<div dir="ltr"><div>Bernhard,</div>Just based on my *nix admin experience, "Address already in use" means that some process is already listening on the address and port listed. In your case, are you sure the old GlusterFS processes are stopped prior to starting the new? A "sudo netstat -lnp |grep 49153" would show what was holding the port and preventing GlusterFS 3.4.x from binding to it. If you're not seeing anything there, it's more likely you've hit some upgrade bug.</div>
<div class="gmail_extra"><br><br><div class="gmail_quote">On Sun, Dec 1, 2013 at 8:41 AM, Josh Boon <span dir="ltr"><<a href="mailto:gluster@joshboon.com" target="_blank">gluster@joshboon.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><div style="font-size:10pt;font-family:Arial"><div>Hey Bernhard,<br></div><div><br></div><div>That was just enough to jog my memory :) Gluster 3.4 changed the port selection they used. They went from ports 24007-24012 in gluster 3.3 to 49153 and up in 3.4 The problem is that libvirt and gluster aren't aware of each other and and when qemu doesn't get its port it thinks the world is ending and gives up. I found trying the migration a second time can help. You can also track the full problem over at <a href="https://bugzilla.redhat.com/show_bug.cgi?id=987555" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=987555</a> which has both teams in there discussing how to handle the port stuff. If you absolutely need live migration you can do it by hand using qemu directly and pick your ports as to not collide until the port range problem is solved.<br>
</div><div><br></div><div>Also you should consider moving your guests images to using gfapi instead of the gluster FUSE mount you're using if you need more performance. It requires a couple hacks and a recompile on Ubuntu but we use it over here and couldn't live without it. I'll be posting a writeup soon if you're interested.<br>
</div><div><br></div><div>Best,<br></div><div>Josh<br></div><div><br></div><hr><div style="font-size:12pt;font-style:normal;font-family:Helvetica,Arial,sans-serif;text-decoration:none;font-weight:normal"><b>From: </b>"Bernhard Glomm" <<a href="mailto:bernhard.glomm@ecologic.eu" target="_blank">bernhard.glomm@ecologic.eu</a>><br>
<b>To: </b><a href="mailto:gluster@joshboon.com" target="_blank">gluster@joshboon.com</a><br><b>Sent: </b>Sunday, December 1, 2013 11:25:07 AM<br><b>Subject: </b>Re: [Gluster-users] glusterfs 3.4<br><div><br></div>Hey Josh,<br>
<div><br></div>thnx for reply<br>well to be honest... nothing special at all.<br>I didn't set any special gluster options.<br>I created the mirror like before in 3.3<br>gluster volume create <vol_name> replica 2 <ip>:/<path> <ip>:/<path><br>
EXACT the same command both times (thnx copyndpaste ;-)<br>I mounted the volume exactly the same on both machines<br>mount -t glusterfs <my_own_ip>:/<vol-name> <mountpoint><br>(asuming this is fuse mount?)<br>
I (tried to) migrate/ed the VM with the same command<br>migrate --verbose --live --unsafe --p2p --domain <dom_name> --desturi qemu+ssh://<ip>/system<br><div><br></div>with version 3.3 no problem<br>with version 3.4.1 I got<div class="im">
<br>"-incoming tcp:<a href="http://0.0.0.0:49153" target="_blank">0.0.0.0:49153</a>: Failed to bind socket: Address already in use"<br><div><br></div></div>any hints on this?<br><div><br></div>I can do with 3.3 for now, works like a charm <br>
but would be happy to feel more comfortable about possible upgrades ;-)<br><div><br></div>best<br>Bernhard<br><div><br></div><br>Am 30.11.2013 23:27:14, schrieb Josh Boon:<div><div class="h5"><br><blockquote><div style="font-size:10pt;font-family:Arial">
<div>Hey Bernhard,<br></div><div><br></div><div>I'm running a very similar setup to you. What are your gluster options? What's the migration command you're using? Are you using gfapi or a fuse mount? I think I've hit this error before but I'll need some info to jog brain on how I fixed it. <br>
</div><div><br></div><div>Best,<br></div><div>Josh<br></div><div><br></div><hr><div style="font-size:12pt;font-style:normal;font-family:Helvetica,Arial,sans-serif;text-decoration:none;font-weight:normal"><b>From: </b>"Bernhard Glomm" <<a href="mailto:bernhard.glomm@ecologic.eu" target="_blank">bernhard.glomm@ecologic.eu</a>><br>
<b>To: </b><a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br><b>Sent: </b>Saturday, November 30, 2013 8:13:26 AM<br><b>Subject: </b>[Gluster-users] glusterfs 3.4<br><div><br></div>
Hi all, I just stumbled over a possible bug in glusterfs-3.4.1 Since I used the package from ppa:semiosis/ubuntu-glusterfs-3.4 for ubuntu (running 13.04 up to date) I like to report here first / ask for confirmation. I had glusterfs 3.3 installed and it worked fine. I used it as the storage backend for the image files of my kvm virtualized instances (two sided mirror/two kvm hosts running four VM as a test environment) I upgraded to 3.4 and all seemed okay on the first glance, but live-migration failed with error: "-incoming tcp:<a href="http://0.0.0.0:49153" target="_blank">0.0.0.0:49153</a>: Failed to bind socket: Address already in use" reverting back to glusterfs 3.3 and the problem was gone anybody knows about that prob? couldn't find anything on the net about it yet. best regards Bernhard -- sysadmin <a href="http://www.ecologic.eu" target="_blank">www.ecologic.eu</a><br>
_______________________________________________<br>Gluster-users mailing list<br><a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br><a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></div>
<div><br></div></div></blockquote><br><div><br></div><br></div></div><span><span>-- <br></span></span><div style><table cellpadding="0" cellspacing="5" border="0"><tbody><tr><td colspan="2" style="vertical-align:middle;color:#ffffff;text-align:center" align="center" valign="center">
<hr style="min-height:2px;background-color:#6f7072;color:#6f7072;border-width:0"></td></tr><tr><td style="color:#182983;text-align:center" align="center"><img alt="*Ecologic Institute*" height="120" width="129"></td><td style="text-align:left;padding-right:10px;white-space:nowrap" align="left">
<span style="font-family:sans-serif" color="black" face="sans-serif"><span style="font-family:sans-serif" color="black" face="sans-serif"> <small> <b>Bernhard Glomm</b><br> IT Administration<br></small></span></span><div>
<br></div><table cellpadding="0" cellspacing="0" border="0"><tbody><tr><td style="white-space:nowrap"><small><small> Phone: </small></small></td><td style="padding-left:5px;white-space:nowrap"><small><small> <a href="tel:%2B49%20%2830%29%2086880%20134" value="+493086880134" target="_blank">+49 (30) 86880 134</a> </small></small></td>
</tr><tr><td style="white-space:nowrap"><small><small> Fax: </small></small></td><td style="padding-left:5px;white-space:nowrap"><small><small> <a href="tel:%2B49%20%2830%29%2086880%20100" value="+493086880100" target="_blank">+49 (30) 86880 100</a> </small></small></td>
</tr><tr><td style="white-space:nowrap"><small><small> Skype: </small></small></td><td style="padding-left:5px;white-space:nowrap"><small><small> bernhard.glomm.ecologic </small></small></td></tr></tbody></table></td></tr>
<tr><td colspan="2" style="vertical-align:middle;text-align:center;background-color:#6f7072;color:#ffffff;white-space:nowrap" align="center" valign="center"><a href="http://ecologic.eu" target="_blank"><img title="Visit our website" alt="Website:" height="36" width="36"></a> <a href="http://www.youtube.com/v/hZtiK04A9Yo" target="_blank"><img title="Watch our video" alt="| Video:" height="36" width="36"></a> <a href="http://ecologic.eu/newsletter/subscribe" target="_blank"><img title="Subscribe to our newsletter" alt="| Newsletter:" height="36" width="36"></a> <a href="http://www.facebook.com/Ecologic.Institute" target="_blank"><img title="Visit us on Facebook" alt="| Facebook:" height="36" width="36"></a> <a href="http://www.linkedin.com/company/ecologic-institute-berlin-germany" target="_blank"><img title="Visit us on Linkedin" alt="| Linkedin:" height="36" width="36"></a> <a href="http://twitter.com/EcologicBerlin" target="_blank"><img title="Visit us on Twitter" alt="| Twitter:" height="36" width="36"></a> <a href="http://www.youtube.com/user/EcologicInstitute" target="_blank"><img title="Visit us on YouTube" alt="| YouTube:" height="36" width="36"></a> <a href="http://plus.google.com/113756356645020994482" target="_blank"><img title="Visit us on Google+" alt="| Google+:" height="36" width="36"></a><br>
</td></tr><tr><td colspan="2" style="padding-right:5px;padding-left:5px;vertical-align:middle;text-align:left;white-space:nowrap" align="left" valign="center"><small><small> Ecologic Institut gemeinnützige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin | Germany<br>
GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: DE811963464<br> Ecologic™ is a Trade Mark (TM) of Ecologic Institut gemeinnützige GmbH </small></small></td></tr><tr><td colspan="2" style="vertical-align:middle;color:#ffffff;text-align:center" align="center" valign="center">
<hr style="min-height:2px;background-color:#6f7072;color:#6f7072;border-width:0"></td></tr></tbody></table></div></div><div><br></div></div></div><br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br>Justin Dossey<br>
CTO, PodOmatic<div><br></div>
</div>