<div dir="ltr"><div class="gmail_default" style="font-family:tahoma,sans-serif">Have you tried this?</div><div class="gmail_default" style="font-family:tahoma,sans-serif"><br></div><div class="gmail_default"><div class="gmail_default">

<font face="tahoma, sans-serif">Work Around until libvirtd fixes the port conflict (<a href="http://review.gluster.org/#/c/6147/">http://review.gluster.org/#/c/6147/</a>)</font></div><div class="gmail_default"><font face="tahoma, sans-serif"><br>

</font></div><div class="gmail_default"><font face="tahoma, sans-serif">Modify /etc/glusterfs/glusterd.vol</font></div><div class="gmail_default"><font face="tahoma, sans-serif">    option base-port 50152</font></div></div>

<div class="gmail_extra">
<br><div class="gmail_default" style="font-family:tahoma,sans-serif">service glusterd restart</div><div class="gmail_default" style="font-family:tahoma,sans-serif"></div><br><div class="gmail_quote">On Sat, Jan 25, 2014 at 1:44 AM, Bernhard Glomm <span dir="ltr">&lt;<a href="mailto:bernhard.glomm@ecologic.eu" target="_blank">bernhard.glomm@ecologic.eu</a>&gt;</span> wrote:<br>

<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div>I submitted </div><div>Bug 1057645 </div><div><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1057645" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1057645</a></div>

<div><br></div><div>Bernhard</div><div><div class="h5"><div><br></div>On 24.01.2014 11:07:49, Bernhard Glomm wrote:<br></div></div><blockquote><div><div class="h5"><blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">samuli wrote: </span><br>

<blockquote><blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">Can you try to set storage.owner-uid and storage.owner-gid to </span><br style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">

<span style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">libvirt-qemu? To do that you have to stop volume.</span><br style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px"><blockquote></blockquote>

</blockquote><blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px"></span></blockquote></blockquote><p>hi samuli, hi all </p><p><br></p><p>I tried setting storage.owner-uid and storage.owner-gid to </p>

<p>libvirt-qemu, as suggested, but with the same effect,</p><p>during livemigration the ownership of the imagefile changes from libvirt-qemu/kvm to root/root</p><p><br></p><p>root@pong[/5]:~ # gluster volume info glfs_atom01</p>

<p> </p><p>Volume Name: glfs_atom01</p><p>Type: Replicate</p><p>Volume ID: f28f0f62-37b3-4b10-8e86-9b373f4c0e75</p><p>Status: Started</p><p>Number of Bricks: 1 x 2 = 2</p><p>Transport-type: tcp</p><p>Bricks:</p><p>Brick1: 172.24.1.11:/ecopool/fs_atom01</p>

<p>Brick2: 172.24.1.13:/ecopool/fs_atom01</p><p>Options Reconfigured:</p><p>storage.owner-gid: 104</p><p>storage.owner-uid: 107</p><p>network.remote-dio: enable</p><p><br></p><p>this is tree -pfungiA &lt;path to where my images live&gt; : atom01 is running</p>

<p><br></p><p>[-rw------- libvirt- kvm     ]  /srv/vms/mnt_atom01/atom01.img</p><p>[drwxr-xr-x libvirt- kvm     ]  /srv/vms/mnt_atom02</p><p>[-rw------- root     root    ]  /srv/vms/mnt_atom02/atom02.img</p><p>[drwxr-xr-x libvirt- kvm     ]  /srv/vms/mnt_atom03</p>

<p><br></p><p>Now I migrate through &quot;VirtualMachineManager&quot; and watching tree</p><p>I see the permission changing to:</p><p><br></p><p>[drwxr-xr-x libvirt- kvm     ]  /srv/vms/mnt_atom01</p><p>[-rw------- root     root    ]  /srv/vms/mnt_atom01/atom01.img</p>

<p>[drwxr-xr-x libvirt- kvm     ]  /srv/vms/mnt_atom02</p><p>[-rw------- root     root    ]  /srv/vms/mnt_atom02/atom02.img</p><p><br></p><p>From inside the atom01 (the VM) the filesystem becomes readonly.</p><p>But in contrast to</p>

<a href="http://epboven.home.xs4all.nl/gluster-migrate.html" style="font-size:13px;font-family:verdana" target="_blank">http://epboven.home.xs4all.nl/gluster-migrate.html</a><br style="font-size:13px;font-family:verdana">

<p>I can still read all file, can checksum them, just no write access</p><p>from outside the image file behaves as Paul described,</p><p>as long as the machine is running I can&#39;t read the file</p><p><br></p><p><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # virsh list</span></p>

<blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif"> Id    Name                           State</span><br><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">----------------------------------------------------</span><br>

<blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif"> 6     atom01                         running</span><br><blockquote><blockquote></blockquote></blockquote><font face="tahoma, arial, helvetica, sans-serif"><br>

</font><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # l /srv/vms/mnt_atom01/atom01.img</span><br><blockquote><blockquote></blockquote></blockquote>

<span style="font-family:tahoma,arial,helvetica,sans-serif">-rw------- 1 root root 10G Jan 24 10:20 /srv/vms/mnt_atom01/atom01.img</span><br><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # file /srv/vms/mnt_atom01/atom01.img</span><br>

<blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">/srv/vms/mnt_atom01/atom01.img: writable, regular file, no read permission</span><br><blockquote><blockquote></blockquote>

</blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # md5sum /srv/vms/mnt_atom01/atom01.img</span><br><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">md5sum: /srv/vms/mnt_atom01/atom01.img: Permission denied</span><br>

<blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # virsh destroy atom01</span><br><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">Domain atom01 destroyed</span><br>

<blockquote><blockquote></blockquote></blockquote><font face="tahoma, arial, helvetica, sans-serif"><br></font><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # l /srv/vms/mnt_atom01/atom01.img</span><br>

<blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">-rw------- 1 root root 10G Jan 24 10:20 /srv/vms/mnt_atom01/atom01.img</span><br><blockquote><blockquote></blockquote>

</blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # file /srv/vms/mnt_atom01/atom01.img</span><br><blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">/srv/vms/mnt_atom01/atom01.img: x86 boot sector; partition 1: ID=0x83, starthead 1, startsector 63, 16777165 sectors; partition 2: ID=0xf, starthead 254, startsector 16777228, 1677718 sectors, code offset 0x63</span><br>

<blockquote><blockquote></blockquote></blockquote><span style="font-family:tahoma,arial,helvetica,sans-serif">root@pong[/5]:~ # md5sum /srv/vms/mnt_atom01/atom01.img</span><br><blockquote><blockquote></blockquote></blockquote>

<span style="font-family:tahoma,arial,helvetica,sans-serif">9d048558deb46fef7b24e8895711c554  /srv/vms/mnt_atom01/atom01.img</span><br><font face="tahoma, arial, helvetica, sans-serif">root@pong[/5]:~ # </font><blockquote style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">

</blockquote><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px"><br></p><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">But interestingly the source of the migration can access the file after migration completed</p>

<p style="font-family:tahoma,arial,helvetica,sans-serif">like so: start atom01 on host &quot;ping&quot;, migrate it to &quot;pong&quot;</p><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px"><br></p><p>

root@pong[/8]:~ # file /srv/vms/mnt_atom01/atom01.img</p><p>/srv/vms/mnt_atom01/atom01.img: writable, regular file, no read permission </p><p>root@ping[/5]:~ # file /srv/vms/mnt_atom01/atom01.img</p><p>/srv/vms/mnt_atom01/atom01.img: x86 boot sector; partition 1: ID=0x83, starthead 1, startsector 63, 16777165 sectors; partition 2: ID=0xf, starthead 254, startsector 16777228, 1677718 sectors, code offset 0x63</p>

<div><br></div><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">100% reproducible </p><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px"><br></p><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">

Regards</p><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px"><br></p><p style="font-family:tahoma,arial,helvetica,sans-serif;font-size:13px">Bernhard</p></div></div>_______________________________________________<div class="im">

<br>Gluster-users mailing list<br><a href="#143c4b5e56a77d0b_">Gluster-users@gluster.org</a><br><a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></div>

</blockquote><span class="HOEnZb"><font color="#888888"><br><br><br></font></span><span><span class="HOEnZb"><font color="#888888">-- <br></font></span><div style><span class="HOEnZb"><font color="#888888">
  </font></span><span class="HOEnZb"><font color="#888888">
    </font></span><span class="HOEnZb"><font color="#888888"></font></span><span class="HOEnZb"><font color="#888888">
      </font></span><table cellpadding="0" cellspacing="5" border="0"><tbody><tr>
      <td colspan="2" style="vertical-align:middle;color:#ffffff;text-align:center" align="center" valign="center">
         <hr style="min-height:2px;background-color:#6f7072;color:#6f7072;border-width:0">
      </td>
    </tr>
    <tr><td style="color:#182983;text-align:center" align="center">
        <img alt="*Ecologic Institute*" height="120" width="129">
      </td>
      <td style="text-align:left;padding-right:10px;white-space:nowrap" align="left">
        <font color="black" face="sans-serif">
          <small>
            <b>Bernhard Glomm</b><br>
            IT Administration<br><br>
          </small>
          <small><small>
            <table cellpadding="0" cellspacing="0" border="0">
              <tbody><tr>
                <td style="white-space:nowrap"><small><small>
                  Phone:
                </small></small></td>
                <td style="padding-left:5px;white-space:nowrap"><small><small>
                  <a href="tel:%2B49%20%2830%29%2086880%20134" value="+493086880134" target="_blank">+49 (30) 86880 134</a>
                </small></small></td>
              </tr>
              <tr>
                <td style="white-space:nowrap"><small><small>
                  Fax:
                </small></small></td>
                <td style="padding-left:5px;white-space:nowrap"><small><small>
                  <a href="tel:%2B49%20%2830%29%2086880%20100" value="+493086880100" target="_blank">+49 (30) 86880 100</a>
                </small></small></td>
              </tr>

              <tr>
                <td style="white-space:nowrap"><small><small>
                  Skype:
                </small></small></td>
                <td style="padding-left:5px;white-space:nowrap"><small><small>
                  bernhard.glomm.ecologic
                </small></small></td>
              </tr>
            </tbody></table>
          </small></small>
        </font>
      </td>
    </tr>
    <tr>
      <td colspan="2" style="vertical-align:middle;text-align:center;background-color:#6f7072;color:#ffffff;white-space:nowrap" align="center" valign="center">
            <a href="http://ecologic.eu" target="_blank"><img title="Visit our website" alt="Website:" height="36" width="36"></a>
            <a href="http://www.youtube.com/v/hZtiK04A9Yo" target="_blank"><img title="Watch our video" alt="| Video:" height="36" width="36"></a>
            <a href="http://ecologic.eu/newsletter/subscribe" target="_blank"><img title="Subscribe to our newsletter" alt="| Newsletter:" height="36" width="36"></a>
            <a href="http://www.facebook.com/Ecologic.Institute" target="_blank"><img title="Visit us on Facebook" alt="| Facebook:" height="36" width="36"></a>
            <a href="http://www.linkedin.com/company/ecologic-institute-berlin-germany" target="_blank"><img title="Visit us on Linkedin" alt="| Linkedin:" height="36" width="36"></a>
            <a href="http://twitter.com/EcologicBerlin" target="_blank"><img title="Visit us on Twitter" alt="| Twitter:" height="36" width="36"></a>
            <a href="http://www.youtube.com/user/EcologicInstitute" target="_blank"><img title="Visit us on YouTube" alt="| YouTube:" height="36" width="36"></a>
            <a href="http://plus.google.com/113756356645020994482" target="_blank"><img title="Visit us on Google+" alt="| Google+:" height="36" width="36"></a>
      </td>
    </tr>
    <tr>
      <td colspan="2" style="padding-right:5px;padding-left:5px;vertical-align:middle;text-align:left;white-space:nowrap" align="left" valign="center">
        <small><small>
          Ecologic Institut gemeinnützige GmbH | Pfalzburger Str. 43/44 | 10717 Berlin | Germany<br>
          GF: R. Andreas Kraemer | AG: Charlottenburg HRB 57947 | USt/VAT-IdNr.: DE811963464<br>
          Ecologic™ is a Trade Mark (TM) of Ecologic Institut gemeinnützige GmbH
        </small></small>
      </td>
    </tr>
    <tr>
      <td colspan="2" style="vertical-align:middle;color:#ffffff;text-align:center" align="center" valign="center">
         <hr style="min-height:2px;background-color:#6f7072;color:#6f7072;border-width:0">
      </td>
    </tr>
  </tbody></table>
</div></span></div>
<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div></div>