<div dir="ltr">Apologies for sending so many messages about this! I think I may be running into this bug:<div><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1105283">https://bugzilla.redhat.com/show_bug.cgi?id=1105283</a><br></div><div><br></div><div>Would someone be so kind as to let me know which symlinks are missing when this bug manifests, so that I can create them?</div><div><br></div><div>Thank you,</div><div>Dave</div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Sun, Dec 7, 2014 at 11:01 AM, David Gibbons <span dir="ltr">&lt;<a href="mailto:david.c.gibbons@gmail.com" target="_blank">david.c.gibbons@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Ok,<div><br></div><div>I was able to get geo-replication configured by changing /usr/local/libexec/glusterfs/gverify.sh to use ssh to access the local machine, instead of accessing bash -c directly. I then found that the hook script was missing for geo-replication, so I copied that over manually. I now have what appears to be a &quot;configured&quot; geo-rep setup:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"># gluster volume geo-replication shares gfs-a-bkp::bkpshares status</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><br></blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">MASTER NODE                     MASTER VOL    MASTER BRICK                     SLAVE                   STATUS         CHECKPOINT STATUS    CRAWL STATUS</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">--------------------------------------------------------------------------------------------------------------------------------------------------------</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-3                         shares        /mnt/a-3-shares-brick-1/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-3                         shares        /mnt/a-3-shares-brick-2/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-3                         shares        /mnt/a-3-shares-brick-3/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-3                         shares        /mnt/a-3-shares-brick-4/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-2                         shares        /mnt/a-2-shares-brick-1/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-2                         shares        /mnt/a-2-shares-brick-2/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-2                         shares        /mnt/a-2-shares-brick-3/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-2                         shares        /mnt/a-2-shares-brick-4/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-4                         shares        /mnt/a-4-shares-brick-1/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-4                         shares        /mnt/a-4-shares-brick-2/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-4                         shares        /mnt/a-4-shares-brick-3/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-4                         shares        /mnt/a-4-shares-brick-4/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-1                         shares        /mnt/a-1-shares-brick-1/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-1                         shares        /mnt/a-1-shares-brick-2/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-1                         shares        /mnt/a-1-shares-brick-3/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gfs-a-1                         shares        /mnt/a-1-shares-brick-4/brick    gfs-a-bkp::bkpshares    Not Started    N/A                  N/A</blockquote></blockquote><div><br></div><div>So that&#39;s a step in the right direction (and I can upload a patch for gverify to a bugzilla). However, gverify *should* have worked with bash-c, and I was not able to figure out why it didn&#39;t work, other than it didn&#39;t seem able to find some programs. I&#39;m thinking that maybe the PATH variable is wrong for Gluster, and that&#39;s why gverify didn&#39;t work out of the box. </div><div><br></div><div>When I attempt to start geo-rep now, I get the following in the geo-rep log:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">[2014-12-07 10:52:40.893594] E [syncdutils(monitor):218:log_raise_exception] &lt;top&gt;: execution of &quot;gluster&quot; failed with ENOENT (No such file or directory)</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">[2014-12-07 10:52:40.893886] I [syncdutils(monitor):192:finalize] &lt;top&gt;: exiting.</blockquote><div><br></div><div>Which seems to agree that maybe gluster isn&#39;t running with the same path variable that my console session is running with. Is this possible? I know I&#39;m grasping :).</div><div><br></div><div>Any nudge in the right direction would be very much appreciated!</div><div><br></div><div>Cheers,<br>Dave</div><div><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Dec 6, 2014 at 10:06 AM, David Gibbons <span dir="ltr">&lt;<a href="mailto:david.c.gibbons@gmail.com" target="_blank">david.c.gibbons@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Good Morning,<div><br></div><div>I am having some trouble getting geo-replication started on a 3.5.3 volume.</div><div><br></div><div>I have verified that password-less SSH is functional in both directions from the backup gluster server, and all nodes in the production gluster. I have verified that all nodes in production and backup cluster are running the same version of gluster, and that name resolution works in both directions.</div><div><br></div><div>When I attempt to start geo-replication with this command:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">gluster volume geo-replication shares gfs-a-bkp::bkpshares create push-pem<br></blockquote><div><br></div><div>I end up with the following in the logs:</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"> [2014-12-06 15:02:50.284426] E [glusterd-geo-rep.c:1889:glusterd_verify_slave] 0-: Not a valid slave</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">[2014-12-06 15:02:50.284495] E [glusterd-geo-rep.c:2106:glusterd_op_stage_gsync_create] 0-: gfs-a-bkp::bkpshares is not a valid slave volume. Error: Unable to fetch master volume details. Please check the master cluster and master volume.</blockquote><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">[2014-12-06 15:02:50.284509] E [glusterd-syncop.c:912:gd_stage_op_phase] 0-management: Staging of operation &#39;Volume Geo-replication Create&#39; failed on localhost : Unable to fetch master volume details. Please check the master cluster and master volume.</blockquote><div><br></div><div>Would someone be so kind as to point me in the right direction?</div><div><br></div><div>Cheers,</div><div>Dave </div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>