<div dir="ltr"><br><div class="gmail_extra"><br><br><div class="gmail_quote">On Wed, Apr 30, 2014 at 5:56 AM, Venky Shankar <span dir="ltr">&lt;<a href="mailto:vshankar@redhat.com" target="_blank" onclick="window.open(&#39;https://mail.google.com/mail/?view=cm&amp;tf=1&amp;to=vshankar@redhat.com&amp;cc=&amp;bcc=&amp;su=&amp;body=&#39;,&#39;_blank&#39;);return false;">vshankar@redhat.com</a>&gt;</span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
  
    
  
  <div bgcolor="#FFFFFF" text="#000000"><div class="">
    <div>On 04/29/2014 11:12 PM, Steve Dainard
      wrote:<br>
    </div>
    <blockquote type="cite">
      <pre>Fixed by editing the geo-rep volumes gsyncd.conf file, changing
/nonexistent/gsyncd to /usr/libexec/glusterfs/gsyncd on both the master
nodes.</pre>
    </blockquote>
    <br>
    </div><tt>That is not required. Did you invoke &quot;create&quot; command with
      push-pem?</tt></div></blockquote><div><br></div><div>Yes, I iterated through every single option, including create push-pem.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><div class=""><br>
    <br>
    <blockquote type="cite">
      <pre>Any reason why this is in the default template? Also any reason why when I
stop glusterd, change the template on both master nodes and start the
gluster service its overwritten?</pre>
    </blockquote>
    <br>
    </div><tt>It&#39;s not as the default template as it&#39;s unsafe and is logged
      clearly in the geo-rep logs as a misconfigured setup.</tt></div></blockquote><div><br></div><div>I referenced the link in the error logs, and there doesn&#39;t seem to be a configuration issue. Is something missing from these doc&#39;s seeing as this is the commercial version of glusterfs vs community?</div>
<div><br></div><div>Can you clarify what the configuration issue is? This &quot;<span style="font-family:arial,sans-serif;font-size:13px">bash: /nonexistent/gsyncd: No such file or directory&quot; is sticking out like a sore thumb as a bad reference to a binary. </span></div>
<div><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div><div><span style="font-family:arial,sans-serif;font-size:13px">What is unsafe?</span></div><div><span style="font-family:arial,sans-serif;font-size:13px"><br>
</span></div><div><span style="font-family:arial,sans-serif;font-size:13px">Thanks,</span></div><div><span style="font-family:arial,sans-serif;font-size:13px">Steve</span></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000"><br>
    <br>
    <blockquote type="cite"><div><div class="h5">
      <pre>Steve


On Tue, Apr 29, 2014 at 12:11 PM, Steve Dainard <a href="mailto:sdainard@miovision.com" target="_blank" onclick="window.open(&#39;https://mail.google.com/mail/?view=cm&amp;tf=1&amp;to=sdainard@miovision.com&amp;cc=&amp;bcc=&amp;su=&amp;body=&#39;,&#39;_blank&#39;);return false;">&lt;sdainard@miovision.com&gt;</a>wrote:

</pre>
      <blockquote type="cite">
        <pre>Just setup geo-replication between two replica 2 pairs, gluster version
3.5.0.2.

Following this guide:
<a href="https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.1/html/Administration_Guide/chap-User_Guide-Geo_Rep-Preparation-Settingup_Environment.html" target="_blank">https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.1/html/Administration_Guide/chap-User_Guide-Geo_Rep-Preparation-Settingup_Environment.html</a>

Status is faulty/passive:

# gluster volume geo-replication rep1 10.0.11.4::rep1 status

MASTER NODE                MASTER VOL    MASTER BRICK
      SLAVE              STATUS     CHECKPOINT STATUS    CRAWL STATUS


------------------------------------------------------------------------------------------------------------------------------------------------
ovirt001.miovision.corp    rep1
 /mnt/storage/lv-storage-domain/rep1    10.0.11.4::rep1    faulty     N/A
                 N/A
ovirt002.miovision.corp    rep1
 /mnt/storage/lv-storage-domain/rep1    10.0.11.5::rep1    Passive    N/A
                 N/A


geo-replication log from master:

[2014-04-29 12:00:07.178314] I [monitor(monitor):129:monitor] Monitor:
------------------------------------------------------------
[2014-04-29 12:00:07.178550] I [monitor(monitor):130:monitor] Monitor:
starting gsyncd worker
[2014-04-29 12:00:07.344643] I
[gsyncd(/mnt/storage/lv-storage-domain/rep1):532:main_i] &lt;top&gt;: syncing:
gluster://localhost:rep1 -&gt; <a>ssh://root@10.0.11.4:gluster://localhost:rep1</a>
[2014-04-29 12:00:07.357718] D
[repce(/mnt/storage/lv-storage-domain/rep1):175:push] RepceClient: call
21880:139789410989824:1398787207.36 __repce_version__() ...
[2014-04-29 12:00:07.631556] E
[syncdutils(/mnt/storage/lv-storage-domain/rep1):223:log_raise_exception]
&lt;top&gt;: connection to peer is broken
[2014-04-29 12:00:07.631808] W
[syncdutils(/mnt/storage/lv-storage-domain/rep1):227:log_raise_exception]
&lt;top&gt;: !!!!!!!!!!!!!
[2014-04-29 12:00:07.631947] W
[syncdutils(/mnt/storage/lv-storage-domain/rep1):228:log_raise_exception]
&lt;top&gt;: !!! getting &quot;No such file or directory&quot; errors is most likely due to
MISCONFIGURATION, please consult
<a href="https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.1/html/Administration_Guide/chap-User_Guide-Geo_Rep-Preparation-Settingup_Environment.html" target="_blank">https://access.redhat.com/site/documentation/en-US/Red_Hat_Storage/2.1/html/Administration_Guide/chap-User_Guide-Geo_Rep-Preparation-Settingup_Environment.html</a>
[2014-04-29 12:00:07.632061] W
[syncdutils(/mnt/storage/lv-storage-domain/rep1):231:log_raise_exception]
&lt;top&gt;: !!!!!!!!!!!!!
[2014-04-29 12:00:07.632251] E
[resource(/mnt/storage/lv-storage-domain/rep1):204:errlog] Popen: command
&quot;ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no -i
/var/lib/glusterd/geo-replication/secret.pem -oControlMaster=auto -S
/tmp/gsyncd-aux-ssh-0_wqaI/cb6bb9e3af32ccbb7c8c0ae955f728db.sock
<a href="mailto:root@10.0.11.4" target="_blank" onclick="window.open(&#39;https://mail.google.com/mail/?view=cm&amp;tf=1&amp;to=root@10.0.11.4&amp;cc=&amp;bcc=&amp;su=&amp;body=&#39;,&#39;_blank&#39;);return false;">root@10.0.11.4</a> /nonexistent/gsyncd --session-owner
c0a6c74c-deb5-4ed0-9ef9-23756d593197 -N --listen --timeout 120
gluster://localhost:rep1&quot; returned with 127, saying:
[2014-04-29 12:00:07.632396] E
[resource(/mnt/storage/lv-storage-domain/rep1):207:logerr] Popen: ssh&gt;
bash: /nonexistent/gsyncd: No such file or directory
[2014-04-29 12:00:07.632689] I
[syncdutils(/mnt/storage/lv-storage-domain/rep1):192:finalize] &lt;top&gt;:
exiting.
[2014-04-29 12:00:07.634656] I [monitor(monitor):150:monitor] Monitor:
worker(/mnt/storage/lv-storage-domain/rep1) died before establishing
connection

Thanks,
Steve


</pre>
      </blockquote>
      <br>
      <fieldset></fieldset>
      <br>
      </div></div><pre>_______________________________________________
Gluster-users mailing list
<a href="mailto:Gluster-users@gluster.org" target="_blank" onclick="window.open(&#39;https://mail.google.com/mail/?view=cm&amp;tf=1&amp;to=Gluster-users@gluster.org&amp;cc=&amp;bcc=&amp;su=&amp;body=&#39;,&#39;_blank&#39;);return false;">Gluster-users@gluster.org</a>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a></pre>
    </blockquote>
    <br>
  </div>

<br>_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" onclick="window.open(&#39;https://mail.google.com/mail/?view=cm&amp;tf=1&amp;to=Gluster-users@gluster.org&amp;cc=&amp;bcc=&amp;su=&amp;body=&#39;,&#39;_blank&#39;);return false;">Gluster-users@gluster.org</a><br>

<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br></blockquote></div><br></div></div>