<div dir="ltr">I concur - I used the same cards on our test cluster - just make sure you upgrade the firmware to the latest revision:<div><a href="http://www.mellanox.com/content/pages.php?pg=custom_firmware_table">http://www.mellanox.com/content/pages.php?pg=custom_firmware_table</a><br>
</div><div><br></div><div>The fw upgrade is not trivial - well, it IS trivial, but bringing all the info together was not - if you want some rough notes, let me know.</div><div><br></div><div>the other harry</div><div><br>
</div><div><br></div></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Mon, Jul 8, 2013 at 5:23 AM, Justin Clift <span dir="ltr"><<a href="mailto:jclift@redhat.com" target="_blank">jclift@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On 08/07/2013, at 10:20 AM, HL wrote:<br>
> I am currently testing glusterfs on a small scale non-production env with ordinary nics.<br>
><br>
> I would like to purchase a couple of inifiniband nics in order to connect 3 servers in point to point mode<br>
> that is with no switches in between.<br>
><br>
> Since I've noticed that some of you have this kind of H/W<br>
> Any info on brands/models and<br>
> a "good known to work setup"<br>
> will be highly appreciated.<br>
<br>
Depends on the kind of performance you're after. :)<br>
<br>
If you're just wanting something better than 10GbE at minimal cost,<br>
these work fine under Linux:<br>
<br>
<a href="http://www.ebay.co.uk/itm/360657396651" target="_blank">http://www.ebay.co.uk/itm/360657396651</a><br>
~US$40 each, not counting postage<br>
<br>
They're rebadged Mellanox MHGH28-XTC cards. Completely ok to be<br>
flashed with standard Mellanox firmware.<br>
<br>
For cables, I use these:<br>
<br>
<a href="http://www.ebay.co.uk/itm/251200441924" target="_blank">http://www.ebay.co.uk/itm/251200441924</a><br>
US$14 each, not counting postage<br>
<br>
Note, I'm comfortable getting stuff off eBay where the seller<br>
seems ok. So far, so good. ;)<br>
<br>
If you do decide to use the above stuff, and later on want a switch,<br>
try and find a Voltaire ISR 9024D-M. They're DDR infiniband (20Gb/s<br>
per port), and can run fanless (completely silent).<br>
<br>
<a href="http://www.ebay.co.uk/itm/350827346490" target="_blank">http://www.ebay.co.uk/itm/350827346490</a><br>
<br>
They can be had pretty cheaply if you're willing to wait for good<br>
pricing. I got mine for ~US$270.<br>
<br>
Hope that helps. :)<br>
<br>
Regards and best wishes,<br>
<br>
Justin Clift<br>
<br>
<br>
> Regards,<br>
> Harry<br>
> _______________________________________________<br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
> <a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
--<br>
Open Source and Standards @ Red Hat<br>
<br>
<a href="http://twitter.com/realjustinclift" target="_blank">twitter.com/realjustinclift</a><br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://supercolony.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://supercolony.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div dir="ltr"><div>Data backup by the NSA - your tax dollars at work.</div><div>--</div>Harry Mangalam - Research Computing, OIT, Rm 225 MSTB, UC Irvine<br>[m/c 2225] / 92697 Google Voice Multiplexer: (949) 478-4487<br>
415 South Circle View Dr, Irvine, CA, 92697 [shipping]<br>MSTB Lat/Long: (33.642025,-117.844414) (paste into Google Maps)</div>
</div>