<div dir="ltr">+1 for a gluster/Thrift service that serves up metadata and or files.
not sure how it would be distributed though. but i would love that :) <br><br><br><div class="gmail_extra"><br><br><div class="gmail_quote">On Fri, Feb 15, 2013 at 12:46 AM, Brad Childs <span dir="ltr"><<a href="mailto:bdc@redhat.com" target="_blank">bdc@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I'm
working on a hadoop/gluster integration. First, whoever wrote the
initial map/reduce gluster DFS layer did a great job. Same with the
FUSE layer-- FUSE alone solves a lot of problems.<br>
<br>
However, some of the hadoop architectures require cross language (java)
bindings with gluster (c). Other's I've talked to about cross language
bindings have shown interest in gluster--> python and ruby bindings.
From the research I've done, most of a common language interface is
simple and the only tricky part is data serialization. <br>
<br>
I'm not an expert in data serialization across programming languages so
it's been a lot of research. There's a few new and old solutions to the
problem but I think the older non IDL solutions are obvious and not
really that interesting (RPC, ASN.1, raw JNI or other language specific
native access).<br>
<br>
Moving up to IDL abstractions, there's Thrift, Protobuf and SWIG. SWIG
is really good for simple multi-language bindings but requires manual
data serialization.<br>
<br>
>From my research the common solutions for multi-language serialization
today is either protobuf or thrift. Thrift is a facebook originated
solution (now under apache) and protobuf is google's open solution.<br>
<br>
I'm leaning towards thrift since it's apache. A few of the hadoop
architectures already support thrift so that would simplify things.
What's your opinion? Is anyone familiar with, or already solved I/O
serialization across programming languages in gluster? I'd love some
feedback and discussion. <br>
<br>
Links:<br>
SWIG: <a href="http://www.swig.org/" target="_blank">http://www.swig.org/</a><br>
Protobuf: <a href="http://code.google.com/p/protobuf/" target="_blank">http://code.google.com/p/protobuf/</a><br>
Serialization Discussion: <a href="http://stackoverflow.com/questions/4633611/what-are-the-key-differences-between-apache-thrift-google-protocol-buffers-mes" target="_blank">http://stackoverflow.com/questions/4633611/what-are-the-key-differences-between-apache-thrift-google-protocol-buffers-mes</a><br>
Previous Gluster Interface Pitch: <a href="https://fedoraproject.org/wiki/Summer_coding_ideas_for_2012#Implement_a_binding_translator_for_GlusterFS" target="_blank">https://fedoraproject.org/wiki/Summer_coding_ideas_for_2012#Implement_a_binding_translator_for_GlusterFS</a><br>
<br>
Humor: <a href="http://www.quickmeme.com/meme/3t05wa/" target="_blank">http://www.quickmeme.com/meme/3t05wa/</a><br>
<br>
<br>
Thanks!<br>
bradley childs<br>
<br>
_______________________________________________<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@nongnu.org">Gluster-devel@nongnu.org</a><br>
<a href="https://lists.nongnu.org/mailman/listinfo/gluster-devel" target="_blank">https://lists.nongnu.org/mailman/listinfo/gluster-devel</a><br>
</blockquote></div><br><br clear="all"><br>-- <br>Jay Vyas<br><a href="http://jayunit100.blogspot.com" target="_blank">http://jayunit100.blogspot.com</a>
</div></div>