in Clojure on Graph schema, Pail, Cascalog, Clojure, Big data
Using Graph Schema with Pail and Cascalog.
In a previous post I wrote about using Thrift, Pail and Cascalog. In this post I’ll expand on that, or rather simplify that example with an extension library, Pail-Graph. More specifically this is about using Pail with a Graph Schema, which is a little bit more specialized than just using thrift and Pail. The use of Graph Schema and the likeness of the example Graph Schema comes from Nathan Marz’ Book on Big Data. Like everything else I’ve done lately this is all based on David Cuddeback’s clj-pail, clj-thrift, pail-thrift and pail-cascalog libraries. Pail-graph wraps and extends each of the libraries. The Pail-Graph library mostly simplifies using a graph-schema with pail and Cascalog. Pail-Graph is available on Clojars. All of the code in this post is available in the pail-graph example in the library on github. Just like the last time, clone my repository fire up a REPL and follow along!
on Thrift, Pail, Cascalog, Clojure, Graph schema, Nathan marz, Big data
Using Thrift, Pail and Cascalog in Clojure.
Thrift, Pail, Cascalog and Clojure have been consuming my work for the last 2 months. It isn’t that hard. It’s just that there isn’t much in the way of documentation. In this post I’ll show how to get all of these things working together. It’s actually pretty easy and it’s very slick once it’s working. Many thanks to David Cuddeback and his clj-thrift, clj-pail,pail-thrift, and pail-cascalog libraries.
in Clojure on Fressian, Pail, Cascalog, Clojure, Big data
Using Fressian with Pails and Cascalog in Clojure.
In my Previous post I wrote about using Thrift, Pail and Cascalog. In this post I’ll replace thrift and graph schema with Fressian and native data types. It turns out that Fressian, Pail, and Cascalog go together like peanut butter and jelly. As before this is based on David Cuddeback’s clj-pail and pail-cascalog libraries. Instead of pail-thrift I have a new Pail-Fressian library which handles the details of using Fressian with Pail. Pail-Fressian on clojars All of the code in this post is available in an [example repository] (https://github.com/EricGebhart/Pail-Fressian/blob/master/src/example/example.clj) Clone my repository, fire up a REPL and follow along!