Lately I've been using Pallet, a Platform as a Service (PaaS) library written in Clojure. It's great to see the building blocks of cloud computing coming together in libraries, prime for using to create new innovative packaging and deployment capabilities. You can think of Pallet as Chef Recipes or Puppet, but instead of configuration files or Ruby, you write Clojure. One of the main reasons I like Pallet is that it is a rich library to build your own PaaS capability, and requires very little from the nodes you build. In fact, the only dependency is being able to SSH into a node and execute commands. No agents, no servers, no repositories out of the box. Copying jar files, executing apt-get, etc are all possible and you have flexibility to build what you want.
While the Pallet site has comprehensive API documentation, there is only one quick start that gets you going with EC2. While I enjoy EC2 as much as the next person, the use case I was working on called for a more local development environment. As luck would have it, Pallet has a library called VMFest, which is an abstraction over Oracle's VirtualBox. Later, we would also pickup their Docker support, but that's a story for another day. The nice thing about VMFest is you can use VirtualBox as a cloud provider. On a reasonable piece of hardware, this means you can spin up virtual machines in 5-7 minutes, and they're full VMs that you can control. Last but not least, I wanted Ubuntu and Java on these VMs as a solid base example to work from. The following is a walk through of how to get started with Pallet, use VMFest as a good starter compute service, and install your first package - Java.
Pallet-java-example, the tutorial repo, is in Github.
Prerequisites:
With these requirements in hand, let's look at how you create this environment. i started with the Pallet lein plugin for creating an example project.
lein new pallet example
With the environment in place, I then proceeded to modify the project.clj file to include the VMFest dependencies, and the Pallet Java crate. In pallet, a crate is a collection of functions that are grouped together as a reusable unit, much like a Chef recipe.
You will notice that we use the Virtual Box web service. There is also a local COM interface, which I presume is higher performing but is not portable across all environments. For this environment, a few more miliseconds to talk to the VirtualBox isn't a big deal, so we'll go portability for ease of setup on different environments. One important note, you cannot have both vbox dependencies in your configuration, as they use classpath loading and clash with eachother.
The next step is to look at what the lein pallet plugin generated for us. The good news is that this is almost everything we need. Let's take a look at the edited file:
In pallet terms, a node is an instance of a software stack running on a compute service, i.e. a VM in our instance with all of the software installed. You'll see that we have a node-spec, some server-specs, and a group-spec. Pallet provides flexibility in defining profiles of what you want the node (e.g. machine level parameters), sever (most of your software), and the group (your cluster). These are all then converged or lifted together (i.e. deployed). These layers of configuration are applied in order of phases: bootstrap, install, configure.
Some important notes here
Now we're just about ready to create our cluster, but first we need to get our Ubuntu base image, and then pull it all together.
There are a couple things going on here:
This should help folks get started with Pallet, gives you an introduction to a PaaS running on your local server, and is a fun way to apply Clojure to a domain. Big thanks go out to Hugo Duncan and Antoni Batechilli, they both are very helpful to all who join #pallet and get started.
To recap the links:
Enjoy!