Tag Archives: ruby

Installing Graylog2 0.9.6, ElasticSearch 0.18.7, & MongoDB 2.0.3 on CentOS 5 (With RVM)

Posted on by
24

Gorilla Party Rocking your logs like an open-source mogul.  

Graylog2‘s moto should be LMFAO (logging my freaking apps off).

Graylog2 is lovely little Splunk-like server that collects your logs and provides a nice interface for searching and analyzing them.

From the site

Graylog2 is an open source log management solution that stores your logs in ElasticSearch. It consists of a server written in Java that accepts your syslog messages via TCP, UDP or AMQP and stores it in the database. The second part is a web interface that allows you to manage the log messages from your web browser.

They have lovely screen shots here.

The only problem with it is it has quite a few moving parts that need to be installed that are not traditionally easy to get going on CentOS.

So, here is my guide.

Continue reading →

Share

The joy of the Opscode Chef Omnibus installer.

Posted on by
3

Finally upgraded to Chef 0.10.6 from 0.9.8.

Hot, sweet, environments and encrypted data bag action.

Except… well… the chef-client would ocassionally die… quetly.

No log, no debug output, no exit codes, just poof… no more chef-client daemon.

(This is not the point there you guys tell me I should use cron or runit or daemontools or something to run chef, I’ve heard it)

The lovely folks at Opscode said that running on ruby 1.8.7 rather than ruby 1.9.2 was the culprit and then drew my attention to the super-happy-awesome Opscode Chef Omnibus installer here (avaliable as rpms, debs, tgz, etc..)

It installs (almost) everything you need into /opt and lets Chef run in it’s own ‘embedded’ ruby 1.9.2 environment keeping my system ruby clean.

Continue reading →

Share

In which I discourse on Java bloat and Cassandra Node Balancing.

Posted on by
5

So, I was hoping to write a little snippet of code to embed on my blog to allow people to get the token ranges for load balancing their cluster.

In Cassandra, when using the random partitioner, all keys are given a token (essentially an md5 of the Key) that is between 0 and 2^127 (0 through 170141183460469231731687303715884105728 for non-nerds). That range is known as the ring.

Each member node of the Cassandra cluster owns a range of those keys on the ring in the same vein you’d divide up a pie.

Continue reading →

Share

First Github Post: Hadoop Chef Cookbook

Posted on by
Reply

Over the last few months we’ve been migrating our infrastructure over to the Chef platform for infrastructure automation.  It is analogous to Puppet, which I’ve tinkered with in the past.

I’ll skip the debate over which is the better tool.  There has been lots of discussion all over about it.  Suffice it to say, we chose Chef for a myriad of reasons and this post isn’t a case study.

My first big chef project was migrating our Hadoop cluster on to it.

Continue reading →

Share