Tuesday, March 12, 2013

Acunu - Eric Evans - Castle-enhanced Cassandra

Castle-enhanced Cassandra is a 20 minute video comes from Berlin Buzzwords and was given by Eric Evans of Acunu.

Castle is a new FLOSS storage backend for Linux as a LKM. It's designed to work with the SSTables that Casandra uses for storage. It's a write-optimized storage system that's optimized to work with both rotational disks and SSDs.

It looks like a great project, and glad something like this is open source. It would be interesting to see of other projects can take advantage of this project. There are other NOSQL projects that, while not using SSTs, use similar write-append strategies.

Thanks Acunu!

  - Craig

Wednesday, March 6, 2013

Wired - Return of the Borg: How Twitter Rebuilt Google’s Secret Weapon

Nice article on Wired.com that revolves around the open source Apache incubator project Mesos.

Mesos is considered to be cluster management software. It is designed to take your entire data center and virtualize the resources for applications running under Mesos.

You don't have to set up a dedicated cluster of machines for a single purpose like running Hadoop. Mesos allows you to set up multiple Hadoop cluster instances over the same hardware set to make more effecient use of resources.

Google's system is referred to as Borg, which is fitting. It is being upgraded soon to Omega. The underlying goal is the same, to effeciently use computing resources for all of the required tasks.

Mesos is being supported by a number of engineers and companies including Twitter and some former Google engineers who worked on Borg.

  - Craig