Analytics/Kraken/status

Last update on: 2013-10-monthly

2013-09-monthly
* Migrated to OpenJDK 7
 * We upgraded the Hadoop cluster to Cloudera's CDH 4.3.1
 * We have been busy experimenting with Camus to import data from a Kafka broker and write it to HDFS. We have also been experimenting with creating Hive schema's that allow for easy querying of webrequest data.

2013-10-monthly
* Multiple data center configuration for Kafka (message bus) designed and implemented.
 * A bug involving buffer space allocation was exposed and fixed in the Varnish module


 * Infrastructure work done on automated data ingestion and partitioning
 * Product Analyst Oliver Keyes did some exploratory work with Hive and provided feedback to Development team on ease of use and use cases