Analytics/Kraken/status

Last update on: 2013-11-monthly

2013-09-monthly
* Migrated to OpenJDK 7
 * We upgraded the Hadoop cluster to Cloudera's CDH 4.3.1
 * We have been busy experimenting with Camus to import data from a Kafka broker and write it to HDFS. We have also been experimenting with creating Hive schema's that allow for easy querying of webrequest data.

2013-10-monthly
The team designed and implemented multiple data center configuration support for Kafka (message bus). A bug involving buffer space allocation was exposed and fixed in the Varnish module, and infrastructure work done on automated data ingestion and partitioning. Product Analyst Oliver Keyes did some exploratory work with Hive and provided feedback to the Development team on ease of use and use cases.

2013-11-monthly
Continued progress made on event delivery via Kafka. Solutions for issues with event delivery from Amsterdam datacenter identified and solutions tested. Solutions also tested for ganglia logging issues. 