Title

Mochi: Visual Log-Analysis Based Tools for Debugging Hadoop

Date of Original Version

6-15-2009

Type

Conference Proceeding

Abstract or Table of Contents

Mochi, a new visual, log-analysis based debugging tool correlates Hadoop’s behavior in space, time and volume, and extracts a causal, unified control- and dataflow model of Hadoop across the nodes of a cluster. Mochi’s analysis produces visualizations of Hadoop’s behavior using which users can reason about and debug performance issues. We provide examples of Mochi’s value in revealing a Hadoop job’s structure, in optimizing real-world workloads, and in identifying anomalous Hadoop behavior, on the Yahoo! M45 Hadoop cluster

Comments

From Workshop on Hot Topics in Cloud Computing (HotCloud '09), San Diego, CA, on June 15, 2009