Date of Original Version

5-2010

Type

Conference Proceeding

Journal Title

Proceedings of the Seventh International Conference on Language Resources and Evaluation

First Page

1301

Last Page

1308

Rights Management

Copyright by the European Language Resources Association

Abstract or Description

Many contemporary language technology systems are characterized by long pipelines of tools with complex dependencies. Too often, these workflows are implemented by ad hoc scripts; or, worse, tools are run manually, making experiments difficult to reproduce. These practices are difficult to maintain in the face of rapidly evolving workflows while they also fail to expose and record important details about intermediate data. Further complicating these systems are hyperparameters, which often cannot be directly optimized by conventional methods, requiring users to determine which combination of values is best via trial and error. We describe LoonyBin, an open-source tool that addresses these issues by providing: 1) a visual interface for the user to create and modify workflows; 2) a well-defined mechanism for tracking metadata and provenance; 3) a script generator that compiles visual workflows into shell scripts; and 4) a new workflow representation we call a HyperWorkflow, which intuitively and succinctly encodes small experimental variations within a larger workflow.

Share

COinS
 

Published In

Proceedings of the Seventh International Conference on Language Resources and Evaluation, 1301-1308.