Date of Original Version

6-2015

Type

Conference Proceeding

Journal Title

Journal of Machine Learning Research : Workshop and Conference Proceedings

Volume

37

First Page

87

Last Page

96

Rights Management

Copyright 2015 by the author(s).

Abstract or Description

We propose a new method for learning word representations using hierarchical regularization in sparse coding inspired by the linguistic study of word meanings. We show an efficient learning algorithm based on stochastic proximal methods that is significantly faster than previous approaches, making it possible to perform hierarchical sparse coding on a corpus of billions of word tokens. Experiments on various benchmark tasks—word similarity ranking, syntactic and semantic analogies, sentence completion, and sentiment analysis—demonstrate that the method outperforms or is competitive with state-of-the-art methods.

Share

COinS
 

Published In

Journal of Machine Learning Research : Workshop and Conference Proceedings, 37, 87-96.