Date of Original Version

7-2015

Type

Conference Proceeding

Rights Management

Copyright © 2015 International Joint Conferences on Artificial Intelligence

Abstract or Description

Motivated by a radically new peer review system that the National Science Foundation recently experimented with, we study peer review systems in which proposals are reviewed by PIs who have submitted proposals themselves. An (m, k)-selection mechanism asks each PI to review m proposals, and uses these reviews to select (at most) k proposals. We are interested in impartial mechanisms, which guarantee that the ratings given by a PI to others’ proposals do not affect the likelihood of the PI’s own proposal being selected. We design an impartial mechanism that selects a k-subset of proposals that is nearly as highly rated as the one selected by the non-impartial (abstract version of) the NSF pilot mechanism, even when the latter mechanism has the “unfair” advantage of eliciting honest reviews

Share

COinS
 

Published In

Proceedings of the International Joint Conference on Artificial Intelligence, 2015, 582-588.