Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk

We examine the trade-offs associated with using Amazon.com 's Mechanical Turk (MTurk) interface for subject recruitment. We first describe MTurk and its promise as a vehicle for performing low-cost and easy-to-field experiments. We then assess the internal and external validity of experiments performed using MTurk, employing a framework that can be used to evaluate other subject pools. We first investigate the characteristics of samples drawn...