
Using crowdsourcing for TREC relevance assessment
Keywords: مجموعه تست; IR evaluation; Test collections; Relevance assessment; Crowdsourcing; TREC; Amazon Mechanical Turk; Experimental design