Intended for those who want to get started in the domain and learn how to
set up a task, what interfaces are available, how to assess the work, etc.
as well as for those who already have used crowdsourcing and want to
create better tasks and obtain better assessments of the work of the
crowd. It will include screenshots to show examples of good and poor
interfaces; examples of case studies in speech processing tasks, going
through the task creation process, reviewing options in the interface, in
the choice of medium (MTurk or other) and explaining choices. Provides an
insightful and practical introduction to crowdsourcing as a means of
rapidly processing speech data. Addresses important aspects of this new
technique that should be mastered before attempting a crowdsourcing
application. Offers speech researchers the hope that they can spend much
less time dealing with the data gathering/annotation bottleneck, leaving
them to focus on the scientific issues. Readers will directly benefit from
the book’s successful examples of how crowd- sourcing was implemented for
speech processing, discussions of interface and processing choices that
worked and choices that didn’t, and guidelines on how to play and record
speech over the internet, how to design tasks, and how to assess workers.
Essential reading for researchers and practitioners in speech research
groups involved in speech processing.