CFP: Human Computation Conference 2021

HCOMP is the home of the human computation and crowdsourcing community. It is the premier venue for presenting latest findings from research and practice into frameworks, methods and systems that bring together people and machine intelligence to achieve better results.

While artificial intelligence (AI) and human-computer interaction (HCI) represent traditional mainstays of the conference, HCOMP believes strongly in fostering and promoting broad, interdisciplinary research. Our field is particularly unique in the diversity of disciplines it draws upon and contributes to, including human-centered qualitative studies and HCI design, social computing, artificial intelligence, economics, computational social science, digital humanities, policy, and ethics. We promote the exchange of advances in human computation and crowdsourcing not only among researchers, but also engineers and practitioners, to encourage dialogue across disciplines and communities of practice.

Submissions may cover theory, studies, tools and applications that present novel, interesting, impactful interactions between people and computational systems. These cover a broad range of scenarios, from classical human computation, wisdom of the crowds, and all forms of crowdsourcing to people-centric AI methods, systems and applications.

Topics of interest include:

• Crowdsourcing applications and techniques, including but not limited to: citizen science, collective action, collective intelligence, wisdom of the crowds, crowdsourcing contests, crowd creativity, crowdfunding, paid microtasks, crowd ideation, crowd sensing, prediction markets.
• Techniques that enable and enhance human-in-the-loop systems, making them more efficient, accurate, and human-friendly, including task design, quality assurance, answer inference, biases and subjectivity, incentives, gamification, task allocation, complex workflows, real-time crowdsourcing etc.
• Approaches to make crowd science FAIR (Findable, Accessible, Interoperable, Reproducible) and studies assessing and commenting on the FAIRness of human computation and crowdsourcing practice.
• Studies into the reliability and other quality aspects of human-annotated and -curated datasets.
• Studies into replicability of crowdsourcing and human computation experiments.
• Methods that use human computation and crowdsourcing to build people-centric AI systems and applications, including topics such as explainability and interpretability.
• Studies about how people perform tasks individually, in groups, or as a crowd, including those drawing on techniques from human-computer interaction, social computing, computer-supported cooperative work, design, cognitive sciences, behavioral sciences, economics, etc.
• Studies into fairness, accountability, transparency, ethics, and policy implications for crowdsourcing and human computation.
• Studies about how people and intelligent systems interact and collaborate with each other and studies revealing the influences and impact of intelligent systems on society.
• Studies that inform our understanding about the future of work, distributed work, the freelancer economy, open innovation and citizen-led innovation.

SUBMISSION

Authors are invited to submit papers of up to 10 pages, plus any number of additional pages containing references only.

All submitted papers must represent original work, not previously published or under simultaneous peer-review for any other peer-reviewed, archival conference or journal.

Papers must be formatted in AAAI two-column, camera-ready style; please refer to the AAAI 2021 Author Kit for details. The AAAI copyright block is not required on submissions, but must be included on final accepted versions.

Electronic abstract and paper submission through the HCOMP-21 EasyChair paper submission site is required on or before the deadlines listed above. We cannot accept submissions by e-mail or fax. Authors will receive confirmation of receipt of their abstracts or papers, including an ID number, shortly after submission. HCOMP will contact authors again only if problems are encountered with papers. Inquiries regarding paper receipt must be made no later than July 9, 2021.

All papers must be anonymized (include no information identifying the authors or their institutions) for double-blind peer-review. To ensure fairness, authors should declare any conflicts-of-interest with PC members by selecting the “Declare Conflicts” link on the upper-right of your EasyChair submission page.

Authors are invited, but not required, to include supplemental materials such as executables and data files so that reviewers can reproduce results in the paper, images, additional videos, related papers, more detailed explanations, derivations, or results. These materials will be viewed only at the discretion of the reviewers, who are only obligated to read your paper itself.

JOURNAL COLLABORATION

HCOMP 2021 has a collaboration this year with the open-access journal Frontiers in AI. Frontiers will publish a special issue on Human-Centered AI and Crowd Computing, focusing on topics aligned with HCOMP. Papers accepted to HCOMP 2021 will have a streamlined process for publication in the journal (e.g., maintaining the same reviewers when possible) if authors decide to submit extended versions of their papers to Frontiers. Frontiers will waive publication fees for the HCOMP best paper award winners.

REVIEWS

Each paper will be reviewed by at least two members of the program committee and one AC. Reviewers will be instructed to evaluate paper submissions according to specific review criteria. We encourage authors to review them before submission.

To ensure relevance, authors should consider including research questions and contributions of broad interest to crowdsourcing and human computation, as well as discuss relevant open problems and prior work in the field. When evaluation is conducted entirely within a specific domain, authors are encouraged to discuss how findings might generalize to other communities and application areas using crowdsourcing and human computation.

PUBLICATION AND PROCEEDINGS

To be included in the proceedings and in the conference program, at least one author must register for the main conference. The registration needs to occur by the camera-ready deadline.

Accepted full papers will be allocated ten (10) pages in the conference proceedings. Final papers found to exceed page limits and or otherwise violating the instructions to authors will not be included in the proceedings. Authors will be required to transfer copyright of their paper to AAAI. Accepted full papers will be published in the HCOMP conference proceedings and included in the AAAI Digital Library.

Accepted papers will also be listed on the conference website.

PRESENTING YOUR PAPER

If your paper is accepted, you will be invited to present it at HCOMP 2021.

As noted earlier, at least one author of each accepted paper must register for the main conference to present the work or acceptance will be withdrawn. The deadline for that is the same as the camera-ready deadline.

PAPER AWARDS

HCOMP 2021 will recognize a best paper and two runner ups. Reviewers will be asked to flag papers they deem worthy of a prize. The general chairs will set up a small panel who will read the papers, consider the comments of the reviewers and assess the talk to determine the winners.

Paper award winners will be invited to submit extended versions of their papers to a special issue of the open-access journal Frontiers of AI, with publication fees waived.