About the Special Interest Group
In 2015, a landmark paper was published that summarized the efforts of 270 researchers in replicating 100 studies, published across 3 highly-esteemed psychology journals . It found that approximately a third of previously reported effects replicated in subsequent studies. Thus, it concluded that the critical features of scientific enterprise, namely transparency, openness, and reproducibility, were significantly undermined in actual research practice. This has given rise to the formalization and advocacy of “Transparency and Openness Promotion” (TOP) guidelines that strive to advance research . Eight standards and three levels of increasing stringency comprise TOP guidelines, with the primary objective of incentivising transparency in research practices. To date, more than 5000 journals and institutions have signed up to review their practices in accordance to TOP guidelines; the Association of Computing Machinery and, notably, its Special Interest Group for Computer-Human Interaction (SIGCHI) are non-signatories.
The objective of the SIG is to arrive at a communal understanding of whether the TOP guidelines and recommended practices of the Open Science Initiative apply to strengthen current HCI research practices.
An outcome of this SIG will be a publication that relates the viable application of TOP guidelines in the HCI research community. This will be of interest to COS as well as CHI. Furthermore, we believe that the HCI community will generate innovative Open Science practices that could be recommended to COS in turn. Next, this SIG could give rise to a new research area, namely the development of better human-computer interfaces for facilitating the adoption of Open Science practices by scientists. Finally, attendees could be interested in implementing a large-scale replication project similar to . Such efforts are currently underway in Cancer Biology and Social Science.