Preliminary Conference Agenda

Overview and details of the sessions of this conference. Please select a date or room to show only sessions at that day or location. Please select a single session for detailed view (with abstracts and downloads if available).

This agenda is preliminary and subject to change.

Please note that all times are shown in the time zone of the conference. The current conference time is: 19th May 2024, 08:55:15pm CST

 
 
Session Overview
Session
SP 5: Short Research Papers 5
Time:
Tuesday, 23/Apr/2024:
4:00pm - 5:30pm

Session Chair: Masanori Koizumi, University of Tsukuba
Location: Room 5

Events V on 3F 3F沙龙V

Show help for 'Increase or decrease the abstract text size'
Presentations

Influence of AI's Uncertainty in the Dawid-Skene Aggregation for Human-AI Crowdsourcing

T. Tamura1, H. Ito2, S. Oyama3, A. Morishima2

1School of Informatics, University of Tsukuba, Japan; 2Faculty of Library, Information and Media Science, University of Tsukuba, Japan; 3School of Data Science, Nagoya City University, Japan

The power and expressiveness of AIs are rapidly increasing, and now AIs have the ability to complete tasks in crowdsourcing as if they were human crowd workers. Therefore, the development of methods to effectively aggregate the results of tasks performed by AIs and humans is becoming a critical problem. In this study, we revisit the Dawid-Skene model that has been used to aggregate human votes to obtain better results in classification problems. Most of the state-of-the-art AI classifiers predict the class probabilities as their output. Considering the probabilities represent their uncertainty, utilizing them in Dawid-Skene aggregation may provide higher-quality annotations. To this end, we introduce a variation of the Dawid-Skene model to directly use the probabilities without discarding them and conduct experiments with two real-world datasets of different domains. Experimental results show that the Dawid-Skene model with probabilities improves the overall accuracy. Moreover, a detailed analysis shows that the aggregation results were improved for classification tasks with high uncertainty.



Promoting academic integrity through gamification: Testing the effectiveness of a 3D immersive video game

X. Zhao, H. Xie, A. Roberts, L. Sbaffi

University of Sheffield, United Kingdom

Academic integrity is the foundation of quality higher education. However, the resources explaining the concept tend to be definition-driven, have complex language and sometimes even a severe tone to discourage students from breaking rules. This project deployed a gamified approach, designing and evaluating a 3D immersive video game for university students to facilitate their understanding and adoption of academic integrity principles. The game allowed students to be immersed in a virtual campus through an avatar and navigate a campus (e.g., garden, library, cafe, student accommodation) with scenario-based, academic integrity related dialogues with in-game characters. The paper aims to showcase the game design and student feedback of the game. Observation (e.g., eye-tracking) and interviews were conducted with 15 participants. Thematic analysis of the data shows that the game greatly enhanced student understanding of academic integrity concepts by providing contextualized memorability whilst relieving anxiety. Students’ engagement with the game was linked to game features such as appealing aesthetics, customization, and contextualization. The paper concludes by offering recommendations concerning the employment of gamification as an educational approach for instructing students in higher education on complex concepts, such as academic integrity.



Detecting the Rumor Patterns Integrating Features of User, Content, and the Spreading Structure

P. Yan1, G. Yu2, Z. Jiang1, T. Lin1, W. Yuan1, X. Liu3

1Zhejiang University, China; 2Wuhan University, China; 3Worcester Polytechnic Institute, USA

The openness characteristic of social networks facilitates the rapid spread of rumors, necessitating effective methods for detecting and managing the abundance of rumors on social media. Existing studies have primarily focused on improving the accuracy of rumor detection, but often overlook the vital aspects of interpretability and explanation of rumor patterns, limiting their credibility and real-world usability. Additionally, previous works have typically examined only a subset of user features, content, and spreading structure, neglecting the analysis of compound rules. To address these limitations, we propose a novel framework for detecting rumor patterns that emphasize comprehensive feature construction and the explanation of compound rules. Our framework incorporates multi-dimensional features, including user characteristics, post content, and the structure of information propagation. Advanced techniques, including large language models (such as ChatGPT) and graph motif discovery algorithms, are employed for feature construction. By leveraging diverse features, crucial integrated rules identified by Rulefit can investigate the contextually dependent associations among various interrelated rumor factors. We consolidate and analyze seven distinct rumor patterns based on the Credible Early Detection Dataset, deriving valuable insights into the inherent characteristics of rumors. The recognition of rumor patterns empowers social media platforms and fact-checking organizations to develop targeted and explainable interventions that effectively mitigate the spread of rumors and safeguard the integrity of information. These interventions greatly enhance the transparency and trustworthiness of rumor management, fostering a more reliable information ecosystem.



 
Contact and Legal Notice · Contact Address:
Privacy Statement · Conference: iConference 2024
Conference Software: ConfTool Pro 2.6.149+TC
© 2001–2024 by Dr. H. Weinreich, Hamburg, Germany