Papers
Topics
Authors
Recent
Search
2000 character limit reached

A Culturally-Aware Tool for Crowdworkers: Leveraging Chronemics to Support Diverse Work Styles

Published 31 Jul 2024 in cs.HC and cs.AI | (2408.07838v1)

Abstract: Crowdsourcing markets are expanding worldwide, but often feature standardized interfaces that ignore the cultural diversity of their workers, negatively impacting their well-being and productivity. To transform these workplace dynamics, this paper proposes creating culturally-aware workplace tools, specifically designed to adapt to the cultural dimensions of monochronic and polychronic work styles. We illustrate this approach with "CultureFit," a tool that we engineered based on extensive research in Chronemics and culture theories. To study and evaluate our tool in the real world, we conducted a field experiment with 55 workers from 24 different countries. Our field experiment revealed that CultureFit significantly improved the earnings of workers from cultural backgrounds often overlooked in design. Our study is among the pioneering efforts to examine culturally aware digital labor interventions. It also provides access to a dataset with over two million data points on culture and digital work, which can be leveraged for future research in this emerging field. The paper concludes by discussing the importance and future possibilities of incorporating cultural insights into the design of tools for digital labor.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (197)
  1. 2023. Global North and Global South. https://en.wikipedia.org/wiki/Global_North_and_Global_South. Accessed: 2023-04-27.
  2. Jake Alimahomed-Wilson and Ellen Reese. 2021. Surveilling Amazon’s warehouse workers: racism, retaliation, and worker resistance amid the pandemic. Work in the Global Economy 1, 1-2 (2021), 55–73.
  3. Decolonial pathways: Our manifesto for a decolonizing agenda in hci research and design. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems. 1–9.
  4. Participatory stoves: Designing renewable energy technologies for the rural sector. In Proceedings of the 18th ACM Conference Companion on Computer Supported Cooperative Work & Social Computing. 259–262.
  5. Modern information retrieval. Vol. 463. ACM press New York.
  6. Dawna I Ballard and David R Seibold. 2004. Communication-related organizational structures and work group temporal experiences: the effects of coordination method, technology type, and feedback cycle on members’ construals and enactments of time. Communication Monographs 71, 1 (2004), 1–27.
  7. Franklin D Becker. 1990. The total workplace: Facilities management and the elastic organization. (No Title) (1990).
  8. H Bigelow. 1998. Cultural Differences in the Workplace. Unpublished manuscript, RMIT University, Victoria, Australia (1998).
  9. Practice-based CSCW Research: ECSCW bridging across the Atlantic. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion. 210–220.
  10. Jacqueline Bloomfield and Murray J Fisher. 2019. Quantitative research design. Journal of the Australasian Rehabilitation Nurses Association 22, 2 (2019), 27–30.
  11. Allen C Bluedorn. 2002. The human organization of time: Temporal realities and experience. Stanford University Press.
  12. Polychronicity and the Inventory of Polychronic Values (IPV): The development of an instrument to measure a fundamental dimension of organizational culture. Journal of managerial psychology 14, 3/4 (1999), 205–231.
  13. How many things do you like to do at once? An introduction to monochronic and polychronic time. Academy of Management Perspectives 6, 4 (1992), 17–26.
  14. Mark Blythe and Andrew Monk. 2004. Funology 2. (2004).
  15. Ricarda B Bouncken. 2004. Cultural diversity in entrepreneurial teams: Findings of new ventures in Germany. Creativity and Innovation Management 13, 4 (2004), 240–253.
  16. Daren C Brabham. 2012. Crowdsourcing: A model for leveraging online communities. In The participatory cultures handbook. Routledge, 120–129.
  17. Alexander Braylan and Matthew Lease. 2021. Aggregating Complex Annotations via Merging and Matching. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 86–94.
  18. Jan Brejcha. 2015. Cross-cultural human-computer interaction and user experience design: a semiotic perspective. CRC Press.
  19. Recovering from an interruption: Investigating speed accuracy trade offs in task resumption behavior. Journal of Experimental Psychology: Applied 19, 2 (2013), 95–107.
  20. Information retrieval: Implementing and evaluating search engines. Mit Press.
  21. Dan Calacci and Alex Pentland. 2022. Bargaining with the Black-Box: Designing and Deploying Worker-Centric Tools to Audit Algorithmic Management. Proceedings of the ACM on Human-Computer Interaction 6, CSCW2 (2022), 1–24.
  22. Patrick J Carr and Maria J Kefalas. 2009. Hollowing out the middle: The rural brain drain and what it means for America. Beacon press.
  23. Ben Carterette and Rosie Jones. 2007. Evaluating search engines by modeling the relationship between relevance and clicks. Advances in neural information processing systems 20 (2007).
  24. Antonio A Casilli. 2017. Global digital culture— Digital labor studies go global: Toward a digital decolonial turn. International Journal of Communication 11 (2017), 21.
  25. Robert Chambers. 2014. Rural development: Putting the last first. Routledge.
  26. Angela Chen. 2020. Desperate Venezuelans are making money by training AI for self-driving cars. https://www.technologyreview.com/2019/08/22/65375/venezuela-crisis-platform-work-trains-self-driving-car-ai-data/
  27. Angela Chen. 2021. Desperate Venezuelans are making money by training AI for self-driving cars.
  28. EunJeong Cheon. 2024. Examining Algorithmic Metrics and their Effects through the Lens of Reactivity. In Proceedings of the 2024 ACM Designing Interactive Systems Conference. 3179–3192.
  29. Crowd coach: Peer coaching for crowd workers’ skill growth. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–17.
  30. Nicholas A Christakis and James H Fowler. 2009. Connected: The surprising power of our social networks and how they shape our lives. Little, Brown Spark.
  31. Research methods, design, and analysis. Pearson Boston.
  32. Claudio U Ciborra. 1997. Groupware and teamwork: Invisible aid or technical hindrance? John Wiley & Sons, Inc.
  33. Shroma Worker Collective. 2023. Monitoring - Shroma. https://shroma.ge/monitor/?lang=en. Accessed: 2023-12-10.
  34. Paul Collier. 2008. The bottom billion: Why the poorest countries are failing and what can be done about it. Oxford University Press, USA.
  35. Gráinne Conole. 2012. Designing for learning in an open world. Vol. 4. Springer Science & Business Media.
  36. June Cotte and Srinivasan Ratneshwar. 1999. Juggling and hopping: what does it mean to work polychronically? Journal of Managerial Psychology (1999).
  37. Shipt Creators. 2023. Shipt Transparency Calculator. https://home.coworker.org/shiptcalc/. Accessed: 2023-12-10.
  38. La Independiente: Designing Ubiquitous Systems for Latin American and Caribbean Women Crowdworkers. In Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing & the 2023 ACM International Symposium on Wearable Computing. 404–406.
  39. La Independiente: an AI-enhanced Platform Co-Designed with Latin-American Crowd-Workers. Avances en Interacción Humano-Computadora 8, 1 (2023), 6–10.
  40. Valerio De Stefano. 2015. The rise of the just-in-time workforce: On-demand work, crowdwork, and labor protection in the gig-economy. Comp. Lab. L. & Pol’y J. 37 (2015), 471.
  41. Demographics and dynamics of mechanical turk workers. In Proceedings of the eleventh ACM international conference on web search and data mining. 135–143.
  42. GigSousveillance: Designing Gig Worker Centric Sousveillance Tools. In Proceedings of the ACM CHI Conference on Human Factors in Computing Systems.
  43. Cynthia M Duncan. 2015. Worlds apart: Poverty and politics in rural America. Yale University Press.
  44. Improving Reactions to Rejection in Crowdsourcing Through Self-Reflection. In 13th ACM Web Science Conference 2021. 74–83.
  45. Thomas Erickson and Wendy A Kellogg. 2000. Social translucence: an approach to designing systems that support social processes. ACM transactions on computer-human interaction (TOCHI) 7, 1 (2000), 59–83.
  46. Susan R Fiorentino and Sandra M Tomkowicz. 2019. E-Petitions and Protected Concerted Activity: The Millennial Response to Organized Labor? ABAJ Lab. & Emp. L. 34 (2019), 71.
  47. The Challenges of Crowd Workers in Rural and Urban America. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing 8, 1 (2020), 159–162.
  48. Worker-centered design: Expanding HCI methods for supporting labor. In Extended abstracts of the 2020 CHI conference on human factors in computing systems. 1–8.
  49. Ron Friedman. 2014. The best place to work: The art and science of creating an extraordinary workplace. TarcherPerigee.
  50. Cross-cultural Perspectives on Time. https://doi.org/10.4324/9781315798370
  51. Daemo: A self-governed crowdsourcing marketplace. In Adjunct proceedings of the 28th annual ACM symposium on user interface software & technology. 101–102.
  52. Boomerang: Rebounding the consequences of reputation feedback on crowdsourcing platforms. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology. 625–637.
  53. The effects of automatic speech recognition quality on human transcription latency. In Proceedings of the 13th International Web for All Conference. 1–8.
  54. Shromis Gemo. 2024. Introduction to Wage Theft. https://shroma.ge/en/wagetheft-intro-en/. Accessed: 2023-12-10.
  55. Wen Gong. 2009. National culture and global diffusion of business-to-consumer e-commerce. Cross cultural management: an international journal (2009).
  56. Jury learning: Integrating dissenting voices into machine learning models. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–19.
  57. Mary L Gray and Siddharth Suri. 2019. Ghost work: How to stop Silicon Valley from building a new global underclass. Eamon Dolan Books.
  58. Learning in virtual worlds: Research and applications. Athabasca University Press.
  59. Turk-life in India. In Proceedings of the 18th International Conference on Supporting Group Work. 1–11.
  60. Edward Hall. 1971. The paradox of culture. B. Landis and ES Tauber (Eds.): In the Name of Life. Essays in Honor of Erich Fromm, New York (Holt, Rinehart and Winston) 1970, pp. 218-235. (1971).
  61. Edward Twitchell Hall. 1989. Beyond culture. Anchor.
  62. Edward T Hall and Edward Twitchell Hall. 1989. The dance of life: The other dimension of time. Anchor.
  63. Edward Twitchell Hall and Mildred Reed Hall. 1990. Understanding cultural differences:[keys to success in West Germany, France, and the United States]. Intercultural Press.
  64. Understanding cultural differences. Intercultural press.
  65. Edward Twitchell Hall and T Hall. 1959. The silent language. Vol. 948. Anchor books.
  66. Reciprocal research: Providing value in design research from the outset in the rural united states. In Proceedings of the 2020 International Conference on Information and Communication Technologies and Development. 1–5.
  67. TurkBench: Rendering the market for Turkers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 1613–1616.
  68. A data-driven analysis of workers’ earnings on Amazon Mechanical Turk. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–14.
  69. Worker demographics and earnings on amazon mechanical turk: An exploratory analysis. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1–6.
  70. Gunnar Harboe and Elaine M Huang. 2015. Real-world affinity diagramming practices: Bridging the paper-digital gap. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 95–104.
  71. Jean Hardy. 2019. How the design of social technology fails rural America. In Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion. 189–193.
  72. Rural computing: Beyond access and infrastructure. In Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing. 463–470.
  73. Designing from the rural. Interactions 26, 4 (2019), 37–41.
  74. The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can Help. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–26.
  75. Ann Heylighen. 2014. About the nature of design in universal design. Disability and rehabilitation 36, 16 (2014), 1360–1368.
  76. A cross-cultural test of the work-family interface in 48 countries. Journal of Marriage and the Family (2004), 1300–1316.
  77. Cindy E Hmelo-Silver. 2013. The international handbook of collaborative learning. (2013).
  78. Geert Hofstede. 1984. Cultural dimensions in management and planning. Asia Pacific journal of management 1 (1984), 81–99.
  79. Geert Hofstede. 2001. Culture’s consequences: Comparing values, behaviors, institutions and organizations across nations. Sage publications.
  80. Cultures and organizations: Software of the mind. Vol. 2. Mcgraw-hill New York.
  81. John Hooker. 2003. Working across cultures. Stanford University Press.
  82. Effects of communication style and time orientation on notification systems and anti-virus software. Behaviour & Information Technology 29, 5 (2010), 483–495.
  83. ” Is There Anything Else I Can Help You With?” Challenges in Deploying an On-Demand Crowd-Powered Conversational Agent. In Fourth AAAI Conference on Human Computation and Crowdsourcing.
  84. Lilly Irani. 2015. The cultural work of microwork. New media & society 17, 5 (2015), 720–739.
  85. Postcolonial computing: a lens on design and development. In Proceedings of the SIGCHI conference on human factors in computing systems. 1311–1320.
  86. Lilly C Irani and M Six Silberman. 2013. Turkopticon: Interrupting worker invisibility in amazon mechanical turk. In Proceedings of the SIGCHI conference on human factors in computing systems. 611–620.
  87. Interrupted by my car? Implications of interruption and interleaving research for automated vehicles. International Journal of Human-Computer Studies 130 (2019), 221–233.
  88. Gareth R Jones. 1983. Transaction costs, property rights, and organizational culture: An exchange perspective. Administrative Science Quarterly (1983), 454–467.
  89. Hyun Joon Jung and Matthew Lease. 2012. Improving quality of crowdsourced labels via probabilistic matrix factorization. In Workshops at the Twenty-Sixth AAAI Conference on Artificial Intelligence.
  90. A hunt for the Snark: Annotator Diversity in Data Practices. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–15.
  91. Striving to earn more: a survey of work strategies and tool use among crowd workers. In Sixth AAAI Conference on Human Computation and Crowdsourcing.
  92. Crowd Work on a CV? Understanding How AMT Fits into Turkers’ Career Goals and Professional Profiles. arXiv preprint arXiv:1902.05361 (2019).
  93. Turker Tales: Integrating Tangential Play into Crowd Work. In Proceedings of the 2019 on Designing Interactive Systems Conference. 21–34.
  94. Carol Kaufman-Scarborough and Jay Lindquist. 1999. Time Management and Polychronicity: Comparisons, Contrasts, and Insights for the Workplace. Journal of Managerial Psychology 14 (06 1999), 288–312. https://doi.org/10.1108/02683949910263819
  95. Precarious interventions: Designing for ecologies of care. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–27.
  96. Reworking the gaps between design and ethnography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 5373–5385.
  97. Online Freelancing on Digital Labor Platforms: A Scoping Review. In Companion Publication of the 2023 Conference on Computer Supported Cooperative Work and Social Computing. 259–266.
  98. ‘Your Duties Are To Sweep A Floor Remotely’: Low Information Quality in Job Advertisements is a Barrier to Low-Income Job-Seekers’ Successful Use of Digital Platforms. In Proceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work. 1–20.
  99. Accounting for market frictions and power asymmetries in online labor markets. Policy & Internet 7, 4 (2015), 383–400.
  100. The future of crowd work. In Proceedings of the 2013 conference on Computer supported cooperative work. 1301–1318.
  101. Satoshi Kose. 1998. From barrier-free to universal design: an international perspective. Assistive technology 10, 1 (1998), 44–50.
  102. One laptop per child: vision vs. reality. Commun. ACM 52, 6 (2009), 66–73.
  103. Robert E Kraut and Paul Resnick. 2012. Building successful online communities: Evidence-based social design. Mit Press.
  104. Visual genome: Connecting language and vision using crowdsourced dense image annotations. International journal of computer vision 123 (2017), 32–73.
  105. Andrew L. Kun and Orit Shaer. 2023. Designing an Inclusive and Engaging Hybrid Event: Experiences From CHIWORK. IEEE Pervasive Computing 22, 3 (2023), 52–57.
  106. “Sometimes It’s Like Putting the Track in Front of the Rushing Train”: Having to Be ‘On Call’ for Work Limits the Temporal Flexibility of Crowdworkers. ACM Transactions on Computer-Human Interaction 31, 2 (29 Jan 2024), 1–45.
  107. Crowdworkers’ Temporal Flexibility is Being Traded for the Convenience of Requesters Through 19 ‘Invisible Mechanisms’ Employed by Crowdworking Platforms: A Comparative Analysis Study of Nine Platforms. In CHI Conference on Human Factors in Computing Systems Extended Abstracts. 1–8.
  108. Monotasking or multitasking: Designing for crowdworkers’ preferences. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–14.
  109. Heejin Lee. 1999. Time and information technology: monochronicity, polychronicity and temporal symmetry. European Journal of Information Systems 8, 1 (1999), 16–26.
  110. Kiefer Lee and Steve Carter. 2011. Global marketing management. Strategic Direction 27, 1 (2011).
  111. Richard Lewis. 2010. When cultures collide: Leading across cultures. Nicholas Brealey International.
  112. Improving Non-Native Speakers’ Participation with an Automatic Agent in Multilingual Groups. Proceedings of the ACM on Human-Computer Interaction 7, GROUP (2023), 1–28.
  113. Cultural appropriation: information technologies as sites of transnational imagination. In Proceedings of the ACM 2012 conference on computer supported cooperative work. 77–86.
  114. Trends in content-based recommendation. User Modeling and User-Adapted Interaction 29, 2 (2019), 239–249.
  115. Andrés Lucero. 2015. Using affinity diagrams to evaluate interactive prototypes. In IFIP conference on human-computer interaction. Springer, 231–248.
  116. Introduction to information retrieval. Cambridge university press.
  117. Lalita A Manrai and Ajay K Manrai. 1995. Effects of cultural-context, gender, and acculturation on perceptions of work versus social/leisure time usage. Journal of Business Research 32, 2 (1995), 115–128.
  118. Masoumeh Mansouri and Henry Taylor. 2024. Does Cultural Robotics Need Culture? Conceptual Fragmentation and the Problems of Merging Culture with Robot Design. International Journal of Social Robotics 16, 2 (2024), 385–401.
  119. Aaron Marcus. 2006. Cross-cultural user-experience design. In International Conference on Theory and Application of Diagrams. Springer, 16–24.
  120. Aaron Marcus and Emilie West Gould. 2000. Crosscurrents: cultural dimensions and global Web user-interface design. interactions 7, 4 (2000), 32–46.
  121. Being a turker. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. 224–235.
  122. DS McCrickard. 2003. Chewar. CM, Somervell, JP, & Ndiwalana. A.” A Model for Notification Systems Evaluation–Assessing User Goals for Multitasking Activity.” ACM Transactions on Computer-Human Interaction (2003), 312–338.
  123. Gabriele Meiselwitz. 2020. Social Computing and Social Media. Design, Ethics, User Behavior, and Social Network Analysis: 12th International Conference, SCSM 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, July 19–24, 2020, Proceedings, Part I. Vol. 12194. Springer Nature.
  124. ‘Jumping Out from the Pressure of Work and into the Game’: Curating Immersive Digital Game Experiences for Post-Work Recovery. ACM Games: Research and Practice (2024).
  125. Project management: a strategic managerial approach. John Wiley & Sons.
  126. Erin Meyer. 2014. The culture map: Breaking through the invisible boundaries of global business. Public Affairs.
  127. Funology: designing enjoyment. In CHI’02 extended abstracts on human factors in computing systems. 924–925.
  128. Tony Morden. 1999. Models of national culture–a management review. Cross Cultural Management: An International Journal 6, 1 (1999), 19–44.
  129. The Brazilian Workers in Amazon Mechanical Turk: Dreams and realities of ghost workers. Contracampo 39, 1 (2020).
  130. Luciara Nardon and Richard M Steers. 2009. The culture theory jungle: Divergence and convergence in models of national culture. Cambridge handbook of culture, organizations, and work (2009), 3–22.
  131. The new normals of work: a framework for understanding responses to disruptions created by new futures of work. Human–Computer Interaction 37, 6 (2022), 508–531.
  132. Gemma Newlands and Christoph Lutz. 2021. Crowdwork and the mobile underclass: Barriers to participation in India and the United States. new media & society 23, 6 (2021), 1341–1361.
  133. Don Norman. 2012. Does culture matter for product design. Core 77 Design magazine & (2012).
  134. Don Norman. 2013. The design of everyday things: Revised and expanded edition. Basic books.
  135. Donald A Norman. 1991. Cognitive artifacts. Designing interaction: Psychology at the human-computer interface 1, 1 (1991), 17–38.
  136. Donald A Norman. 2016. Living with complexity. MIT press.
  137. Georgia Fair Labor Platform. 2020. Wage Theft Calculator. Georgia Fair Labor Platform.
  138. Elizabeth M Poposki and Frederick L Oswald. 2010. The multitasking preference inventory: Toward an improved measure of individual differences in polychronicity. Human Performance 23, 3 (2010), 247–264.
  139. Julian Posada. 2022. The Coloniality of Data Work: Power and Inequality in Outsourced Data Production for Machine Learning. Ph. D. Dissertation. University of Toronto (Canada).
  140. Nastazja Potocka-Sionek. 2022. Crowdwork and global supply chains: Regulating digital piecework. In A Research Agenda for the Gig Economy and Society. Edward Elgar Publishing, 215–234.
  141. In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers. Frontiers in Artificial Intelligence 5 (2022).
  142. CK Prahalad. 2008. The fortune at the bottom of the pyramid: Eradicating poverty through profits. McKinsey briefing notes series 36, 3 (2008), 52–74.
  143. Using worker avatars to improve microtask crowdsourcing. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–28.
  144. Whitney Quesenbery and Daniel Szuc. 2011. Global UX: design and research in a connected world. Elsevier.
  145. Constructing test collections using multi-armed bandits and active learning. In The World Wide Web Conference. 3158–3164.
  146. Editor’s comments: Diversity of design science research. (2017).
  147. Cross-cultural design for IT products and services. CRC Press.
  148. PL Patrick Rau. 2015. Cross-Cultural Design Methods, Practice and Impact: 7th International Conference, CCD 2015, Held as Part of HCI International 2015, Los Angeles, CA, USA, August 2-7, 2015, Proceedings, Part I. Vol. 9180. Springer.
  149. Katharina Reinecke. 2010. Culturally adaptive user interfaces. Ph. D. Dissertation. University of Zurich.
  150. Katharina Reinecke and Abraham Bernstein. 2011. Improving performance, perceived usability, and aesthetics with culturally adaptive user interfaces. ACM Transactions on Computer-Human Interaction (TOCHI) 18, 2 (2011), 1–29.
  151. Cecil R Reynolds and Elaine Fletcher-Janzen. 2007. Encyclopedia of Special Education: A Reference for the Education of Children, Adolescents, and Adults with Disabilities and Other Exceptional Individuals, Volume 3. Vol. 3. John Wiley & Sons.
  152. Paola Ricaurte. 2019. Data epistemologies, the coloniality of power, and resistance. Television & New Media 20, 4 (2019), 350–365.
  153. Veronica A Rivera and David T Lee. 2021. I Want to, but First I Need to: Understanding Crowdworkers’ Career Goals, Challenges, and Tensions. Proceedings of the ACM on Human-Computer Interaction 5, CSCW1 (2021), 1–22.
  154. Tim S Roberts. 2005. Computer-supported collaborative learning in higher education. In Computer-supported collaborative learning in higher education. IGI global, 1–18.
  155. William Peter Robinson and Howard Giles. 1990. Handbook of language and social psychology. Wiley Chichester, UK.
  156. Understanding digital wellbeing within complex technological contexts. International Journal of Human-Computer Studies 175 (2023), 103034.
  157. Who are the crowdworkers? Shifting demographics in Mechanical Turk. In CHI’10 extended abstracts on Human factors in computing systems. 2863–2872.
  158. Turkscanner: Predicting the hourly wage of microtasks. In The World Wide Web Conference. 3187–3193.
  159. Shruti Sannon and Dan Cosley. 2019. Privacy, power, and invisible labor on Amazon Mechanical Turk. In Proceedings of the 2019 CHI conference on human factors in computing systems. 1–12.
  160. Becoming the super turker: Increasing wages via a strategy from high earning workers. In Proceedings of The Web Conference 2020. 1241–1252.
  161. Saiph Savage and Martha Garcia-Murillo. 2024. Tools for crowdworkers coding data for AI. In Handbook of Artificial Intelligence at Work, Joy Xiang and Peter Lee (Eds.). Edward Elgar Publishing, 76–94.
  162. Research Methods to Study & Empower Crowd Workers. Oxford University Press (2021).
  163. Sergio Sayago. 2023. Cultures in human-computer interaction. Springer Nature.
  164. See friendship, sort of: How conversation and digital traces might support reflection on friendships. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work. 1145–1154.
  165. The social roles of bots: evaluating impact of bots on discussions in online communities. Proceedings of the ACM on Human-Computer Interaction 2, CSCW (2018), 1–29.
  166. Moderator engagement and community development in the age of algorithms. New Media & Society 21, 7 (2019), 1417–1443.
  167. Taking it out of context: collaborating within and across cultures in face-to-face settings and via instant messaging. In Proceedings of the 2004 ACM conference on Computer supported cooperative work. 604–613.
  168. AI-Augmented Brainwriting: Investigating the use of LLMs in group ideation. In Proceedings of the CHI Conference on Human Factors in Computing Systems. 1–17.
  169. Mildred Sikkema and Agnes Niyekawa. 1987. Design for Cross-Cultural Learning. ERIC.
  170. M Silberman. 2015. Operating an employer reputation system: Lessons from Turkopticon, 2008-2015. Comp. Lab. L. & Pol’y J. 37 (2015), 505.
  171. Responsible research with crowds: pay crowdworkers at least minimum wage. Commun. ACM 61, 3 (2018), 39–41.
  172. Jennifer Daryl Slack and John Macgregor Wise. 2005. Culture+ technology: A primer. Peter Lang.
  173. Gerry Stahl. 2006. Group cognition: Computer support for building collaborative knowledge (acting with technology). The MIT Press.
  174. Edward Steinfeld and Jordana Maisel. 2012. Universal design: Creating inclusive environments. John Wiley & Sons.
  175. Joseph Stiglitz and Robert M Pike. 2004. Globalization and its Discontents. (2004).
  176. Molly Follette Story. 2001. Principles of universal design. Universal design handbook (2001).
  177. Huatong Sun. 2012. Cross-cultural technology design: Creating culture-sensitive technology for local users. OUP USA.
  178. Atelier: Repurposing expert crowdsourcing tasks as micro-internships. In Proceedings of the 2016 CHI conference on human factors in computing systems. 2645–2656.
  179. Reputation agent: Prompting fair reviews in gig markets. In Proceedings of The Web Conference 2020. 1228–1240.
  180. Quantifying the invisible labor in crowd work. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–26.
  181. Fons Trompenaars and Charles Hampden-Turner. 2004. Managing people across cultures. Capstone Chichester.
  182. Fons Trompenaars and Charles Hampden-Turner. 2011. Riding the waves of culture: Understanding diversity in global business. Nicholas Brealey International.
  183. Upwork. 2022. Use your work diary - upwork customer service & support. https://support.upwork.com/hc/en-us/articles/211068518-Use-Your-Work-Diary
  184. Oana Ursu and Elena Ciortescu. 2021. Exploring Cultural Patterns in Business Communication. Insights from Europe and Asia. CES Working Papers 13, 2 (2021), 149–158.
  185. Feeling Proud, Feeling Embarrassed: Experiences of Low-income Women with Crowd Work. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. 1–18.
  186. TREC: Experiment and evaluation in information retrieval. Vol. 63. Citeseer.
  187. Immanuel Wallerstein. 2020. World-systems analysis: An introduction. duke university Press.
  188. Whose AI Dream? In Search of the Aspiration in Data Annotation.. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 582, 16 pages. https://doi.org/10.1145/3491102.3502121
  189. A community rather than a union: Understanding self-organization phenomenon on Mturk and how it impacts Turkers and requesters. In Proceedings of the 2017 CHI conference extended abstracts on human factors in computing systems. 2210–2216.
  190. Combining Worker Factors for Heterogeneous Crowd Task Assignment. In Proceedings of the ACM Web Conference 2023. 3794–3805.
  191. The Perpetual Work Life of Crowdworkers: How Tooling Practices Increase Fragmentation in Crowdwork. Proceedings of the ACM on Human-Computer Interaction 3, CSCW (2019), 1–28.
  192. Haoyu Xie. 2023. Understanding the Use of HIT Catchers and Crowd Knowledge Sharing: A Case Study of Crowdworkers on Amazon Mechanical Turk. Ph. D. Dissertation. University of Sheffield.
  193. Judith Yaaqoubi. 2020. Practitioners’ Views on Cultural Adaptation of Web-based Products. University of Washington.
  194. Together but alone: Atomization and peer support among gig workers. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2 (2021), 1–29.
  195. Understanding informal communication in multilingual contexts. In Proceedings of the 2013 conference on Computer supported cooperative work. 909–922.
  196. G Zichermann. 2020. Gamification at Work: Designing Engaging Business Software. Retrieved from The Interaction Design Foundation: https://www. interactiondesign. org/literature/book/gamification-at-work-designing-engaging-businesssoftware (2020).
  197. Kathryn Zyskowski and Kristy Milland. 2018. A crowded future: Working against abstraction on Turker Nation. Catalyst: Feminism, Theory, Technoscience 4, 2 (2018), 1–30.

Summary

No one has generated a summary of this paper yet.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 3 tweets with 44 likes about this paper.