IndiTag: An Online Media Bias Analysis and Annotation System Using Fine-Grained Bias Indicators
Abstract: In the age of information overload and polarized discourse, understanding media bias has become imperative for informed decision-making and fostering a balanced public discourse. This paper presents IndiTag, an innovative online media bias analysis and annotation system that leverages fine-grained bias indicators to dissect and annotate bias in digital content. IndiTag offers a novel approach by incorporating LLMs, bias indicator, vector database to automatically detect and interpret bias. Complemented by a user-friendly interface facilitating both automated bias analysis and manual annotation, IndiTag offers a comprehensive platform for in-depth bias examination. We demonstrate the efficacy and versatility of IndiTag through experiments on four datasets encompassing news articles from diverse platforms. Furthermore, we discuss potential applications of IndiTag in fostering media literacy, facilitating fact-checking initiatives, and enhancing the transparency and accountability of digital media platforms. IndiTag stands as a valuable tool in the pursuit of fostering a more informed, discerning, and inclusive public discourse in the digital age. The demonstration video can be accessed from https://youtu.be/Gt2T4T7DYqs. We release an online system for end users and the source code is available at https://github.com/lylin0/IndiTag.
- Redditbias: A real-world resource for bias evaluation and debiasing of conversational language models. arXiv preprint arXiv:2106.03521.
- Politically motivated selective exposure and perceived media bias. 47(1):82–103.
- The media frames corpus: Annotations of frames across issues. In Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pages 438–444.
- Learning to flip the bias of news headlines. In Proceedings of the 11th International Conference on Natural Language Generation, pages 79–88, Tilburg University, The Netherlands. Association for Computational Linguistics.
- An affirmed self and an open mind: Self-affirmation and sensitivity to argument strength. 40(3):350–356.
- Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
- Recounting the courts? applying automated content analysis to enhance empirical legal research. Journal of Empirical Legal Studies, 4(4):1007–1039.
- Tiziano Fagni and Stefano Cresci. 2022. Fine-grained prediction of political leaning on social media with unsupervised deep learning. 73:633–672.
- In plain sight: Media bias through the lens of factual reporting. arXiv preprint arXiv:1909.02670.
- A multidimensional dataset based on crowdsourcing for analyzing and detecting news bias. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management, pages 3007–3014.
- Hostile media bias on social media: Testing the effect of user comments on perceptions of news bias and credibility. 2.
- A large labeled corpus for online harassment research. In Proceedings of the 2017 ACM on web science conference, pages 229–233.
- Seth K. Goldman and Diana C. Mutz. 2011. The friendly media phenomenon: A cross-national analysis of cross-cutting exposure. 28(1):42–66. Number: 1 Publisher: Routledge _eprint: https://doi.org/10.1080/10584609.2010.544280.
- Dylan Grosz and Patricia Conde-Cespedes. 2020. Automatic detection of sexist statements commonly used at the workplace. In Trends and Applications in Knowledge Discovery and Data Mining: PAKDD 2020 Workshops, DSFN, GII, BDM, LDRC and LBD, Singapore, May 11–14, 2020, Revised Selected Papers 24, pages 104–115. Springer.
- Political ideology detection using recursive neural networks. In Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1113–1122.
- Kenneth Kim. 2019. The hostile media phenomenon: Testing the effect of news framing on perceptions of media bias. 36(1):35–44. Number: 1 Publisher: Routledge _eprint: https://doi.org/10.1080/08824096.2018.1555659.
- Silvia Knobloch-Westerwick and Jingbo Meng. 2009. Looking the other way: Selective exposure to attitude-consistent and counterattitudinal political information. 36(3):426–448. Number: 3 _eprint: https://doi.org/10.1177/0093650209333030.
- NeuS: Neutral multi-news summarization for mitigating framing bias. Issue: arXiv:2204.04902.
- Indivec: An exploration of leveraging large language models for media bias detection with fine-grained bias indicators. arXiv preprint arXiv:2402.00345.
- Politics: pretraining with same-story article comparison for ideology prediction and stance detection. arXiv preprint arXiv:2205.00619.
- POLITICS: Pretraining with same-story article comparison for ideology prediction and stance detection.
- Ilya Loshchilov and Frank Hutter. 2017. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101.
- A survey on predicting the factuality and the bias of news media. abs/2103.12506.
- Embedding-based retrieval with llm for effective agriculture information extracting from unstructured data. arXiv preprint arXiv:2308.03107.
- Gordon Pennycook and David G. Rand. 2021. The psychology of fake news. 25(5):388–402. Number: 5.
- Eitan Sapiro-Gheiler. 2019. Examining political trustworthiness through text-based measures of ideology. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 33, pages 10029–10030.
- Timo Spinde. 2021. An interdisciplinary approach for the automated detection and visualization of media bias in news articles. In 2021 International Conference on Data Mining Workshops (ICDMW), pages 1096–1103.
- Neural media bias detection using distant supervision with babe - bias annotations by experts. In Findings of the Association for Computational Linguistics: EMNLP 2021, Dominican Republic.
- Neural media bias detection using distant supervision with babe–bias annotations by experts. arXiv preprint arXiv:2209.14557.
- Incidental exposure, selective exposure, and political information sharing: Integrating online exposure patterns and expression on social media. 22(6):363–379. Number: 6 Publisher: Oxford University Press Oxford, UK.
- Introducing mbib-the first media bias identification benchmark task and dataset collection. In Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2765–2774.
- Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 conference on empirical methods in natural language processing: system demonstrations, pages 38–45.
- Classifying party affiliation from political speech. Journal of Information Technology & Politics, 5(1):33–48.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.