skip to main content
10.1145/3287560.3287601acmconferencesArticle/Chapter ViewAbstractPublication PagesfacctConference Proceedingsconference-collections
research-article

Controlling Polarization in Personalization: An Algorithmic Framework

Published:29 January 2019Publication History

ABSTRACT

Personalization is pervasive in the online space as it leads to higher efficiency for the user and higher revenue for the platform by individualizing the most relevant content for each user. However, recent studies suggest that such personalization can learn and propagate systemic biases and polarize opinions; this has led to calls for regulatory mechanisms and algorithms that are constrained to combat bias and the resulting echo-chamber effect. We propose a versatile framework that allows for the possibility to reduce polarization in personalized systems by allowing the user to constrain the distribution from which content is selected. We then present a scalable algorithm with provable guarantees that satisfies the given constraints on the types of the content that can be displayed to a user, but -- subject to these constraints -- will continue to learn and personalize the content in order to maximize utility. We illustrate this framework on a curated dataset of online news articles that are conservative or liberal, show that it can control polarization, and examine the trade-off between decreasing polarization and the resulting loss to revenue. We further exhibit the flexibility and scalability of our approach by framing the problem in terms of the more general diverse content selection problem and test it empirically on both a News dataset and the MovieLens dataset.

References

  1. {n. d.}. AllSides Media Bias Ratings. https:/www.allsides.com/media-bias/media-bias-ratings.Google ScholarGoogle Scholar
  2. {n. d.}. Webhose News API. https://webhose.io/data-feeds/news-api/.Google ScholarGoogle Scholar
  3. Yasin Abbasi-Yadkori, Dávid Pál, and Csaba Szepesvári. 2011. Improved Algorithms for Linear Stochastic Bandits. In Advances In Neural Information Processing Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gediminas Adomavicius, Jesse Bockstedt, Curley Shawn, and Jingjing Zhang. 2014. De-biasing user preference ratings in recommender systems. In Joint Workshop on Interfaces and Human Decision Making for Recommender Systems, Co-located with ACM Conference on Recommender Systems.Google ScholarGoogle Scholar
  5. Gediminas Adomavicius and YoungOk Kwon. 2012. Improving aggregate recommendation diversity using ranking-based techniques. IEEE Transactions on Knowledge and Data Engineering 24, 5 (2012), 896--911. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Shipra Agrawal and Nikhil Devanur. 2016. Linear Contextual Bandits with Knapsacks. In Advances In Neural Information Processing Systems. 3450--3458. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Shipra Agrawal and Navin Goyal. 2012. Analysis of thompson sampling for the multi-armed bandit problem. In Conference on Learning Theory. 39--1.Google ScholarGoogle Scholar
  8. Rubayyi Alghamdi and Khalid Alfalqi. 2015. A survey of topic modeling in text mining. Int. J. Adv. Comput. Sci. Appl.(IJACSA) 6, 1 (2015).Google ScholarGoogle Scholar
  9. Peter Auer, Nicolo Cesa-Bianchi, and Paul Fischer. 2002. Finite-time analysis of the multiarmed bandit problem. Machine learning 47, 2-3 (2002), 235--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Drake Baer. 2016. The 'Filter Bubble' Explains Why Trump Won and You Didn't See It Coming. NY Mag.Google ScholarGoogle Scholar
  11. Engin Bozdag and Jeroen van den Hoven. 2015. Breaking the filter bubble: democracy and design. Ethics and Information Technology 17, 4 (01 Dec 2015), 249--265. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. L. E. Celis, L. Huang, V. Keswani, and N. K. Vishnoi. 2018. Classification with Fairness Constraints: A Meta-Algorithm with Provable Guarantees. ArXiv e-prints (June 2018). arXiv:1806.06055Google ScholarGoogle Scholar
  13. Michael Conover, Jacob Ratkiewicz, Matthew R Francisco, Bruno Gonçalves, Filippo Menczer, and Alessandro Flammini. 2011. Political polarization on twitter. ICWSM 133 (2011), 89--96.Google ScholarGoogle Scholar
  14. Varsha Dani, Thomas P Hayes, and Sham M Kakade. 2008. Stochastic Linear Optimization under Bandit Feedback. In Proceedings of the Annual Conference on Learning Theory (COLT).Google ScholarGoogle Scholar
  15. Amit Datta, Michael Carl Tschantz, and Anupam Datta. 2015. Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies 2015, 1 (2015), 92--112.Google ScholarGoogle ScholarCross RefCross Ref
  16. Wenkui Ding, Tao Qin, Xu-Dong Zhang, and Tie-Yan Liu. 2013. Multi-Armed Bandit with Budget Constraint and Variable Costs.. In AAAI. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Robert Epstein and Ronald E Robertson. 2015. The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections. Proceedings of the National Academy of Sciences 112, 33 (2015), E4512--E4521.Google ScholarGoogle ScholarCross RefCross Ref
  18. Ayman Farahat and Michael C Bailey. 2012. How effective is targeted advertising?. In Proceedings of the 21st international conference on World Wide Web. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Thomas Fox-Brewster. 2017. Creepy Or Cool? Twitter Is Tracking Where You've Been, What You Like And Is Telling Advertisers. Forbes Magazine.Google ScholarGoogle Scholar
  20. Venkata Rama Kiran Garimella and Ingmar Weber. 2017. A Long-Term Analysis of Polarization on Twitter. In ICWSM.Google ScholarGoogle Scholar
  21. Avi Goldfarb and Catherine Tucker. 2011. Online display advertising: Targeting and obtrusiveness. Marketing Science (2011). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. F. Maxwell Harper and Joseph A. Konstan. 2015. The MovieLens Datasets: History and Context. ACM Trans. Interact. Intell. Syst. 5, 4, Article 19 (Dec. 2015), 19 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Sounman Hong and Sun Hyoung Kim. 2016. Political polarization on twitter: Implications for the use of social media in digital governments. Government Information Quarterly 33, 4 (2016), 777--782.Google ScholarGoogle ScholarCross RefCross Ref
  24. Matthew Joseph, Michael Kearns, Jamie H Morgenstern, and Aaron Roth. 2016. Fairness in learning: Classic and contextual bandits. In Advances in Neural Information Processing Systems. 325--333. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Lihong Li, Wei Chu, John Langford, and Robert E Schapire. 2010. A contextual-bandit approach to personalized news article recommendation. In Proceedings of the 19th international conference on World wide web. ACM, 661--670. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Shuai Li, Alexandras Karatzoglou, and Claudio Gentile. 2016. Collaborative filtering bandits. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 539--548. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jiahui Liu, Peter Dolan, and Elin Rønby Pedersen. 2010. Personalized news recommendation based on click behavior. In Proceedings of the 15th international conference on Intelligent user interfaces. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Sandeep Pandey and Christopher Olston. 2006. Handling Advertisements of Unknown Quality in Search Advertising. In Advances in Neural Information Processing Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Eli Pariser. 2011. The filter bubble: What the Internet is hiding from you. Penguin UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Filipe N. Ribeiro, Lucas Henrique, Fabricio Benevenuto, Abhijnan Chakraborty, Juhi Kulshrestha, Mahmoudreza Babaei, and Krishna P. Gummadi. 2018. Media Bias Monitor: Quantifying Biases of Social Media News Outlets at Scale. In Proceedings of the 12th International AAAI Conference on Web and Social Media (ICWSM).Google ScholarGoogle Scholar
  32. Ronald E. Robertson, David Lazer, and Christo Wilson. 2018. Auditing the Personalization and Composition of Politically-Related Search Engine Results Pages. In Proceedings of the 2018 World Wide Web Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Peter J. Rousseeuw. 1987. Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. J. Comput. Appl. Math. (1987). Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Pranav Sakulkar and Bhaskar Krishnamachari. 2016. Stochastic contextual bandits with known reward functions. arXiv preprint arXiv:1605.00176 (2016).Google ScholarGoogle Scholar
  35. Till Speicher, Muhammad Ali, Giridhari Venkatadri, Filipe Nunes Ribeiro, George Arvanitakis, Fabricio Benevenuto, Krishna P. Gummadi, Patrick Loiseau, and Alan Mislove. 2018. Potential for Discrimination in Online Targeted Advertising. In Proceedings of the 1st Conference on Fairness, Accountability and Transparency. PMLR.Google ScholarGoogle Scholar
  36. Karthik Sridharan. 2002. A gentle introduction to concentration inequalities. (2002).Google ScholarGoogle Scholar
  37. Chong Wang and David M Blei. 2011. Collaborative topic modeling for recommending scientific articles. In Proceedings of the 17th ACM SIGKDD international conference on Knowledge discovery and data mining. ACM, 448--456. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jacek Wasilewski and Neil Hurley. 2016. Incorporating Diversity in a Learning to Rank Recommender System.. In FLAIRS Conference. 572--578.Google ScholarGoogle Scholar
  39. Ingmar Weber, Venkata R Kiran Garimella, and Alaa Batayneh. 2013. Secular vs. islamist polarization in egypt on twitter. In Proceedings of the 2013 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining. ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Yiming Yan. {n.d.}. Mehrotra's Predictor-Corrector Interior Point Method. https://github.com/YimingYAN/mpc.Google ScholarGoogle Scholar
  41. Yi Zhang. 2005. Bayesian Graphical Models For Adaptive Filtering. In PhD Thesis. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Controlling Polarization in Personalization: An Algorithmic Framework

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        FAT* '19: Proceedings of the Conference on Fairness, Accountability, and Transparency
        January 2019
        388 pages
        ISBN:9781450361255
        DOI:10.1145/3287560

        Copyright © 2019 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 January 2019

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Upcoming Conference

        FAccT '24

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader