Harm Mitigation in Recommender Systems under User Preference Dynamics | Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (2024)

S. Agrawal, V. Avadhanula, V. Goyal, and A. Zeevi. Thompson sampling for the mnl-bandit. In S. Kale and O. Shamir, editors, Proceedings of the 2017 Conference on Learning Theory, volume 65 of Proceedings of Machine Learning Research, pages 76--78. PMLR, 07--10 Jul 2017. URL https://proceedings.mlr.press/v65/agrawal17a.html.

A. Arora, P. Nakov, M. Hardalov, S. M. Sarwar, V. Nayak, Y. Dinkov, D. Zlatkova, K. Dent, A. Bhatawdekar, G. Bouchard, et al. Detecting harmful content on online platforms: what platforms need vs. where research efforts go. ACM Computing Surveys, 56(3):1--17, 2023.

H. Ashton and M. Franklin. The problem of behaviour and preference manipulation in ai systems. In CEUR Workshop Proceedings, volume 3087. CEUR Workshop Proceedings, 2022.

S. Banach. Sur les opérations dans les ensembles abstraits et leur application aux équations intégrales. Fundamenta mathematicae, 3(1):133--181, 1922.

S. Beckers, H. Chockler, and J. Y. Halpern. Causal analysis of harm. Advances in Neural Information Processing Systems, 36, 2022.

M. Benaïm. Dynamics of stochastic approximation algorithms. In Seminaire de probabilites XXXIII, pages 1--68. Springer, 2006.

A. Benveniste, M. Métivier, and P. Priouret. Adaptive algorithms and stochastic approximations, volume 22. Springer Science & Business Media, 2012.

D. P. Bertsekas. Nonlinear programming. Journal of the Operational Research Society, 48(3):334--334, 1997.

M. Blondel, Q. Berthet, M. Cuturi, R. Frostig, S. Hoyer, F. Llinares-López, F. Pedregosa, and J.-P. Vert. Efficient and modular implicit differentiation. Advances in neural information processing systems, 35:5230--5242, 2022.

V. S. Borkar. Stochastic approximation: a dynamical systems viewpoint, volume 48. Springer, 2009.

M. Carroll, D. Hadfield-Menell, S. Russell, and A. Dragan. Estimating and penalizing preference shift in recommender systems. In Fifteenth ACM Conference on Recommender Systems, pages 661--667, 2021.

I. H. Center. Imdb parental guide, 2023. https://help.imdb.com/article/contribution/titles/parental-guide/GF4KYKYJA4PKQB32.

B. H. Chaptini. Use of discrete choice models with recommender systems. PhD thesis, Massachusetts Institute of Technology, 2005.

J. Chee, S. Kalyanaraman, S. K. Ernala, U. Weinsberg, S. Dean, and S. Ioannidis. Harm mitigation in recommender systems under user preference dynamics, 2024. Arxiv http://arxiv.org/abs/2406.09882.

P. Cremonesi, Y. Koren, and R. Turrin. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the fourth ACM conference on Recommender systems, pages 39--46, 2010.

M. Curmei, A. A. Haupt, B. Recht, and D. Hadfield-Menell. Towards psychologically-grounded dynamic preference models. In Proceedings of the 16th ACM Conference on Recommender Systems, pages 35--48, 2022.

M. Danaf, F. Becker, X. Song, B. Atasoy, and M. Ben-Akiva. Online discrete choice models: Applications in personalized recommendations. Decision Support Systems, 119:35--45, 2019.

S. Dean and J. Morgenstern. Preference dynamics under personalized recommendations. arXiv preprint arXiv:2205.13026, 2022.

M. Deshpande and G. Karypis. Item-based top-n recommendation algorithms. ACM Transactions on Information Systems (TOIS), 22(1):143--177, 2004.

F. Fabbri, Y. Wang, F. Bonchi, C. Castillo, and M. Mathioudakis. Rewiring what-to-watch-next recommendations to reduce radicalization pathways. In Proceedings of the ACM Web Conference 2022, pages 2719--2728, 2022.

D. Fleder and K. Hosanagar. Blockbuster culture's next rise or fall: The impact of recommender systems on sales diversity. Management science, 55(5):697--712, 2009.

G. Folland. Avanced Calculus. Pearson, 2001.

Y. Ge, S. Zhao, H. Zhou, C. Pei, F. Sun, W. Ou, and Y. Zhang. Understanding echo chambers in e-commerce recommender systems. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pages 2261--2270, 2020.

T. Gillespie. Content moderation, ai, and the question of scale. Big Data & Society, 7(2):2053951720943234, 2020.

R. Gormann and S. Armstrong. The dangers in algorithms learning humans' values and irrationalities. arXiv preprint arXiv:2202.13985, 2022.

B. Hayworth. Imdb parental guide, 2023. https://www.kaggle.com/datasets/barryhaworth/imdb-parental-guide.

N. Hazrati and F. Ricci. Recommender systems effect on the evolution of users' choices distribution. Information Processing & Management, 59(1):102766, 2022.

S. Hosseini, H. Palangi, and A. H. Awadallah. An empirical study of metrics to measure representational harms in pre-trained language models. arXiv preprint arXiv:2301.09211, 2023.

Y. Hou, D. Xiong, T. Jiang, L. Song, and Q. Wang. Social media addiction: Its impact, mediation, and intervention. Cyberpsychology: Journal of psychosocial research on cyberspace, 13(1), 2019.

F. Huszár, S. I. Ktena, C. O'Brien, L. Belli, A. Schlaikjer, and M. Hardt. Algorithmic amplification of politics on twitter. Proceedings of the National Academy of Sciences, 119(1):e2025334119, 2022.

D. Jannach. Multi-objective recommender systems: Survey and challenges. arXiv preprint arXiv:2210.10309, 2022.

H. Jiang, X. Qi, and H. Sun. Choice-based recommender systems: a unified approach to achieving relevancy and diversity. Operations Research, 62(5):973--993, 2014.

R. Jiang, S. Chiappa, T. Lattimore, A. György, and P. Kohli. Degenerate feedback loops in recommender systems. In Proceedings of the 2019 AAAI/ACM Conference on AI, Ethics, and Society, pages 383--390, 2019.

D. Kalimeris, S. Bhagat, S. Kalyanaraman, and U. Weinsberg. Preference amplification in recommender systems. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, pages 805--815, 2021.

G. Karypis. Evaluation of item-based top-n recommendation algorithms. In Proceedings of the tenth international conference on Information and knowledge management, pages 247--254, 2001.

D. Koutra, A. Dighe, S. Bhagat, U. Weinsberg, S. Ioannidis, C. Faloutsos, and J. Bolot. PNP: Fast path ensemble method for movie design. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pages 1527--1536, 2017.

D. Kraft. A software package for sequential quadratic programming. Forschungsbericht- Deutsche Forschungs- und Versuchsanstalt fur Luft- und Raumfahrt, 1988.

K. Krauth, S. Dean, A. Zhao, W. Guo, M. Curmei, B. Recht, and M. I. Jordan. Do offline metrics predict online performance in recommender systems? arXiv preprint arXiv:2011.07931, 2020.

A. Lada, M. Wang, and T. Yan. How machine learning powers Facebook's News Feed ranking algorithm, 2021. https://engineering.fb.com/2021/01/26/core-infra/news-feed-ranking/.

M. Ledwich, A. Zaitsev, and A. Laukemper. Radical bubbles on youtube? revisiting algorithmic extremism with personalised recommendations. First Monday, 2022.

W. Lee, S. S. Lee, S. Chung, and D. An. Harmful contents classification using the harmful word filtering and svm. In Computational Science--ICCS 2007: 7th International Conference, Beijing, China, May 27--30, 2007, Proceedings, Part III 7, pages 18--25. Springer, 2007.

N. E. Leonard, K. Lipsitz, A. Bizyaeva, A. Franci, and Y. Lelkes. The nonlinear feedback dynamics of asymmetric political polarization. Proceedings of the National Academy of Sciences, 118(50):e2102149118, 2021.

S. A. Levin, H. V. Milner, and C. Perrings. The dynamics of political polarization, 2021.

L. Y. Lin, J. E. Sidani, A. Shensa, A. Radovic, E. Miller, J. B. Colditz, B. L. Hoffman, L. M. Giles, and B. A. Primack. Association between social media use and depression among us young adults. Depression and anxiety, 33(4):323--331, 2016.

W. Lu, S. Ioannidis, S. Bhagat, and L. V. Lakshmanan. Optimal recommendations under attraction, aversion, and social influence. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, pages 811--820, 2014.

R. D. Luce. Individual choice behavior: A theoretical analysis, 1959.

S. Maniu, S. Ioannidis, and B. Cautis. Bandits under the influence. In 2020 IEEE International Conference on Data Mining (ICDM), pages 1172--1177. IEEE, 2020.

M. Mansoury, H. Abdollahpouri, M. Pechenizkiy, B. Mobasher, and R. Burke. Feedback loop and bias amplification in recommender systems. In Proceedings of the 29th ACM international conference on information & knowledge management, pages 2145--2148, 2020.

D. McFadden et al. Conditional logit analysis of qualitative choice behavior. 1973.

C. Michelot. A Finite Algorithm for Finding the Projection of a Point onto the Canonical Simplex of Rⁿ. Journal of Optimization Theory and Applications, 50(1): 195--200, 1986.

M.-h. Oh and G. Iyengar. Thompson sampling for multinomial logit contextual bandits. Advances in Neural Information Processing Systems, 32, 2019.

M.-h. Oh and G. Iyengar. Multinomial logit contextual bandits: Provable optimality and practicality. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 9205--9213, 2021.

N. Pagan, J. Baumann, E. Elokda, G. De Pasquale, S. Bolognani, and A. Hannák. A classification of feedback loops and their relation to biases in automated decision- making systems. In Proceedings of the 3rd ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization, pages 1--14, 2023.

N. Perra and L. E. Rocha. Modelling opinion dynamics in the age of algorithmic personalisation. Scientific reports, 9(1):7261, 2019.

F. Pierri, L. Luceri, E. Chen, and E. Ferrara. How does twitter account moderation work? dynamics of account creation and suspension on twitter during major geopolitical events. EPJ Data Science, 12(1):43, 2023.

N. J. Restrepo, L. Illari, R. Leahy, R. F. Sear, Y. Lupu, and N. F. Johnson. How social media machinery pulled mainstream parenting communities closer to extremes and their misinformation during covid-19. IEEE Access, 2021.

M. H. Ribeiro, R. Ottoni, R. West, V. A. Almeida, and W. Meira Jr. Auditing radicalization pathways on youtube. In Proceedings of the 2020 conference on fairness, accountability, and transparency, pages 131--141, 2020.

J. G. Richens, R. Beard, and D. H. Thompson. Counterfactual harm. Advances in Neural Information Processing Systems, 36, 2022.

W. S. Rossi, J. W. Polderman, and P. Frasca. The closed loop between opinion formation and personalized recommendations. IEEE Transactions on Control of Network Systems, 9(3):1092--1103, 2021.

R. Shelby, S. Rismani, K. Henne, A. Moon, N. Rostamzadeh, P. Nicholas, N. Yilla, J. Gallegos, A. Smart, E. Garcia, et al. Sociotechnical harms: Scoping a taxonomy for harm reduction. arXiv preprint arXiv:2210.05791, 2022.

A. Singh, Y. Halpern, N. Thain, K. Christakopoulou, E. Chi, J. Chen, and A. Beutel. Building healthy recommendation sequences for everyone: A safe reinforcement learning approach. In FAccTRec Workshop, 2020.

J. J. Smith, L. Jayne, and R. Burke. Recommender systems and algorithmic hate. In Proceedings of the 16th ACM Conference on Recommender Systems, pages 592--597, 2022.

W. Suna and O. Nasraouia. User polarization aware matrix factorization for recommendation systems. 2021.

Ö. Sürer, R. Burke, and E. C. Malthouse. Multistakeholder recommendation with provider constraints. In Proceedings of the 12th ACM Conference on Recommender Systems, pages 54--62, 2018.

B. Tabibian, V. Gomez, A. De, B. Schölkopf, and M. G. Rodriguez. On the design of consequential ranking algorithms. In Conference on Uncertainty in Artificial Intelligence, pages 171--180. PMLR, 2020.

S. Vargas and P. Castells. Rank and relevance in novelty and diversity metrics for recommender systems. In Proceedings of the fifth ACM conference on Recommender systems, pages 109--116, 2011.

P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J. van der Walt, M. Brett, J. Wilson, K. J. Millman, N. Mayorov, A. R. J. Nelson, E. Jones, R. Kern, E. Larson, C. J. Carey, I. Polat, Y. Feng, E. W. Moore, J. VanderPlas, D. Laxalde, J. Perktold, R. Cimrman, I. Henriksen, E. A. Quintero, C. R. Harris, A. M. Archibald, A. H. Ribeiro, F. Pedregosa, P. van Mulbregt, and SciPy 1.0 Contributors. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python. Nature Methods, 17:261--272, 2020.

J. Whittaker, S. Looney, A. Reed, and F. Votta. Recommender systems and the amplification of extremist content. Internet Policy Review, 10(2):1--29, 2021.

Y. Wu, N. Yang, and H. Luo. Unified group recommendation towards multiple criteria. In Web and Big Data: Third International Joint Conference, APWeb-WAIM 2019, Chengdu, China, August 1--3, 2019, Proceedings, Part II 3, pages 137--151. Springer, 2019.

L. Xiao, Z. Min, Z. Yongfeng, G. Zhaoquan, L. Yiqun, and M. Shaoping. Fairness-aware group recommendation with pareto-efficiency. In Proceedings of the eleventh ACM conference on recommender systems, pages 107--115, 2017.

S.-H. Yang, B. Long, A. J. Smola, H. Zha, and Z. Zheng. Collaborative competitive filtering: learning recommender using context of user choice. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval, pages 295--304, 2011.

M. Zampieri, S. Rosenthal, P. Nakov, A. Dmonte, and T. Ranasinghe. Offenseval 2023: Offensive language identification in the age of large language models. Natural Language Engineering, 29(6):1416--1435, 2023.

L. Zhang, T. Yang, Z.-H. Zhou, et al. Dynamic regret of strongly adaptive methods. In International conference on machine learning, pages 5882--5891. PMLR, 2018.

Y. Zhang, F. Chen, and J. Lukito. Network amplification of politicized information and misinformation about covid-19 by conservative media and partisan influencers on twitter. Political Communication, pages 1--24, 2022.

Y. Zheng and D. X. Wang. A survey of recommender systems with multi-objective optimization. Neurocomputing, 474:141--153, 2022.

M. Zinkevich. Online convex programming and generalized infinitesimal gradient ascent. In Proceedings of the 20th international conference on machine learning (icml-03), pages 928--936, 2003.