Publications

Anaelia Ovalle, Palash Goyal, Jwala Dhamala, Zachary Jaggers, Kai-Wei Chang, Aram Galstyan, Richard Zemel, Rahul Gupta (2023). “I’m fully who I am”: Towards Centering Transgender and Non-Binary Voices to Measure Biases in Open Language Generation (ACM FAccT, 2023). ACM FAccT 2023.

Anaelia Ovalle, Ninareh Mehrabi, Palash Goyal, Jwala Dhamala, Kai-Wei Chang, Richard Zemel, Aram Galstyan, Yuval Pinter, Rahul Gupta (2023). Tokenization Matters: Navigating Data-Scarce Tokenization for Gender Inclusive Language Technologies (2024, NAACL Findings). ACM FAccT 2023.

Anaelia Ovalle, Krunoslav Lehman Pavasovic, Louis Martin, Luke Zettlemoyer, Eric Michael Smith, Adina Williams, Levent Sagun (2023). The Root Shapes the Fruit: On the Persistence of Gender-Exclusive Harms in Aligned Language Models (2025, ACM FAccT). ACM FAccT 2023.

Margaret Mitchell, Giuseppe Attanasio, Ioana Baldini, Miruna Clinciu, Jordan Clive, Pieter Delobelle, Manan Dey, Sil Hamilton, Timm Dill, Jad Doughman, Ritam Dutt, Avijit Ghosh, Jessica Zosa Forde, Carolin Holtermann, Lucie-Aimée Kaffee, Tanmay Laud, Anne Lauscher, Roberto L Lopez-Davila, Maraim Masoud, Nikita Nangia, Anaelia Ovalle, Giada Pistilli, Dragomir Radev, Beatrice Savoldi, Vipul Raheja, Jeremy Qin, Esther Ploeger, Arjun Subramonian, Kaustubh Dhole, Kaiser Sun, Amirbek Djanibekov, Jonibek Mansurov, Kayo Yin, Emilio Villa Cueva, Sagnik Mukherjee, Jerry Huang, Xudong Shen, Jay Gala, Hamdan Al-Ali, Tair Djanibekov, Nurdaulet Mukhituly, Shangrui Nie, Shanya Sharma, Karolina Stańczak, Eliza Szczechla, Tiago Timponi Torrent, Deepak Tunuguntla, Marcelo Viridiano, Oskar Van Der Wal, Adina Yakefu, Aurélie Névéol, Mike Zhang, Sydney Zink, Zeerak Talat (2023). SHADES: Towards a multilingual assessment of stereotypes in large language models (2025, NAACL). ACM FAccT 2023.

Organizers Of Queerinai, Anaelia Ovalle, Arjun Subramonian, Ashwin Singh, Claas Voelcker, Danica J Sutherland, Davide Locatelli, Eva Breznik, Filip Klubicka, Hang Yuan, Huan Zhang, Jaidev Shriram, Kruno Lehman, Luca Soldaini, Maarten Sap, Marc Peter Deisenroth, Maria Leonor Pacheco, Maria Ryskina, Martin Mundt, Milind Agarwal, Nyx Mclean, Pan Xu, A Pranav, Raj Korpan, Ruchira Ray, Sarah Mathew, Sarthak Arora, St John, Tanvi Anand, Vishakha Agrawal, William Agnew, Yanan Long, Zijie J Wang, Zeerak Talat, Avijit Ghosh, Nathaniel Dennler, Michael Noseworthy, Sharvani Jha, Emi Baylor, Aditya Joshi, Natalia Y Bilenko, Andrew Mcnamara, Raphael Gontijo-Lopes, Alex Markham, Evyn Dong, Jackie Kay, Manu Saraswat, Nikhil Vytla, Luke Stark (2023). Queer In AI: A Case Study in Community-Led Participatory AI (ACM FAcct Best Paper Award, 2023). ACM FAccT 2023.

Nathan Dennler, Anaelia Ovalle, Ashwin Singh, Luca Soldaini, Arjun Subramonian, Huy Tu, William Agnew, Avijit Ghosh, Kyra Yee, Irene Font Peradejordi, Zeerak Talat, Mayra Russo, Jess De Jesus De Pinho Pinhal (2023). Bound by the Bounty: Collaboratively Shaping Evaluation Processes for Queer AI Harms. 2023 AAAI/ACM Conference on AI, Ethics, and Society (AIES).

Anaelia Ovalle, PhD, Arjun Subramonian, Vagrant Gautam, Gilbert Gee, Kai-Wei Chang (2023). Factoring the Matrix of Domination: A Critical Review and Reimagination of Intersectionality in AI Fairness. 2023 AAAI/ACM Conference on AI, Ethics, and Society (AIES).

Anaelia Ovalle, Davi Liang, Alicia Boyd (2023). Should they? Mobile Biometrics and Technopolicy meet Queer Community Considerations. ACM EAAMO 2023.

Anaelia Ovalle, PhD, Evan Czyzycki, Cho-Jui Hsieh (2021). Improving Adversarial Robustness to Sensitivity and Invariance Attacks with Deep Metric Learning. 2023 AAAI Student Abstract.

Anaelia Ovalle, PhD, Orpaz Goldstein, Mohammad Kachuee, Chenglin Hong, Elizabeth Wu, Ian Holloway, Majid Sarrafzadeh (2021). Leveraging Social Media Activity and Machine Learning for HIV and Substance Abuse Risk Assessment. JMIR.

Sunipa Dev, Masoud Monajatipoor, Anaelia Ovalle, PhD, Arjun Subramonian, Jeff Philips, Kai-Wei Chang (2021). Harms of gender exclusivity and challenges in non-binary representation in language technologies. 2019 EMNLP Conference.

Anaelia Ovalle, PhD, Sunipa Dev, Jieyu Zhao, Majid Sarrafzadeh, Kai-Wei Chang (2021). Auditing Algorithmic Fairness in Machine Learning for Health with Severity-Based LOGAN. AAAI Health Intelligence.