Stephanie Milani

I am a final-year Ph.D. candidate in the Machine Learning Department at Carnegie Mellon University, where I am advised by Fei Fang. My research addresses real-world, human-centered challenges of machine learning involving sequential decision-making, including human-AI interaction, transparency, and alignment. I am a Future Leader in Responsible Data Science & AI and a Rising Star in Data Science.

During my Ph.D., I interned at Microsoft Research with Geoff Gordon and in the Microsoft Research Deep Reinforcement Learning for Games group with Katja Hofmann. Before that, I completed my B.S. in Computer Science and B.A. in Psychology at the University of Maryland, Baltimore County, where I worked with Marie desJardins and Cynthia Matuszek.

🎓 On the Academic Job Market!

Email  /  CV  /  Google Scholar  /  LinkedIn  /  Twitter

Selected Publications

PATIENT-Ψ: Using Large Language Models to Simulate Patients for Training Mental Health Professionals
Ruiyi Wang*, Stephanie Milani*, Jamie C. Chiu, Shaun M. Eack, Travis Labrum, Samuel M. Murphy, Nev Jones, Kate Hardy, Hong Shen, Fei Fang, Zhiyu Zoey Chen
EMNLP, 2024
NeurIPS FM-EduAssess Workshop, 2024 (Oral); NeurIPS GenAI for Health Workshop, 2024 (Oral)

Concept-Based Interpretable Reinforcement Learning with Limited to No Human Labels
Zhuorui Ye*, Stephanie Milani*, Geoffrey J. Gordon, Fei Fang
RLC TAFM Workshop, 2024 (Spotlight); RLC InterpPol Workshop, 2024 (Oral)

MABL: Bi-Level Latent-Variable World Model for Sample-Efficient Multi-Agent Reinforcement Learning
Aravind Venugopal, Stephanie Milani, Fei Fang, Balaraman Ravindran
AAMAS, 2024

BEDD: The MineRL BASALT Evaluation and Demonstrations Dataset for Training and Benchmarking Agents that Solve Fuzzy Tasks
Stephanie Milani, Anssi Kanervisto, Karolis Ramanauskas, Sander Schulhoff, Brandon Houghton, Rohin Shah
NeurIPS Datasets & Benchmarks Track, 2023 (Oral)
ICML MFM-EAI Workshop, 2024 (Outstanding Paper Award)

Explainable Reinforcement Learning: A Survey and Comparative Review
Stephanie Milani, Nicholay Topin, Manuela Veloso, Fei Fang
ACM CSUR Special Issue on Trustworthy AI, 2023

Navigates Like Me: Understanding How People Evaluate Human-Like AI in Video Games
Stephanie Milani, Arthur Juliani, Ida Momennejad, Raluca Georgescu, Jaroslaw Rzpecki, Alison Shaw, Gavin Costello, Fei Fang, Sam Devlin, Katja Hofmann
CHI, 2023

Uni[MASK]: Unified Inference in Sequential Decision Problems
Micah Carroll, Jessy Lin, Orr Paradise, Raluca Georgescu, Mingfei Sun, David Bignell, Stephanie Milani, Katja Hofmann, Matthew Hausknecht, Anca Dragan, Sam Devlin
NeurIPS, 2022 (Oral)

MAVIPER: Learning Decision Tree Policies for Interpretable Multi-Agent Reinforcement Learning
Stephanie Milani*, Zhicheng Zhang*, Nicholay Topin, Zheyuan Ryan Shi, Charles Kamhoua, Evangelos E. Papalexakis, Fei Fang
ECML-PKDD, 2022

Iterative Bounding MDPs: Learning Interpretable Policies via Non-Interpretable Methods
Nicholay Topin, Stephanie Milani, Fei Fang, Manuela Veloso
AAAI, 2021

Harnessing the Power of Deception in Attack Graph-Based Security Games
Stephanie Milani, Weiran Shen, Kevin S. Chan, Sridhar Venkatesan, Nandi O. Leslie, Charles Kamhoua, Fei Fang
GameSec, 2020

Perceptions of Domestic Robots' Normative Behavior Across Cultures
Huao Li, Stephanie Milani, Vigneshram Krishnamoorthy, Michael Lewis, Katia Sycara
AIES, 2019
bibtex


I got this great website here.