All Publications

  1. Model Equality Testing: Which model is this API serving?
    Irena Gao, Percy Liang, and Carlos Guestrin
    In International Conference on Learning Representations 2025.
    arXiv Code Twitter
  2. OpenFlamingo: An open-source framework for training large autoregressive vision-language models
    Anas Awadalla*, Irena Gao*, Joshua Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Gadre, Shiori Sagawa, Jenia Jitsev, Simon Kornblith, Pang Wei Koh, Gabriel Ilharco, Mitchell Wortsman, and Ludwig Schmidt
    2023.
    arXiv Blog Code Website Twitter
  3. Are aligned neural networks adversarially aligned?
    Nicholas Carlini, Milad Nasr, Christopher A Choquette-Choo, Matthew Jagielski, Irena Gao, Anas Awadalla, Pang Wei Koh, Daphne Ippolito, Katherine Lee, Florian Tramer, and Ludwig Schmidt
    In Neural Information Processing Systems 2023.
    arXiv
  4. Adaptive Testing of Computer Vision Models
    Irena Gao, Gabriel Ilharco, Scott Lundberg, and Marco Tulio Ribeiro
    In International Conference on Computer Vision 2023. (Oral Presentation)
    arXiv Code Twitter
  5. CREPE: Can Vision-Language Foundation Models Reason Compositionally?
    Zixian Ma*, Jerry Hong*, Mustafa Omer Gul*, Mona Gandhi, Irena Gao, and Ranjay Krishna
    In Conference on Computer Vision and Pattern Recognition 2023. (Highlight)
    arXiv Code
  6. Out-of-Domain Robustness via Targeted Augmentations
    Irena Gao*, Shiori Sagawa*, Pang Wei Koh, Tatsunori Hashimoto, and Percy Liang
    In International Conference on Machine Learning 2023.
    arXiv Code
  7. Extending the WILDS benchmark for unsupervised adaptation
    Shiori Sagawa*, Pang Wei Koh*, Tony Lee*, Irena Gao*, Sang Michael Xie, Kendrick Shen, Ananya Kumar, Weihua Hu, Michihiro Yasunaga, Henrik Marklund, Sara Beery, Etienne David, Ian Stavness, Wei Guo, Jure Leskovec, Kate Saenko, Tatsunori Hashimoto, Sergey Levine, Chelsea Finn, and Percy Liang
    In International Conference on Learning Representations 2022. (Oral Presentation)
    arXiv Code Website
  8. WILDS: A benchmark of in-the-wild distribution shifts
    Pang Wei Koh*, Shiori Sagawa*, Sang Michael Xie, Marvin Zhang, Akshay Balsubramani, Weihua Hu, Michihiro Yasunaga, Richard Lanas Phillips, Irena Gao, Tony Lee, Etienne David, Ian Stavness, Wei Guo, Berton Earnshaw, Imran Haque, Sara Beery, Jure Leskovec, Anshul Kundaje, Emma Pierson, Sergey Levine, Chelsea Finn, and Percy Liang
    In International Conference on Machine Learning 2021. (Long Talk)
    arXiv Code Website
  9. Parallel worlds: Repeated initializations of the same team to improve team viability
    Mark E Whiting, Irena Gao*, Michelle Xing*, N’godjigui Junior Diarrassouba*, Tonya Nguyen*, and Michael S Bernstein
    2020.
    Paper

* denotes equal contribution.