Hello! I’m Ivi, a 2nd year PhD candidate at the Max Planck Institute for Software Systems, under the supervision of Dr. Manuel Gomez-Rodriguez. My research interests lie broadly in the area of Human-Centered Machine Learning. Currently, I am researching reliable and efficient methods to evaluate large language models based on human alignment.

Before joining MPI-SWS, I received my MEng in Electrical and Computer Engineering from the National Technical University of Athens, where I did my diploma thesis with Prof. Symeon Papavassiliou. During my undergraduate studies, I was fortunate to do research internships at ETH Zürich under Dr. Fanny Yang and at the National Observatory of Athens, where I contributed to the development of the Flash Detection Software.

Publications

  • Counterfactual Token Generation in Large Language Models
    CLeaR, Lausanne, 2025
    Ivi Chatzi*, Nina Corvelo Benz*, Eleni Straitouri*, Stratis Tsirtsis*, Manuel Gomez-Rodriguez
    [arxiv] [code] [poster]

  • Prediction-Powered Ranking of Large Language Models
    NeurIPS, Vancouver, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

Workshops

  • Canonical Autoregressive Generation
    TokShop at ICML, Vancouver, 2025
    Ivi Chatzi, Nina Corvelo Benz, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [pdf]

  • Evaluation of Large Language Models via Coupled Token Generation
    Building Trust workshop at ICLR, Signapore, 2025
    Nina Corvelo Benz, Stratis Tsirtis, Eleni Straitouri, Ivi Chatzi, Ander Artola Velasco, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

  • Counterfactual Token Generation in Large Language Models
    C❤LM workshop at NeurIPS, Vancouver, 2024
    Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

  • Prediction-Powered Ranking of Large Language Models
    HEAL workshop at CHI, Honolulu, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]