Hello! I’m Ivi, a 2nd year PhD candidate at the Max Planck Institute for Software Systems, under the supervision of Dr. Manuel Gomez-Rodriguez. My research interests lie broadly in the area of Human-Centered Machine Learning. Currently, I am researching reliable and efficient methods to evaluate large language models based on human alignment.

Before joining MPI-SWS, I received my MEng in Electrical and Computer Engineering from the National Technical University of Athens, where I did my diploma thesis with Prof. Symeon Papavassiliou. During my undergraduate studies, I was fortunate to do research internships at ETH Zürich under Dr. Fanny Yang and at the National Observatory of Athens, where I contributed to the development of the Flash Detection Software.

Publications

  • Counterfactual Token Generation in Large Language Models
    CLeaR, Lausanne, 2025
    Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [code]

  • Prediction-Powered Ranking of Large Language Models
    NeurIPS, Vancouver, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

Workshops

  • Counterfactual Token Generation in Large Language Models
    C❤LM workshop at NeurIPS, Vancouver, 2024
    Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

  • Prediction-Powered Ranking of Large Language Models
    HEAL workshop at CHI, Honolulu, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

Pre-prints

  • Evaluation of Large Language Models via Coupled Token Generation
    Nina Corvelo Benz, Stratis Tsirtis, Eleni Straitouri, Ivi Chatzi, Ander Artola Velasco, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code]