Hello! I’m Ivi, a 3rd year PhD candidate at the Max Planck Institute for Software Systems, under the supervision of Dr. Manuel Gomez-Rodriguez. My research interests lie broadly in the area of Human-Centered Machine Learning. Currently, I am researching the effects of non-canonical tokenizations on the quality of LLM generation. Previously, I have also worked on statistical and causal methods for LLM evaluation.

Before joining MPI-SWS, I received my MEng in Electrical and Computer Engineering from the National Technical University of Athens, where I did my diploma thesis with Prof. Symeon Papavassiliou. During my undergraduate studies, I was fortunate to briefly work at ETH Zürich under Dr. Fanny Yang, and at the National Observatory of Athens, where I contributed to the development of the Flash Detection Software.

Publications

  • Counterfactual Token Generation in Large Language Models
    CLeaR, Lausanne, 2025
    Ivi Chatzi*, Nina Corvelo Benz*, Eleni Straitouri*, Stratis Tsirtsis*, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

  • Prediction-Powered Ranking of Large Language Models
    NeurIPS, Vancouver, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

Workshops

  • Canonical Autoregressive Generation
    TokShop at ICML, Vancouver, 2025
    Ivi Chatzi, Nina Corvelo Benz, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [pdf]

  • Evaluation of Large Language Models via Coupled Token Generation
    Building Trust workshop at ICLR, Signapore, 2025
    Nina Corvelo Benz, Stratis Tsirtis, Eleni Straitouri, Ivi Chatzi, Ander Artola Velasco, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

  • Counterfactual Token Generation in Large Language Models
    C❤LM workshop at NeurIPS, Vancouver, 2024
    Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

  • Prediction-Powered Ranking of Large Language Models
    HEAL workshop at CHI, Honolulu, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]