Hello! I’m Ivi, a 1st year PhD candidate at the Max Planck Institute for Software Systems, under the supervision of Dr. Manuel Gomez-Rodriguez. My research interests lie broadly in the area of Human-Centered Machine Learning. Currently, I am investigating how to evaluate and compare large language models based on human alignment.

Before joining MPI-SWS, I received my MEng in Electrical and Computer Engineering from the National Technical University of Athens, where I did my diploma thesis with Prof. Symeon Papavassiliou. During my undergraduate studies, I was fortunate to do a research internship at ETH Zürich under Dr. Fanny Yang, where I worked on high-dimensional active learning. I also interned at the National Observatory of Athens and contributed to the development of the Flash Detection Software.

Publications

  • Prediction-Powered Ranking of Large Language Models
    NeurIPS, Vancouver, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code]
  • Prediction-Powered Ranking of Large Language Models
    HEAL workshop at CHI, Honolulu, 2024
    Ivi Chatzi, Eleni Straitouri, Suhas Thejaswi, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code] [poster]

Pre-prints

  • Counterfactual Token Generation in Large Language Models
    Ivi Chatzi, Nina Corvelo Benz, Eleni Straitouri, Stratis Tsirtsis, Manuel Gomez-Rodriguez
    [arxiv] [pdf] [code]