EPFL papers @ ICLR 2025

© 2025 EPFL

© 2025 EPFL

The following EPFL papers have been accepted to ICLR 2025 (The Thirteenth International Conference on Learning Representations).
The conference will be held from April 24-28, 2025 in Singapore.

Below is a list of ICLR 2025 papers with at least one EPFL author:

  1. Adversarial Training for Defense Against Label Poisoning Attacks by Melis Ilayda Bal, Volkan Cevher, Michael Muehlebach
  2. Certified Robustness Under Bounded Levenshtein Distance by Elias Abad Rocamora, Grigorios Chrysos, Volkan Cevher
  3. Faster Inference of Flow-Based Generative Models via Improved Data-Noise Coupling by Aram Davtyan, Leello Tadesse Dadi, Volkan Cevher, Paolo Favaro
  4. Efficient Interpolation between Extragradient and Proximal Methods for Weak MVIs by Thomas Pethick, Ioannis Mavrothalassitis, Volkan Cevher
  5. Addressing Label Shift in Distributed Learning via Entropy Regularization​ by Zhiyuan Wu, Changkyu Choi, Xiangcheng Cao, Volkan Cevher, Ali Ramezani-Kebrya
  6. How Gradient descent balances features: A dynamical analysis for two-layer neural networks by Zhenyu Zhu, Fanghui Liu, Volkan Cevher
  7. Quantum-PEFT: Ultra parameter-efficient fine-tuning by Toshiaki Koike-Akino, Francesco Tonin, Yongtao Wu, Zhengqing Wu, Leyla Naz Candogan, Volkan Cevher
  8. Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escaping, and Network Embedding by Zhengqing Wu, Berfin Simsek, François Gaston Ged
  9. Intrinsic User-Centric Interpretability through Global Mixture of Experts by Vinitra Swamy, Syrielle Montariol, Julian Blackwell, Jibril Frej, Martin Jaggi, Tanja Käser
  10. Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks by Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion
  11. Does Refusal Training in LLMs Generalize to the Past Tense? by Maksym Andriushchenko, Nicolas Flammarion
  12. Is In-Context Learning Sufficient for Instruction Following in LLMs? by Hao Zhao, Maksym Andriushchenko, Francesco Croce, Nicolas Flammarion
  13. Adversarially Robust Out-of-Distribution Detection Using Lyapunov-Stabilized Embeddings by Hossein Mirzaei, Mackenzie W Mathis
  14. Beyond Auto-Regression: Fast LLMs via Self-Distillation Through Time by Justin Deschenaux, Caglar Gulcehre
  15. LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging by Ke Wang, Nikolaos Dimitriadis, Alessandro Favero, Guillermo Ortiz-Jimenez, François Fleuret, Pascal Frossard
  16. Pareto Low-Rank Adapters: Efficient Multi-Task Learning with Preferences by Nikolaos Dimitriadis, Pascal Frossard, François Fleuret
  17. Improved Algorithms for Kernel Matrix-Vector Multiplication by Piotr Indyk, Michael Kapralov, Kshiteej Sheth, Tal Wagner
  18. Probing the Latent Hierarchical Structure of Data via Diffusion Models by Antonio Sclocchi, Alessandro Favero, Noam Itzhak Levi, Matthieu Wyart
  19. CoTFormer: A Chain of Thought Driven Architecture with Budget-Adaptive Computation Cost at Inference by Amirkeivan Mohtashami, Matteo Pagliardini, Martin Jaggi
  20. The AdEMAMix Optimizer: Better, Faster, Older by Matteo Pagliardini, Pierre Ablin, David Grangier
  21. Task-Adaptive Pretrained Language Models via Clustered-Importance Sampling by David Grangier, Simin Fan, Skyler Seto, Pierre Ablin
  22. Effective Interplay between Sparsity and Quantization: From Theory to Practice by Simla Burcu Harma, Ayan Chakraborty, Elizaveta Kostenok, Danila Mishin, Dongho Ha, Babak Falsafi, Martin Jaggi, Ming Liu, Yunho Oh, Suvinay Subramanian, Amir Yazdanbakhsh
  23. Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression by Megh Shukla, Aziz Shameem, Mathieu Salzmann, Alexandre Alahi
  24. Attention with Markov: A Curious Case of Single-layer Transformers by Ashok Vardhan Makkuva, Marco Bondaschi, Alliot Nagle, Adway Girish, Hyeji Kim, Martin Jaggi, Michael Gastpar
  25. TopoLM: brain-like spatio-functional organization in a topographic language model by Neil Rathi, Johannes Mehrer, Badr AlKhamissi, Taha Osama A Binhuraib, Nicholas Blauch, Martin Schrimpf
  26. INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge by Angelika Romanou, Negar Foroutan, Anna Sotnikova, Imanol Schlag, Marzieh Fadaee, Sara Hooker, Antoine Bosselut
  27. BigDocs: An Open and Permissively-Licensed Dataset for Training Multimodal Models on Document and Code Tasks by Juan A. Rodriguez, Xiangru Jian, Siba Smarak Panigrahi, David Vazquez, Sai Rajeswar
  28. SymmCD: Symmetry-Preserving Crystal Generation with Diffusion Models by Daniel Levy, Siba Smarak Panigrahi, Siamak Ravanbakhsh
  29. Large (Vision) Language Models are Unsupervised In-Context Learners by Artyom Gadetsky, Andrei Atanov, Yulun Jiang, Zhitong Gao, Ghazal Hosseini Mighan, Amir Zamir, Maria Brbic
  30. HyperFace: Generating Synthetic Face Recognition Datasets by Exploring Face Embedding Hypersphere by Hatef Otroshi Shahreza, Sébastien Marcel
  31. What to align in multimodal contrastive learning? by Benoit Dufumier, Javiera Castillo Navarro, Devis Tuia, Jean-Philippe Thiran
  32. Joint Fine-tuning and Conversion of Pretrained Speech and Language Models towards Linear Complexity by Mutian He, Philip N. Garner
  33. Selective induction Heads: How Transformers Select Causal Structures in Context by Francesco D'Angelo, Francesco Croce, Nicolas Flammarion
  34. Adaptive Gradient Clipping for Robust Federated Learning by Youssef Allouah, Rachid Guerraoui, Nirupam Gupta, Ahmed Jellouli, Geovani Rizk, John Stephan
  35. The Utility and Complexity of In- and Out-of-Distribution Machine Unlearning by Youssef Allouah, Joshua Kazdan, Rachid Guerraoui, Sanmi Koyejo
  36. LeFusion: Controllable Pathology Synthesis via Lesion-Focused Diffusion Models by Hantao Zhang, Yuhe Liu, Jiancheng Yang, Shouhong Wan, Xinyuan Wang, Wei Peng, Pascal Fua
  37. Enhancing Compositional Text-to-Image Generation with Reliable Random Seeds by Shuangqi Li, Hieu Le, Jingyi Xu, Mathieu Salzmann
  38. Long-Context Linear System Identification by Oğuz Kaan Yüksel, Mathieu Even, Nicolas Flammarion
  39. Controllable Context Sensitivity and the Knob Behind It by Julian Minder, Kevin Du, Niklas Stoehr, Giovanni Monea, Chris Wendler, Robert West, Ryan Cotterell
  40. Adversarially Robust Anomaly Detection through Spurious Negative Pair Mitigation by Hossein Mirzaei, Mojtaba Nafez, Jafar Habibi, Mohammad Sabokrou, Mohammad Hossein Rohban