EARL Workshop

The 2nd EARL Workshop on Evaluating and Applying Recommender Systems with Large Language Models will take place at RecSys 2025 in Prague, Czech Republic. This workshop focuses on advancing the application, evaluation, and understanding of large language models (LLMs) in the context of recommender systems (RSs). The event encourages submissions on emerging techniques such as retrieval-augmented generation (RAG), multi-modal recommendation, reinforcement learning with human feedback (RLHF), dynamic prompting, scalable fine-tuning, and personalized conversational agents. It also highlights real-world applications, deployment experiences, and critical challenges related to fairness, transparency, and responsible AI in LLM-driven RSs.

Call for papers

  • Important Dates:
    • Call for Papers publication: April 25, 2025
    • First Round paper submission deadline: July 10, 2025
    • Second Round paper submission deadline: August 7, 2025 (RecSys Official Suggested)
    • Reviewer deadline: August 21, 2025
    • Author notification: August 25, 2025
    • Camera-ready version deadline: September 4, 2025

Schedule

EARL is scheduled on September 26 (GMT+2), at Prague, Czech Republic
13:30 - 13:40 Welcome note - Award Announcement
13:40 - 14:30 Invited Talk 1: LLMs for Next-Generation Recommender Systems: From Understanding User Behavior to Deployment
Speaker: Wei-Wei Du (Sony Group Corporation), Tommaso Carraro (Sony Research India)
14:30 - 14:50 AudioBoost: Increasing Audiobook Retrievability in Spotify Search with Synthetic Query Generation
Presenters: Enrico Palumbo, Gustavo Penha, Alva Liu, Marcus Eltscheminov, Jefferson Carvalho dos Santos, Alice Wang, Hugues Bouchard, Humberto Corona and Michelle Tran Luu
14:50 - 15:10 Revealing Potential Biases in LLM-Based Recommender Systems in the Cold Start Setting
Presenters: Alexandre Andre, Gauthier Roy, Eva Dyer and Kai Wang
15:10 - 15:30 ScientiaRec: a Scientific Article Recommendation System with LLM-Driven Feature Extraction
Presenters: Imen Ben Sassi
15:30 - 16:00 Coffee break
16:00 - 16:40 Invited Talk 2: Agentic Marketplace: The next era of recommendation system
Speaker: Wenyue Hua (Microsoft Research)
16:40 - 17:00 LLM-as-Judge: Rapid Evaluation of Legal Document Recommendation via Retrieval-Augmented Generation
Presenters: Anu Pradhan, Alexandra Ortan, Apurv Verma and Madhavan Seshadri
17:00 - 17:20 LLM-based Relevance Assessment for Web-Scale Search Evaluation at Pinterest
Presenters: Han Wang, Alex Whitworth, Pak Ming Cheung, Zhenjie Zhang and Krishna Kamath
17:20 - 17:40 A Metric for MLLM Alignment in Large-scale Recommendation
Presenters: Yubin Zhang, Yanhua Huang, Haiming Xu, Mingliang Qi, Chang Wang, Jiarui Jin, Xiangyuan Ren, Xiaodan Wang and Ruiwen Xu

EARL Workshop

The workshop will be held on RecSys 2025.

RecSys

SUPPORTERS

Smartor

Insight

KR

CONTACT

irene.li@weblab.t.u-tokyo.ac.jp, ruihai.dong@ucd.ie

PREVIOUS WORKSHOPS

EARL 2024