Shuo Chen

foto-2.png
  • PhD Candidate at LMU Munich & Siemens
  • Generative Multimodal Models and Responsible AI
  • Tresp Lab
  • MCML & relAI & OpenFLaaS
  • Email: chenshuo.cs at outlook dot com

I am a 2nd year PhD student at LMU Munich and Siemens AG, supervised by Prof. Volker Tresp. My research interests include Generative Multimodal Models and Responsible AI. I am also affiliated with MCML and relAI. Before that, I graduated from the Elite Master of Data Science with distinction at LMU Munich advised by Prof. Volker Tresp.

Before joining LMU, I graduated from the School of Information Management at Sun Yat-sen University (SYSU), Guangzhou, China, in 2020 with a major in Information Systems and a minor in Computer Science, advised by Prof. Daifeng Li.

I am always actively seeking motivated students for both research and master thesis projects. If you’re interested in working with me, feel free to apply by emailing your CV, and transcript.


News

  • Sep 2024 Our paper on question decomposition on MLLMs got accepted at EMNLP 2024. Congratulations to all co-authors!

  • July 2024 Our paper on adversarial attacks on MLLMs with CoT (paper) got accepted at COLM 2024. Congratulations to all co-authors!

  • June 2024 We are co-organizing an ELISE Workshop on Semantic, Symbolic and Interpretable Machine Learning with TU Darmstadt, in beautiful Helsinki!

  • May 2024 I will serve as a reviewer for NeurIPS 2024

  • Apr 2024 I will serve as a Program Committee member at NeusymBridge @ LREC-Coling 2024

  • Apr 2024 Check out our new paper on red-teaming GPT-4V against jailbreak attacks! paper

  • Apr 2024 Check out our new paper on adversarial attacks on MLLMs with CoT! paper

  • Nov 2023 Check out our new paper of in-context learning on vision-language models! paper

  • Sep 2023 One paper got accepted at NeurIPS 2023 Dataset and Benchmark Track! paper, page

  • Jul 2023 Check out our new systematic survey of prompt engineering on vision-language foundation models! paper, awesome github repo

Yesterday's News
  • Jun 2023 Check out our new benchmark on robustness of adaptation methods on pre-trained vision-language models! paper, page.

  • Feb 2023 I graduated from the Data Science Master project at LMU with a grade of 1.08/1.0 (1.0 is the best) and started a new journey as a PhD Student!

  • Nov 2022 One paper has been accepted to Cancers.

  • May 2022 I obtained the LMU SIST Scholarship and would be sponsored by the Bavaria Education Ministry in the next 10 months.

  • July 2020 I joined DMAI as a Research Intern.
  • July 2019 I joined DMAI as a Research Intern.
  • May 2019 I obtained the First Class Scholarship for Excellent Students at Sun Yat-sen University.
  • Nov 2018 I obtained the Chinese National Scholarship which is the scholarship with the highest honor that Chinese college students can obtain. (Press Coverage, in Chinese)

  • Nov 2017 I obtained the National Encouragement Scholarship for excellent students with financial needs.

  • Aug 2017 I took a study tour of top-notch universities in Taiwan with visiting grant from SYSU.


Education Experiences

  • 2023 - Now PhD Student, LMU Munich & Siemens AG, Munich Germany

  • 2020 - 2022 M.Sc. Data Science, LMU Munich, Munich Germany
    Elite Master Project funded by Bavaria Government
    1.08/1.0 (approximately 4.0/4.0)

  • 2016 - 2020 Information System, Sun Yat-sen University, Guangzhou China
    Minor in Computer Science
    3.8/4.0 top10%

Publications

  • Red Teaming GPT-4V: Are GPT-4V Safe Against Uni/Multi-Modal Jailbreak Attacks? [arXiv] [Code]
    Shuo Chen, Zhen Han, Bailan He, Zifeng Ding, Wenqian Yu, Philip Torr, Volker Tresp, Jindong Gu
    SET LLM @ ICLR 2024

  • Understanding and Improving In-Context Learning on Vision-language Models [arXiv]
    Shuo Chen, Zhen Han, Bailan He, Mark Buckley, Philip Torr, Volker Tresp, Jindong Gu
    ME-FoMo @ ICLR 2024

  • Benchmarking Robustness of Adaptation Methods on Pre-trained Vision-Language Models [arXiv] [Page] [Code]
    Shuo Chen, Jindong Gu, Zhen Han, Yunpu Ma, Philip Torr, Volker Tresp
    NeurIPS 2023 Dataset and Benchmark Track

  • Stop Reasoning! When Multimodal LLMs with Chain-of-Thought Reasoning Meets Adversarial Images [arXiv]
    Zefeng Wang, Zhen Han, Shuo Chen, Fan Xue, Zifeng Ding, Xun Xiao, Volker Tresp, Philip Torr, Jindong Gu
    COLM 2024

  • Visual Question Decomposition on Multimodal Large Language Models Stay-tuned for the final camera-ready version!
    Haowei Zhang, Jianzhe Liu, Zhen Han, Shuo Chen, Bailan He, Volker Tresp, Zhiqiang Xu, Jindong Gu
    EMNLP 2024 Findings

  • A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models [arXiv] [Awesome Githup Repo]
    Jindong Gu, Zhen Han, Shuo Chen, Ahmad Beirami, Bailan He, Gengyuan Zhang, Ruotong Liao, Yao Qin, Volker Tresp, Philip Torr
    arXiv preprint arXiv:2307.12980, 2023

Before PhD
  • EMT-Related Genes Have No Prognostic Relevance in Metastatic Colorectal Cancer as Opposed to Stage II/III [Link] [PDF]
    Pretzsch Elise, Volker Heinemann, Sebastian Stintzing, Andreas Bender, Shuo Chen, Julian Walter Holch, Felix Oliver Hofmann, Haoyu Ren, Florian Bösch, Helmut Küchenhoff, Jens Werner, Martin Konrad Angele
    Cancers, 2022
  • Introduction and Exemplars of Uncertainty Decomposition. [arXiv] [PDF]
    Shuo Chen
    arXiv preprint arXiv:2211.15475, 2022
  • Social Networks are Divulging Your Identity behind Crypto Addresses. [arXiv] [PDF]
    Shuo Chen, Uzair Norman
    arXiv preprint arXiv:2211.09656, 2021