Publications

2026

1. ICML 2026

   

   The Geometry of Reasoning: Self-Evaluation via Layerwise Trajectory Evolution

   Jinhe Bi, Danqi Yan, Yifan Wang, Wenke Huang, Haokun Chen, Guancheng Wan, Mang Ye, Xun Xiao, Hinrich Schuetze, Volker Tresp, and others

   In International Conference on Machine Learning

   July 2026

   Abs Bib PDF

   Large Reasoning Models (LRMs) enhance performance by generating explicit Chain-of-Thought (CoT) trajectories, yet enabling them to self-evaluate correctness without external supervision remains a critical challenge. Existing methods often rely on ground-truth labels or shallow output probabilities, neglecting the layerwise evolution of the reasoning trajectory. In this work, we introduce GoR (Geometry of Reasoning), a white-box self-evaluation framework based on layerwise trajectory evolution. GoR decomposes reasoning fidelity into two complementary dimensions: (1) Geometric Evolution, which synthesizes the first- and second-order evolution of layerwise hidden-state trajectories to quantify geometric progress in reasoning; and (2) Difficulty-Aware Calibration, which utilizes cross-entropy of reasoning progress to normalize the Geometric Evolution against intrinsic query uncertainty. By jointly modeling these factors, GoR effectively distinguishes the coherent evolution of correct reasoning from the chaotic trajectories of errors. Extensive experiments across eight LRMs and seven benchmarks demonstrate that GoR consistently outperforms state-of-the-art baselines in AUROC, AUPR, and FPR@95.

   @inproceedings{bi2026geometry,
     title = {The Geometry of Reasoning: Self-Evaluation via Layerwise Trajectory Evolution},
     author = {Bi, Jinhe and Yan, Danqi and Wang, Yifan and Huang, Wenke and Chen, Haokun and Wan, Guancheng and Ye, Mang and Xiao, Xun and Schuetze, Hinrich and Tresp, Volker and others},
     booktitle = {International Conference on Machine Learning},
     year = {2026},
     month = jul,
   }

2. ICML 2026

   

   Graph is a Substrate Across Data Modalities

   Ziming Li, Xiaoming Wu, Zehong Wang, Jiazheng Li, Yijun Tian, Jinhe Bi, Yunpu Ma, Yanfang Ye, and Chuxu Zhang

   In International Conference on Machine Learning

   July 2026

   Abs Bib PDF

   Graphs provide a natural representation of relational structure that arises across diverse domains. Despite this ubiquity, graph structure is typically learned in a modality- and task-isolated manner, where structural regularities across modalities and tasks are repeatedly reconstructed rather than accumulated at the level of intermediate graph representations. We adopt a representation-centric perspective in which graph structure is treated as a structural substrate that persists across learning contexts. We propose G-Substrate, comprising a unified structural schema that ensures compatibility among graph representations across heterogeneous modalities and tasks, and an interleaved role-based training strategy that exposes the same graph structure to multiple functional roles during learning. Experiments across multiple domains, modalities, and tasks show that G-Substrate outperforms task-isolated and naive multi-task learning methods.

   @inproceedings{li2026graphsubstrate,
     title = {Graph is a Substrate Across Data Modalities},
     author = {Li, Ziming and Wu, Xiaoming and Wang, Zehong and Li, Jiazheng and Tian, Yijun and Bi, Jinhe and Ma, Yunpu and Ye, Yanfang and Zhang, Chuxu},
     booktitle = {International Conference on Machine Learning},
     year = {2026},
     month = jul,
   }

3. ICML 2026

   

   Select to Think: Unlocking SLM Potential with Local Sufficiency

   Wenxuan Ye, Yangyang Zhang, Xueli An, Georg Carle, and Yunpu Ma

   In International Conference on Machine Learning

   July 2026

   Abs Bib PDF

   Small language models (SLMs) offer efficient deployment, yet often lag behind LLMs in reasoning. We identify local sufficiency: at divergence points, the LLM’s preferred token often resides within the SLM’s top-K next-token predictions, even when failing to emerge as the SLM top-1 choice. We propose Select to Think (S2T), which reframes the LLM’s role from open-ended generation to selection among the SLM’s proposals, simplifying supervision to discrete candidate rankings. We introduce S2T-Local, which distills the selection logic into the SLM for autonomous re-ranking without inference-time LLM dependency. A 1.5B SLM’s top-8 candidates contain the 32B LLM’s choice with a 95% hit rate, and S2T-Local improves the 1.5B SLM’s Math Avg. over greedy decoding by 24.1% relative gain.

   @inproceedings{ye2026selecttothink,
     title = {Select to Think: Unlocking {SLM} Potential with Local Sufficiency},
     author = {Ye, Wenxuan and Zhang, Yangyang and An, Xueli and Carle, Georg and Ma, Yunpu},
     booktitle = {International Conference on Machine Learning},
     year = {2026},
     month = jul,
   }

4. ICML 2026

   

   EchoRL: Reinforcement Learning via Rollout Echoing

   Jinhe Bi, Aniri, Minglai Yang, Xingcheng Zhou, Wenke Huang, Sikuan Yan, Yujun Wang, Zixuan Cao, Michael Faerber, Xun Xiao, Volker Tresp, and Yunpu Ma

   In International Conference on Machine Learning

   July 2026

   Abs Bib PDF

   Reinforcement Learning with Verifiable Rewards (RLVR) is an effective route for post-training to strengthen the reasoning capability of large language models. As training proceeds, a growing fraction of prompts’ rollouts become advantage-degenerated: all self-generated rollouts show verified-success, making the standard deviation of rewards zero and causing policy gradient to vanish. We propose EchoRL, which identifies an EchoClip from verified-success rollouts based on step-level entropy values and feeds this clip back as an auxiliary supervision signal in the RL objective. Extensive experiments across 10 benchmarks, 5 LLM backbones, and 4 popular RLVR post-training methods demonstrate that EchoRL consistently improves RLVR post-training with minimal overhead.

   @inproceedings{bi2026echorl,
     title = {{EchoRL}: Reinforcement Learning via Rollout Echoing},
     author = {Bi, Jinhe and Aniri and Yang, Minglai and Zhou, Xingcheng and Huang, Wenke and Yan, Sikuan and Wang, Yujun and Cao, Zixuan and Faerber, Michael and Xiao, Xun and Tresp, Volker and Ma, Yunpu},
     booktitle = {International Conference on Machine Learning},
     year = {2026},
     month = jul,
   }

5. ACL Findings 2026

   

   Self-Evolving Multi-Agent Systems via Textual Backpropagation

   Xiaowen Ma, Yunpu Ma, Chenyang Lin, Sikuan Yan, Jinhe Bi, Zixuan Cao, Yijun Tian, Volker Tresp, and Hinrich Schuetze

   In Findings of the Association for Computational Linguistics: ACL 2026

   July 2026

   Abs Bib PDF

   Leveraging multiple Large Language Models (LLMs) has proven effective for addressing complex tasks, but current approaches rely on static, manually engineered multi-agent configurations. We present the Agentic Neural Network (ANN), a framework that conceptualizes multi-agent collaboration as a layered neural network architecture. Our framework follows a two-phase optimization strategy: (1) Forward Phase—tasks are dynamically decomposed into subtasks, and cooperative agent teams are constructed layer by layer; (2) Backward Phase—mirroring backpropagation, we refine collaboration through iterative feedback, allowing agents to self-evolve their roles, prompts, and coordination. Across seven benchmark datasets, our work surpasses leading multi-agent baselines under the same configurations.

   @inproceedings{ma2025selfevolving,
     title = {Self-Evolving Multi-Agent Systems via Textual Backpropagation},
     author = {Ma, Xiaowen and Ma, Yunpu and Lin, Chenyang and Yan, Sikuan and Bi, Jinhe and Cao, Zixuan and Tian, Yijun and Tresp, Volker and Schuetze, Hinrich},
     booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
     pages = {9918--9951},
     year = {2026},
     month = jul,
   }

6. ACL 2026

   

   Memory-R1: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning

   Sikuan Yan, Xiufeng Yang, Zuchao Huang, Ercong Nie, Zifeng Ding, Zonggen Li, Xiaowen Ma, Jinhe Bi, Kristian Kersting, Jeff Z. Pan, Hinrich Schuetze, Volker Tresp, and Yunpu Ma

   In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics

   July 2026

   Abs Bib PDF

   Large Language Models (LLMs) remain fundamentally stateless, constrained by limited context windows that hinder long-horizon reasoning. We present Memory-R1, a reinforcement learning framework that equips LLMs with the ability to actively manage and utilize external memory through two specialized agents: a Memory Manager that learns structured operations (ADD, UPDATE, DELETE, NOOP) and an Answer Agent that pre-selects and reasons over relevant entries. Both agents are fine-tuned with outcome-driven RL, enabling adaptive memory management with minimal supervision. With only 152 training QA pairs, Memory-R1 outperforms strong baselines and generalizes across three benchmarks (LoCoMo, MSC, LongMemEval) and multiple model scales (3B–14B).

   @inproceedings{yan2025memoryr1,
     title = {{Memory-R1}: Enhancing Large Language Model Agents to Manage and Utilize Memories via Reinforcement Learning},
     author = {Yan, Sikuan and Yang, Xiufeng and Huang, Zuchao and Nie, Ercong and Ding, Zifeng and Li, Zonggen and Ma, Xiaowen and Bi, Jinhe and Kersting, Kristian and Pan, Jeff Z. and Schuetze, Hinrich and Tresp, Volker and Ma, Yunpu},
     booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics},
     pages = {12805--12825},
     year = {2026},
     month = jul,
   }

7. ACL 2026

   

   Mem²Evolve: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation

   Zihao Cheng, Zeming Liu, Yingyu Shan, Xinyi Wang, Xiangrong Zhu, Yunpu Ma, Hongru Wang, Yuhang Guo, Wei Lin, and Yunhong Wang

   In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics

   July 2026

   Abs Bib PDF

   While large language model-powered agents can self-evolve by accumulating experience or by dynamically creating new assets, existing frameworks treat these two evolutionary processes in isolation. We introduce a novel paradigm of co-evolutionary Capability Expansion and Experience Distillation. We propose Mem²Evolve, which integrates Experience Memory and Asset Memory, leveraging accumulated experience to guide the dynamic creation of assets while acquiring new experience to achieve co-evolution. Extensive experiments across 6 task categories and 8 benchmarks demonstrate that Mem²Evolve achieves improvement of 18.53% over standard LLMs, 11.80% over agents evolving solely through experience, and 6.46% over those evolving solely through asset creation.

   @inproceedings{cheng2026mem2evolve,
     title = {{Mem²Evolve}: Towards Self-Evolving Agents via Co-Evolutionary Capability Expansion and Experience Distillation},
     author = {Cheng, Zihao and Liu, Zeming and Shan, Yingyu and Wang, Xinyi and Zhu, Xiangrong and Ma, Yunpu and Wang, Hongru and Guo, Yuhang and Lin, Wei and Wang, Yunhong},
     booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics},
     pages = {20784--20831},
     year = {2026},
     month = jul,
   }

8. CVPR 2026

   

   Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Models

   Jialiang Zhang, Junlong Tong, Junyan Lin, Hao Wu, Yirong Sun, Yunpu Ma, and Xiaoyu Shen

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition

   June 2026

   Abs Bib PDF

   Large Vision Language Models (LVLMs) exhibit strong Chain-of-Thought (CoT) capabilities, yet most existing paradigms assume full-video availability before inference, misaligned with real-world video streams where information arrives sequentially. We propose Think-as-You-See (TaYS), a unified framework enabling true concurrent reasoning through parallelized CoT generation, stream-constrained training, and stream-parallel inference. TaYS employs temporally aligned reasoning units, streaming attention masks and positional encodings, and a dual KV-cache that decouples visual encoding from textual reasoning. Evaluated on the Qwen2.5-VL family, TaYS consistently outperforms both batch and interleaved baselines, improving reasoning performance while substantially reducing time-to-first-token and overall reasoning delay.

   @inproceedings{zhang2026thinkasyousee,
     title = {Think-as-You-See: Streaming Chain-of-Thought Reasoning for Large Vision-Language Models},
     author = {Zhang, Jialiang and Tong, Junlong and Lin, Junyan and Wu, Hao and Sun, Yirong and Ma, Yunpu and Shen, Xiaoyu},
     booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
     pages = {11998--12008},
     year = {2026},
     month = jun,
   }

9. 

   Memory-R2: Fair Credit Assignment for Long-Horizon Memory-Augmented LLM Agents

   Sikuan Yan, Ahmed Bahloul, Ercong Nie, Susanna Schwarzmann, Riccardo Trivisonno, Volker Tresp, and Yunpu Ma

   arXiv preprint arXiv:2605.21768

   May 2026

   Abs Bib PDF

   Memory-augmented LLM agents enable interactions that extend beyond finite context windows. Training such agents with reinforcement learning in multi-session environments is challenging because memory turns past actions into part of the future environment, making trajectory-level comparisons fundamentally unfair. We introduce Memory-R2 featuring LoGo-GRPO that combines local and global group-relative optimization. The global objective preserves end-to-end learning from long-horizon trajectory-level rewards, while local rerollouts compare different memory-operation outcomes from the same intermediate memory state, yielding fairer group comparisons and more precise supervision for memory construction. Memory-R2 jointly optimizes memory formation and evolution with a shared-parameter co-learning design and a progressive curriculum increasing training horizons from 8 to 32 sessions.

   @misc{yan2026memoryr2,
     title = {{Memory-R2}: Fair Credit Assignment for Long-Horizon Memory-Augmented {LLM} Agents},
     author = {Yan, Sikuan and Bahloul, Ahmed and Nie, Ercong and Schwarzmann, Susanna and Trivisonno, Riccardo and Tresp, Volker and Ma, Yunpu},
     note = {arXiv preprint arXiv:2605.21768},
     year = {2026},
     month = may,
   }

10. 

    PyraVid: Hierarchical Multimodal Memory for Long-Horizon Video Reasoning

    Sikuan Yan, Sicheng Dong, Haotong Wang, Ercong Nie, Yilun Liu, Jinhe Bi, Yingjie Xu, Susanna Schwarzmann, Riccardo Trivisonno, Volker Tresp, and Yunpu Ma

    arXiv preprint arXiv:2605.17065

    May 2026

    Abs Bib PDF

    Memory has become an increasingly important component of agentic systems, as these systems are expected to reason over long-term experience. Multimodal memory introduces challenges including heterogeneous input integration, person-centric information alignment, and evidence aggregation across different granularities. We present PyraVid, a hierarchical multimodal memory framework inspired by Event Segmentation Theory from cognitive science. PyraVid organizes long videos into a coarse-to-fine pyramid structure, enabling structured memory access and effective evidence aggregation. It supports structure-guided memory expansion with pruning, allowing retrieval of related events with strong causal connectivity but low semantic similarity. Experiments on multiple long-video understanding benchmarks show that PyraVid consistently improves performance across datasets, model scales, and question types.

    @misc{yan2026pyravid,
      title = {{PyraVid}: Hierarchical Multimodal Memory for Long-Horizon Video Reasoning},
      author = {Yan, Sikuan and Dong, Sicheng and Wang, Haotong and Nie, Ercong and Liu, Yilun and Bi, Jinhe and Xu, Yingjie and Schwarzmann, Susanna and Trivisonno, Riccardo and Tresp, Volker and Ma, Yunpu},
      note = {arXiv preprint arXiv:2605.17065},
      year = {2026},
      month = may,
    }

11. 

    OpenClaw Research: A Systematic Survey of Large Language Model Agents in Open Deployment

    Shuo Lu, Kecheng Yu, Siru Jiang, Yinuo Xu, Bing Zhan, Yanbo Wang, Changxin Ke, Yuan Xu, Xin Xiong, Xinyun Zhou, and others

    May 2026

    Abs Bib PDF

    Autonomous agents powered by large language models are moving from curated demos to persistent, open-world deployment. The rapid rise of OpenClaw, an open-source project that became one of the most starred in GitHub history, makes this transition concrete: agents can now run continuously, operate across heterogeneous platforms, and use community-contributed skills outside fully curated environments. This shift breaks the sandbox assumptions that have dominated prior agent research, including developer-controlled model updates, trusted tools, constrained environments, and short-lived execution. We present the first systematic survey of OpenClaw Research, defined as the study of agent systems after they enter open deployment. We formalize this setting through an agent-system tuple A = ⟨π, env, pop, substrate⟩ and derive four principles of openness: Open Policy, Open Environment, Open Population, and Open Substrate. These principles structure the taxonomy around five research areas: Learning & Evolving, Safety & Security, Claw Society, Infrastructure & Systems, and Applications. Across these areas, we review representative work, identify emerging risks such as malicious skill supply chains and autonomy–accountability gaps, and highlight open challenges that arise in open, continuously deployed agent systems. This survey provides a roadmap for understanding and governing LLM agents as they move beyond laboratory settings into large-scale open deployment, ultimately laying the groundwork for a trustworthy and sustainable agent ecosystem. To support ongoing research in this field, we maintain an online curated paper list.

    @misc{lu2026openclaw,
      title = {{OpenClaw Research}: A Systematic Survey of Large Language Model Agents in Open Deployment},
      author = {Lu, Shuo and Yu, Kecheng and Jiang, Siru and Xu, Yinuo and Zhan, Bing and Wang, Yanbo and Ke, Changxin and Xu, Yuan and Xiong, Xin and Zhou, Xinyun and others},
      year = {2026},
      month = may,
    }

12. ICLR 2026

    

    StreamingThinker: Large Language Models Can Think While Reading

    Junlong Tong, Yingqi Fan, Anhao Zhao, Yunpu Ma, and Xiaoyu Shen

    In International Conference on Learning Representations

    April 2026

    Abs Bib PDF

    Large language models (LLMs) have demonstrated remarkable capabilities in chain-of-thought reasoning. However, the current LLM reasoning paradigm initiates thinking only after the entire input is available, introducing unnecessary latency in dynamic scenarios. Inspired by human cognition of thinking while reading, we design a streaming thinking paradigm for LLMs, where reasoning unfolds in the order of input. We instantiate this paradigm with StreamingThinker, a framework that enables LLMs to think while reading through the integration of streaming CoT generation, streaming-constraint training, and streaming parallel inference. StreamingThinker yields an 80% reduction in token waiting before the onset of reasoning and more than 60% reduction in time-level latency for producing the final answer.

    @inproceedings{tong2025streamingthinker,
      title = {{StreamingThinker}: Large Language Models Can Think While Reading},
      author = {Tong, Junlong and Fan, Yingqi and Zhao, Anhao and Ma, Yunpu and Shen, Xiaoyu},
      booktitle = {International Conference on Learning Representations},
      year = {2026},
      month = apr,
    }

13. 

    Routing-Free Mixture-of-Experts

    Yilun Liu, Jinru Han, Sikuan Yan, Volker Tresp, and Yunpu Ma

    arXiv preprint arXiv:2604.00801

    April 2026

    Abs Bib PDF

    Standard Mixture-of-Experts (MoE) models rely on centralized routing mechanisms that introduce rigid inductive biases. We propose Routing-Free MoE, which eliminates any hard-coded centralized designs including external routers, Softmax, Top-K and load balancing, instead encapsulating all activation functionalities within individual experts and directly optimizing through continuous gradient flow. We introduce a unified adaptive load-balancing framework to simultaneously optimize both expert-balancing and token-balancing objectives through a configurable interpolation. Extensive experiments show that Routing-Free MoE consistently outperforms baselines with better scalability and robustness.

    @misc{liu2026routingfree,
      title = {Routing-Free Mixture-of-Experts},
      author = {Liu, Yilun and Han, Jinru and Yan, Sikuan and Tresp, Volker and Ma, Yunpu},
      note = {arXiv preprint arXiv:2604.00801},
      year = {2026},
      month = apr,
    }

14. EACL Findings 2026

    

    Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules

    Yilun Liu, Yunpu Ma, Yuetian Lu, Shuo Chen, Zifeng Ding, and Volker Tresp

    In Findings of the Association for Computational Linguistics: EACL 2026

    March 2026

    Abs Bib PDF

    Mixture-of-Experts (MoE) benefits from a dynamic routing mechanism among specialized experts, which existing Parameter-Efficient Fine-Tuning (PEFT) strategies often fail to leverage. We investigate whether adaptation modules themselves should incorporate routing mechanisms to align with MoE’s multi-expert architecture. We analyze dynamics of core components when applying PEFT to MoE language models and examine how different routing strategies affect adaptation effectiveness. Extensive experiments adapting OLMoE-1B-7B and Mixtral-8x7B on various commonsense and math reasoning tasks validate the performance and efficiency of our routed approach, with practical insights to facilitate better PEFT and MoE applications.

    @inproceedings{liu2026perft,
      title = {Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules},
      author = {Liu, Yilun and Ma, Yunpu and Lu, Yuetian and Chen, Shuo and Ding, Zifeng and Tresp, Volker},
      booktitle = {Findings of the Association for Computational Linguistics: EACL 2026},
      pages = {4439--4457},
      year = {2026},
      month = mar,
    }

15. AAAI 2026

    

    OpenDriveVLA: Towards End-to-End Autonomous Driving with Large Vision Language Action Model

    Xingcheng Zhou, Xingshuo Han, Fan Yang, Yunpu Ma, Volker Tresp, and Alois Knoll

    In Proceedings of the AAAI Conference on Artificial Intelligence

    March 2026

    Abs Bib PDF

    We present OpenDriveVLA, a Vision-Language Action (VLA) model designed for end-to-end autonomous driving, built upon open-source large language models. OpenDriveVLA generates spatially-grounded driving actions by leveraging multimodal inputs including 2D and 3D instance-aware visual representations, ego vehicle states, and language commands. We introduce a hierarchical vision-language alignment process projecting both 2D and 3D structured visual tokens into a unified semantic space. We incorporate structured agent-environment-ego interaction modeling into the autoregressive decoding process, enabling the model to capture fine-grained spatial dependencies critical for reliable trajectory planning. Extensive experiments on nuScenes demonstrate that OpenDriveVLA achieves state-of-the-art results across open-loop trajectory planning and driving-related question-answering tasks.

    @inproceedings{zhou2026opendrivevla,
      title = {{OpenDriveVLA}: Towards End-to-End Autonomous Driving with Large Vision Language Action Model},
      author = {Zhou, Xingcheng and Han, Xingshuo and Yang, Fan and Ma, Yunpu and Tresp, Volker and Knoll, Alois},
      booktitle = {Proceedings of the AAAI Conference on Artificial Intelligence},
      volume = {40},
      number = {16},
      pages = {13782--13790},
      year = {2026},
      month = mar,
    }

16. AAAI 2026

    

    ASCD: Attention-Steerable Contrastive Decoding for Reducing Hallucination in MLLM

    Yifan Wang, Aniri, Jinhe Bi, Soeren Pirk, and Yunpu Ma

    In Proceedings of the AAAI Conference on Artificial Intelligence

    March 2026

    Abs Bib PDF

    Multimodal large language models (MLLMs) frequently hallucinate by over-committing to spurious visual cues. We empirically show that improvements from contrastive decoding methods systematically coincide with redistributions of cross-modal attention. Building on this insight, we propose Attention-Steerable Contrastive Decoding (ASCD), which directly steers attention scores during decoding by combining positive steering (amplifying text-centric heads) with negative steering (dampening critical visual tokens). The method incurs negligible runtime and memory overhead without additional training. Across five MLLM backbones, ASCD reduces hallucination on POPE, CHAIR, and MMHal-Bench by up to 38.2% while improving accuracy on standard VQA benchmarks.

    @inproceedings{wang2026ascd,
      title = {{ASCD}: Attention-Steerable Contrastive Decoding for Reducing Hallucination in {MLLM}},
      author = {Wang, Yifan and Aniri and Bi, Jinhe and Pirk, Soeren and Ma, Yunpu},
      booktitle = {Proceedings of the AAAI Conference on Artificial Intelligence},
      year = {2026},
      month = mar,
    }

17. Quantum 2026

    

    Quantum Architecture Search with Unsupervised Representation Learning

    Yize Sun, Zixin Wu, Volker Tresp, and Yunpu Ma

    Quantum

    February 2026

    Abs Bib PDF

    Unsupervised representation learning presents new opportunities for advancing Quantum Architecture Search (QAS) on Noisy Intermediate-Scale Quantum (NISQ) devices. QAS is designed to optimize quantum circuits for Variational Quantum Algorithms (VQAs). Most QAS algorithms tightly couple the search space and search algorithm, requiring the evaluation of numerous quantum circuits with high computational costs. Predictor-based QAS algorithms mitigate this by estimating circuit performance from structure or embedding, but often demand time-intensive labeling. Inspired by the classical neural architecture search algorithm Arch2vec, we investigate the potential of unsupervised representation learning for QAS without relying on predictors. Our framework decouples unsupervised architecture representation learning from the search process and integrates an improved quantum circuit graph encoding scheme. During the search, we employ REINFORCE and Bayesian Optimization to explore the latent representation space. We further validate by executing the best-discovered MaxCut circuits on IBM quantum hardware, confirming that the architectures retain optimal performance under real hardware noise.

    @article{sun2026quantumarchitecture,
      title = {Quantum Architecture Search with Unsupervised Representation Learning},
      author = {Sun, Yize and Wu, Zixin and Tresp, Volker and Ma, Yunpu},
      journal = {Quantum},
      volume = {10},
      pages = {1994},
      year = {2026},
      month = feb,
    }

2025

1. EMNLP 2025

   

   METok: Multi-Stage Event-Based Token Compression for Efficient Long Video Understanding

   Mengyue Wang, Shuo Chen, Kristian Kersting, Volker Tresp, and Yunpu Ma

   In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing

   November 2025

   Abs Bib PDF

   Recent advances in Video Large Language Models (VLLMs) have enhanced their ability to understand video content, but processing long videos remains challenging due to high computational demands and visual redundancy. We propose METok, a training-free, Multi-stage Event-based Token compression framework designed to accelerate VLLMs’ inference while preserving accuracy. METok progressively eliminates redundant visual tokens across three stages: (1) event-aware compression during vision encoding, (2) hierarchical token pruning based on semantic alignment and event importance, and (3) a decoding-stage KV Cache optimization. Equipping LongVA-7B with METok realizes an 80.6% FLOPs reduction and 93.5% KV Cache memory savings while maintaining comparable or superior accuracy.

   @inproceedings{wang2025metok,
     title = {{METok}: Multi-Stage Event-Based Token Compression for Efficient Long Video Understanding},
     author = {Wang, Mengyue and Chen, Shuo and Kersting, Kristian and Tresp, Volker and Ma, Yunpu},
     booktitle = {Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing},
     pages = {18870--18884},
     year = {2025},
     month = nov,
   }

2. EMNLP 2025

   

   SwarmAgentic: Towards Fully Automated Agentic System Generation via Swarm Intelligence

   Yao Zhang, Chenyang Lin, Shijie Tang, Haokun Chen, Shijie Zhou, Yunpu Ma, and Volker Tresp

   In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing

   November 2025

   Abs Bib PDF

   Existing agentic system generation frameworks lack full autonomy, missing from-scratch agent generation, self-optimizing agent functionality, and collaboration. We propose SwarmAgentic, the first framework that fully automates agentic system generation, optimization, and collaboration, constructing agents from scratch and jointly refining functionality and coordination via language-driven exploration. To enable efficient search over system-level structures, SwarmAgentic maintains a population of candidate systems and evolves them via feedback-guided updates, drawing inspiration from Particle Swarm Optimization. Given only a task description and an objective function, SwarmAgentic outperforms all baselines, achieving a +261.8% relative improvement over ADAS on the TravelPlanner benchmark.

   @inproceedings{zhang2025swarmagentic,
     title = {{SwarmAgentic}: Towards Fully Automated Agentic System Generation via Swarm Intelligence},
     author = {Zhang, Yao and Lin, Chenyang and Tang, Shijie and Chen, Haokun and Zhou, Shijie and Ma, Yunpu and Tresp, Volker},
     booktitle = {Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing},
     pages = {1778--1818},
     year = {2025},
     month = nov,
   }

3. ACL 2025

   

   LLaVA Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering

   Jinhe Bi, Yujun Wang, Haokun Chen, Xun Xiao, Artur Hecker, Volker Tresp, and Yunpu Ma

   In Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics

   July 2025

   Abs Bib PDF

   Multimodal Large Language Models (MLLMs) have significantly advanced visual tasks by integrating visual representations into large language models. Our research reveals a persistent imbalance between text and visual modalities, with text often dominating output generation during visual instruction tuning. We introduce Modality Linear Representation-Steering (MoReS), which re-balances the intrinsic modalities by steering visual representations through linear transformations in the visual subspace across each model layer. The composed LLaVA Steering models require, on average, 500 times fewer trainable parameters than LoRA needs while achieving comparable performance across three visual benchmarks and eight visual question-answering tasks.

   @inproceedings{bi2025llava,
     title = {{LLaVA} Steering: Visual Instruction Tuning with 500x Fewer Parameters through Modality Linear Representation-Steering},
     author = {Bi, Jinhe and Wang, Yujun and Chen, Haokun and Xiao, Xun and Hecker, Artur and Tresp, Volker and Ma, Yunpu},
     booktitle = {Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics},
     pages = {15230--15250},
     year = {2025},
     month = jul,
   }

4. TMLR 2025

   

   DyGMamba: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Models

   Zifeng Ding, Yifeng Li, Yuan He, Antonio Norelli, Jingcheng Wu, Volker Tresp, Yunpu Ma, and Michael Bronstein

   Transactions on Machine Learning Research

   May 2025

   Abs Bib PDF

   Learning useful representations for continuous-time dynamic graphs (CTDGs) is challenging, due to the concurrent need to span long node interaction histories and grasp nuanced temporal details. Two problems emerge: (1) Encoding longer histories requires more computational resources, making it crucial for CTDG models to maintain low computational complexity; (2) More powerful models are needed to identify and select the most critical temporal information within extended contexts. We propose DyGMamba, a CTDG representation learning model originating from the popular Mamba state space model (SSM). DyGMamba first leverages a node-level SSM to encode the sequence of historical node interactions. Another time-level SSM then exploits temporal patterns hidden in the historical graph, where its output is used to dynamically select critical information from the interaction history. DyGMamba achieves state-of-the-art in most cases while maintaining high efficiency, making it possible to capture long temporal dependencies with a limited computation budget.

   @article{ding2025dygmamba,
     title = {{DyGMamba}: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Models},
     author = {Ding, Zifeng and Li, Yifeng and He, Yuan and Norelli, Antonio and Wu, Jingcheng and Tresp, Volker and Ma, Yunpu and Bronstein, Michael},
     journal = {Transactions on Machine Learning Research},
     year = {2025},
     month = may,
   }

5. AAAI 2025

   

   WebPilot: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration

   Yao Zhang, Zijian Ma, Yunpu Ma, Zhen Han, Yu Wu, and Volker Tresp

   In Proceedings of the AAAI Conference on Artificial Intelligence

   April 2025

   Abs Bib PDF

   LLM-based autonomous agents often fail to execute complex web tasks that require dynamic interaction, largely due to the inherent uncertainty and complexity of these environments. We develop WebPilot, a multi-agent system with a dual optimization strategy that improves MCTS to better handle complex web environments. The Global Optimization phase generates a high-level plan by breaking down tasks into manageable subtasks, continuously refined through reflective analysis. The Local Optimization phase executes each subtask using a tailored MCTS that iteratively refines decisions based on new observations. Experimental results on WebArena and MiniWoB++ demonstrate the effectiveness of WebPilot, achieving SOTA performance with GPT-4 and a 93% relative increase in success rate over the concurrent tree search-based method.

   @inproceedings{zhang2025webpilot,
     title = {{WebPilot}: A Versatile and Autonomous Multi-Agent System for Web Task Execution with Strategic Exploration},
     author = {Zhang, Yao and Ma, Zijian and Ma, Yunpu and Han, Zhen and Wu, Yu and Tresp, Volker},
     booktitle = {Proceedings of the AAAI Conference on Artificial Intelligence},
     year = {2025},
     month = apr,
   }

6. 

   PRISM: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selection

   Jinhe Bi, Yifan Wang, Danqi Yan, Aniri, Wenke Huang, Zeyu Jin, Xiaowen Ma, Artur Hecker, Mang Ye, Xun Xiao, Hinrich Schuetze, Volker Tresp, and Yunpu Ma

   arXiv preprint arXiv:2502.12119

   February 2025

   Abs Bib PDF

   Visual instruction tuning adapts pre-trained Multimodal Large Language Models (MLLMs) to follow human instructions, but the rapid growth of training datasets introduces significant redundancy. We identify a critical factor: the anisotropy inherent in visual feature distributions induces a Global Semantic Drift that limits data selection efficiency. Motivated by this insight, we devise PRISM, the first training-free framework for efficient visual instruction selection. PRISM removes the corrupting influence of global background features by modeling intrinsic visual semantics via implicit re-centering. PRISM reduces the end-to-end time for data selection and model tuning to just 30% of conventional pipelines while achieving a 101.7% relative improvement over the baseline.

   @misc{bi2025prism,
     title = {{PRISM}: Self-Pruning Intrinsic Selection Method for Training-Free Multimodal Data Selection},
     author = {Bi, Jinhe and Wang, Yifan and Yan, Danqi and Aniri and Huang, Wenke and Jin, Zeyu and Ma, Xiaowen and Hecker, Artur and Ye, Mang and Xiao, Xun and Schuetze, Hinrich and Tresp, Volker and Ma, Yunpu},
     note = {arXiv preprint arXiv:2502.12119},
     year = {2025},
     month = feb,
   }

2024

1. EMNLP Findings 2024

   

   VideoINSTA: Zero-Shot Long Video Understanding via Informative Spatial-Temporal Reasoning with LLMs

   Ruotong Liao, Max Erler, Huiyu Wang, Guangyao Zhai, Gengyuan Zhang, Yunpu Ma, and Volker Tresp

   In Findings of the Association for Computational Linguistics: EMNLP 2024

   November 2024

   Abs Bib PDF

   In the video-language domain, recent works in leveraging zero-shot Large Language Model-based reasoning for video understanding have become competitive challengers to previous end-to-end models. Long video understanding presents unique challenges due to the complexity of reasoning over extended timespans. We propose VideoINSTA, i.e., INformative Spatial-TemporAl Reasoning for zero-shot long-form video understanding. VideoINSTA contributes (1) a zero-shot framework for long video understanding using LLMs; (2) an event-based temporal reasoning and content-based spatial reasoning approach for LLMs to reason over spatial-temporal information in videos; (3) a self-reflective information reasoning scheme based on information sufficiency and prediction confidence. Our model significantly improves the state-of-the-art on three long video question-answering benchmarks: EgoSchema, NextQA, and IntentQA.

   @inproceedings{liao2024videoinsta,
     title = {{VideoINSTA}: Zero-Shot Long Video Understanding via Informative Spatial-Temporal Reasoning with {LLM}s},
     author = {Liao, Ruotong and Erler, Max and Wang, Huiyu and Zhai, Guangyao and Zhang, Gengyuan and Ma, Yunpu and Tresp, Volker},
     booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2024},
     pages = {6577--6602},
     year = {2024},
     month = nov,
   }

2. NAACL Findings 2024

   

   GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Models

   Ruotong Liao, Xu Jia, Yangzhe Li, Yunpu Ma, and Volker Tresp

   In Findings of the Association for Computational Linguistics: NAACL 2024

   June 2024

   Abs Bib PDF

   The rapid advancements in large language models (LLMs) have ignited interest in the temporal knowledge graph (tKG) domain, where conventional embedding-based and rule-based methods dominate. The question remains open of whether pre-trained LLMs can understand structured temporal relational data and replace them as the foundation model for temporal relational forecasting. We bring temporal knowledge forecasting into the generative setting with GenTKG, a novel retrieval-augmented generation framework combining a temporal logical rule-based retrieval strategy and few-shot parameter-efficient instruction tuning. Extensive experiments show that GenTKG outperforms conventional methods using as few as 16 training samples, and highlights remarkable cross-domain generalizability on unseen datasets without re-training.

   @inproceedings{liao2024gentkg,
     title = {{GenTKG}: Generative Forecasting on Temporal Knowledge Graph with Large Language Models},
     author = {Liao, Ruotong and Jia, Xu and Li, Yangzhe and Ma, Yunpu and Tresp, Volker},
     booktitle = {Findings of the Association for Computational Linguistics: NAACL 2024},
     pages = {4303--4317},
     year = {2024},
     month = jun,
   }

2023

1. GECCO 2023

   

   QNEAT: Natural Evolution of Variational Quantum Circuit Architecture

   Alessandro Giovagnoli, Volker Tresp, Yunpu Ma, and Matthias Schubert

   In Proceedings of the Companion Conference on Genetic and Evolutionary Computation

   July 2023

   Abs Bib PDF

   Quantum Machine Learning (QML) is a recent and rapidly evolving field where the theoretical framework and logic of quantum mechanics are employed to solve machine learning tasks. Various techniques with different levels of quantum-classical hybridization have been proposed. Here we focus on variational quantum circuits (VQC), which emerged as the most promising candidates for the quantum counterpart of neural networks in the noisy intermediate-scale quantum (NISQ) era. Although showing promising results, VQCs can be hard to train because of different issues, e.g., barren plateau, periodicity of the weights, or choice of architecture. This paper focuses on this last problem for finding optimal architectures of variational quantum circuits for various tasks. To address it, we propose a gradient-free algorithm inspired by natural evolution to optimize both the weights and the architecture of the VQC. In particular, we present a version of the well-known neuroevolution of augmenting topologies (NEAT) algorithm and adapt it to the case of variational quantum circuits. We refer to the proposed architecture search algorithm for VQC as QNEAT.

   @inproceedings{giovagnoli2023qneat,
     title = {{QNEAT}: Natural Evolution of Variational Quantum Circuit Architecture},
     author = {Giovagnoli, Alessandro and Tresp, Volker and Ma, Yunpu and Schubert, Matthias},
     booktitle = {Proceedings of the Companion Conference on Genetic and Evolutionary Computation},
     pages = {647--650},
     year = {2023},
     month = jul,
   }