Aligning Progress and Feasibility: A Neuro-Symbolic Dual
Large language models (LLMs) have demonstrated strong potential in long- horizon decision-making tasks, such as embodied manipulation and web interaction. However, agents frequently struggle with endless trial-and- error loops or deviate from the main objective in complex...
ESL-Bench: An Event-Driven Synthetic Longitudinal Benchmark for
Longitudinal health agents must reason across multi-source trajectories that combine con- tinuous device streams, sparse clinical exams, and episodic life events—yet evaluating them is hard: real-world data cannot be released at scale, and temporally grounded attribution...
GrandCode: Achieving Grandmaster Level in Competitive
Competitive programming remains one of the last few human strongholds in coding against AI. The best AI system to date still underperforms the best humans competitive program- ming: the most recent best result, Google’s Gemini 3 Deep Think, attained 8th place even not being...
Holos: A Web-Scale LLM-Based Multi-Agent
As large language models (LLM)-driven agents transition from isolated task solvers to persistent digital entities, the emergence of the Agentic Web, an ecosystem where heterogeneous agents autonomously interact and co-evolve, marks a pivotal shift toward Artificial General...
AIVV: Neuro-Symbolic LLM Agent-Integrated Verification
Deep learning models excel at detecting anomaly patterns in normal data. However, they do not provide a direct solution for anomaly classifica- tion and scalability across diverse control systems, frequently failing to distinguish genuine faults from nuisance faults caused by...
IMPROVING ROLE CONSISTENCY IN MULTI-AGENT
In large language model (LLM)-driven multi-agent systems, disobey role specification (failure to adhere to the defined responsibilities and constraints of an assigned role, potentially leading to an agent behaving like another) is a major failure mode Cemri et al. [2025]. To...
AutoVerifier: An Agentic Automated Verification Framework Using
Xpertbench: Expert Level Tasks with Rubrics-Based
As Large Language Models (LLMs) exhibit plateauing performance on conventional benchmarks, a pivotal challenge persists: evaluating their proficiency in complex, open-ended tasks characterizing genuine expert-level cognition. Existing frameworks suffer from narrow domain...
”I must delete the evidence”:
As ongoing research explores the ability of AI agents to be insider threats and act against com- pany interests, we showcase the abilities of such agents to act against human well being in service of corporate authority. Building on Agentic Mis- alignment and AI scheming...
Let’s Have a Conversation: Designing and Evaluating
Compositional Neuro-Symbolic Reasoning
We study structured abstraction-based reasoning for the Abstraction and Reasoning Corpus (ARC) and compare its generalization to test-time approaches. Purely neural architectures lack reliable combinatorial generalization, while strictly symbolic systems struggle with per-...