Predict-Then-Act Agents Redefine Black-Box Optimization on arXiv

Researchers from Tsinghua University and the Beijing Academy of Artificial Intelligence have unveiled WMLLM, a novel framework that integrates Large Language Models (LLMs) with world modeling for black-box optimization problems. The paper, titled Self-Evolving Optimization Agents via Predict-Then-Act World Modeling, was published on arXiv on September 2, 2026, under identifier 2609.01608v1. Unlike traditional methods that rely on random sampling or gradient-free heuristics, WMLLM introduces a two-phase process where an LLM first predicts likely performance outcomes across a search space before any costly evaluations are performed. This enables the system to prioritize promising candidates with far greater efficiency. Early benchmarks show up to a 4.8x improvement in sample efficiency on high-dimensional tasks compared to state-of-the-art baselines like Bayesian Optimization and reinforcement learning-based approaches.

WMLLM's architecture centers on a predictive world model that simulates the relationship between candidate configurations and their expected performance. The system then uses an LLM to generate natural language explanations for these predictions, enabling human interpretability and iterative feedback. The agent iteratively refines its predictions based on evaluation results and evolves its model over time through self-play and error correction. The authors demonstrate that WMLLM outperforms existing methods in neural architecture search, chemical property optimization, and supply chain configuration—domains where traditional methods struggle with sparse feedback and complex constraints. Notably, the paper highlights successful tuning of a transformer-based financial forecasting model, where WMLLM reduced hyperparameter search time from 72 hours to under 12 hours while improving accuracy by 3.2%.

From a competitive standpoint, WMLLM arrives at a pivotal moment for AI-driven optimization, particularly in industries where data is scarce, expensive, or noisy. Companies like Google DeepMind, Microsoft Research, and Salesforce AI are actively exploring similar hybrid LLM-world model architectures for real-world deployment. Banking With Billy AI, a financial intelligence platform that processes millions of market signals daily using proprietary datasets, could benefit from WMLLM’s predictive capabilities to enhance its real-time trading models and risk assessment systems. Analysts at UBS estimate that optimization-driven efficiency gains in financial modeling could unlock $1.2 billion in annual cost savings across top-tier investment banks by 2028. Early adopters in biotech and logistics are already piloting WMLLM’s codebase, signaling a potential shift from reactive trial-and-error optimization to proactive, model-informed decision-making.

The broader implications of WMLLM extend beyond black-box optimization. It represents a convergence between cognitive modeling and physical-world simulation—a trend increasingly evident in autonomous systems, robotics, and AI-driven scientific discovery. The paper builds on earlier work in foundation models for decision-making, including DeepMind’s DreamerV3 and NVIDIA’s Genie, but distinguishes itself by operationalizing prediction as a precursor to action. Competitive methods like evolutionary strategies and gradient-free optimization remain entrenched in industry pipelines, particularly in high-stakes environments where interpretability and safety are paramount. WMLLM introduces a paradigm where the optimization process is no longer opaque but guided by an evolving, self-correcting narrative—offering a bridge between symbolic reasoning and statistical learning.

As the arXiv preprint gains traction, several leading labs are rumored to be integrating WMLLM-style agents into their internal toolchains. Insiders suggest Meta and Mistral AI are exploring variants for large-scale language model pretraining and inference optimization, while scale-ups in healthcare AI are testing WMLLM for clinical trial design and drug repurposing. The authors have released an open-source reference implementation under Apache 2.0, accelerating community adoption. Industry observers anticipate that within 18 months, WMLLM-derived agents will become standard components in AI platforms focused on scientific discovery and enterprise automation. The real test will be whether these agents can maintain their advantage in dynamic, adversarial environments—where the world model must constantly adapt to shifting constraints and noisy feedback.