Autoregressive Multimodal Anomaly Detection with Large Language Models for Microservice Systems
LLMMAD is an unsupervised autoregressive multimodal anomaly detection framework for microservice systems. It interleaves metrics/logs/traces into a unified sequence for LoRA-adapted, frozen LLM inference, then applies modality-wise reconstruction heads. It uses a prediction-driven autoregressive objective to predict future states (not copy inputs) to avoid the “identity shortcut,” and aggregates modality decisions with OR-logic.
