← Back to arXiv Computer Vision

arXiv Computer Vision briefings

ResearchOfficialarXiv Computer Vision

GlobalForge: Robust AI-Generated Image Detection via Global Structure

Researchers introduce GlobalForge, a framework for detecting AI-generated images that focuses on robust global structural cues rather than fragile local artifacts. The method combines a Local Information Bottleneck and Global Structural Reasoning module, trained with a contrastive structural loss to enhance resilience against real-world degradations such as JPEG compression and blur. GlobalForge achieves a 5.89% accuracy improvement over previous state-of-the-art methods across eight in-the-wild benchmarks. The team also presents RealDeg-Bench, a new benchmark suite for evaluating robustness under seven degradation types and compound chains.

Why it matters: This work offers a more robust approach to detecting AI-generated images, addressing a key vulnerability of current detectors to real-world image degradations and potentially improving the reliability of deepfake and synthetic image identification.

ResearchOfficialarXiv Computer Vision

DCVC-MB: Neural B-Frame Video Compression using State Space Models

Researchers have introduced DCVC-Mamba (DCVC-MB), a neural video codec framework designed for B-frame coding. The approach leverages an IBP frame strategy, a spatio-temporal fusion model based on state-space models for bidirectional temporal prediction, and an entropy-aware skipping mechanism to improve compression efficiency. Experimental results show that DCVC-MB achieves BD-rate reductions of up to 8.98% compared to previous neural video codecs, and outperforms traditional codecs VTM-19.0-LDP and VTM-19.0-RA by up to 30.45% and 1.81%, respectively.

Why it matters: This work demonstrates a notable advance in neural video compression by introducing state-space models for bidirectional prediction, resulting in significant compression improvements over both neural and traditional codecs.

ResearchOfficialarXiv Computer Vision

GeoDetect: Geometric Adversarial Detection for Vision-Language Pre-trained Models

Researchers have introduced GeoDetect, a method that utilizes the geometric properties of embedding spaces in vision-language pre-trained models (VLPs) to detect adversarial examples. By analyzing the anisotropic structure of VLP embeddings, they found that adversarial examples tend to have greater distances to random points compared to clean examples. GeoDetect leverages this property to reliably identify adversarial attacks across various VLP architectures and threat scenarios, including both unimodal and multimodal attacks.

Why it matters: This work offers a robust and practical approach to detecting adversarial attacks in vision-language models, enhancing their safety and reliability.

ResearchOfficialarXiv Computer Vision

MonteRET: AI Agent Enhances Chest CT Report Generation with Multi-granularity Knowledge Retrieval

Researchers have introduced MonteRET, a region-aware retrieval-enhanced framework for automated chest CT report generation. The system combines global and region-level CT features, retrieves clinically relevant knowledge based on predicted conditions and anatomical regions, and uses an AI agent to refine initial reports. MonteRET demonstrated improved report quality, semantic similarity, and clinical efficacy compared to baselines and state-of-the-art methods on both public and external datasets, with human expert evaluations favoring its outputs.

Why it matters: This work shows that integrating multi-granularity knowledge retrieval and vision-language alignment can significantly enhance the clinical accuracy and completeness of automated radiology report generation.

ResearchOfficialarXiv Computer Vision

VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation

Researchers introduce VTM-Nav, a training-free navigation framework that leverages a persistent hierarchical Visual-Topological Memory (VTM) to enable embodied agents to reuse experience across multiple episodes in the same environment. The VTM organizes scene knowledge at both room and object levels and retrieves relevant experience through a coarse-to-fine matching process. Evaluations on HM3D and MP3D benchmarks show that VTM-Nav outperforms a strengthened WMNav baseline, demonstrating improved performance and robustness in cross-episode object-goal navigation.

Why it matters: This work advances open-vocabulary navigation by enabling agents to effectively reuse experience without retraining, supporting more persistent and adaptable behavior in real-world environments.

ResearchOfficialarXiv Computer Vision

TAMF-VTON: Mask-Free Virtual Try-On with Texture Preservation

TAMF-VTON is a new diffusion-based virtual try-on framework that eliminates the need for segmentation masks at inference, supports multi-garment composition, and preserves fine-grained textures. The method achieves inference in under 15 seconds per image on consumer hardware with INT4 quantization and outperforms state-of-the-art methods in both quantitative metrics and perceptual quality. TAMF-VTON introduces a unified generative pipeline with a Mixture-of-Experts adaptation scheme, frequency-domain supervision for texture fidelity, and a robust data curation process.

Why it matters: This work addresses key barriers to real-world e-commerce deployment of virtual try-on by removing mask requirements and enabling efficient, high-fidelity multi-garment transfer on consumer GPUs.

ResearchOfficialarXiv Computer Vision

MixCompress: Mixture of Experts for Variable Rate Learned Image Compression

MixCompress introduces a unified framework for learned image compression that leverages sparse Mixture-of-Experts (MoE) and Mixture-of-Depths (MoD) architectures to support multiple bit-rates within a single model. By dynamically scaling model capacity and reducing feature entanglement, MixCompress matches or exceeds the performance of individually optimized single-rate models, setting a new Pareto frontier for efficient image coding.

Why it matters: This approach could significantly reduce storage and deployment costs by eliminating the need for multiple separate compression models, while improving efficiency in image compression tasks.

ResearchOfficialarXiv Computer Vision

Frozen DINOv3 Features Enable Zero-Shot Facial Region Correspondence

Researchers demonstrate that frozen DINOv3 ViT-L/16 patch embeddings achieve 83.0% cross-identity region-level semantic accuracy on facial parts without any face-specific training. The study finds that the strongest correspondence emerges at an intermediate layer (block 18), and DINOv3 outperforms CLIP on anatomical facial regions by +16.8 percentage points.

Why it matters: This work shows that self-supervised vision models can serve as zero-shot facial coordinate systems, potentially enabling face analysis without the need for specialized training data.

ResearchOfficialarXiv Computer Vision

FilmGPT: Autoregressive Transformer for Video Montage

FilmGPT is an autoregressive transformer trained on a large corpus of movies to learn the statistical patterns, or 'grammar,' of film editing. Rather than generating new video frames, it selects the best next shot from raw footage using a footage-constrained decoding algorithm. FilmGPT outperforms previous methods in shot prediction benchmarks and user studies evaluating full film editing tasks.

Why it matters: This work demonstrates a novel AI approach that automates aspects of video montage by learning editing patterns directly from film data, advancing the automation of a complex creative process.

ResearchOfficialarXiv Computer Vision

SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning

Researchers present SD-MAR, a framework for training and evaluating vision-language models on multi-image analytical reasoning tasks, such as change detection and quantitative comparison. By leveraging synthetic data and a reinforcement learning method called GRPO-lite with Backward Discounted Allocation, they report up to 36.95% accuracy improvement on in-domain benchmarks. Notably, Qwen2.5-VL-7B outperforms GPT-4.1 on the SD-MAR benchmark, and out-of-domain generalization is maintained or improved on several standard benchmarks.

Why it matters: This work advances multimodal AI by enabling models to reason analytically across multiple images, a capability important for real-world tasks involving visual comparison and inference.

ResearchOfficialarXiv Computer Vision

VideoSEMA: Efficient Mamba-Like Attention Model for Video Understanding

Researchers introduce VideoSEMA, a split space-time attention model for video classification that uses a scalable Mamba-like attention block for spatial processing and softmax temporal attention. VideoSEMA outperforms heavier vision transformer and Mamba models on the K400 benchmark and achieves leading top-1 accuracy among models of similar size on SSv2. The model also maintains accuracy better than VideoMamba as image resolution increases, without requiring fine-tuning.

Why it matters: VideoSEMA demonstrates a more efficient and scalable approach to video understanding, achieving strong benchmark results with lower computational cost.

ResearchOfficialarXiv Computer Vision

FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models

FoMoVLA is a framework that augments Vision-Language-Action (VLA) models with explicit spatio-temporal supervision by jointly learning future feature foresight and sparse 2D point tracking. This approach enhances continuous action policy learning and achieves state-of-the-art performance on the LIBERO, RoboCasa, and LIBERO-Plus benchmarks, demonstrating strong zero-shot generalization.

Why it matters: By integrating visual foresight with motion guidance, FoMoVLA addresses a key limitation of reactive VLA models and enables more robust and generalizable robot manipulation policies.

ResearchOfficialarXiv Computer Vision

AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents

AdaTurn is a framework for active visual perception agents that enables them to adapt to varying rollout budgets by conditioning on the allowed number of turns and explicitly training for boundary behavior. Its Forced-Answer DAPO component turns over-budget events into trainable final-decision steps, allowing agents to synthesize answers even when further actions are not possible. The approach significantly improves low-budget accuracy and generalizes across different agent backbones and multimodal benchmarks.

Why it matters: AdaTurn addresses a key deployment challenge by enabling active visual agents to provide valid answers under varying and tight turn limits, improving their practical usability.

ResearchOfficialarXiv Computer Vision

Negative Prompt Optimization and Latent Classifier Guidance Enhance Stable Diffusion Image Generation

Researchers have developed a system that combines negative prompt optimization using a fine-tuned language model with latent-space classifier guidance to improve images generated by Stable Diffusion. The method automatically creates optimized negative prompts and uses a CNN-RNN hybrid classifier to identify and reverse low-quality latent updates during the diffusion process. Experiments indicate that this dual-guidance approach reduces artifacts and enhances semantic fidelity compared to standard diffusion methods.

Why it matters: This framework provides an automated way to improve image generation quality, reducing the need for manual prompt engineering.

ResearchOfficialarXiv Computer Vision

MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation

MagicPrompt is a lightweight framework designed to fine-tune large-scale video diffusion models with extreme parameter efficiency. By combining Attention-Embedded Prompt Tuning and Dual-Space Reward Feedback Optimization, it achieves competitive performance using less than 1% of trainable parameters, significantly lowering training costs. The approach also addresses instability issues in reward-based training for condition-guided tasks.

Why it matters: MagicPrompt enables efficient and stable adaptation of large video diffusion models to new tasks with minimal computational resources.

ResearchOfficialarXiv Computer Vision

GlanceFace: Inferring Apparent Personality from Faces Using Vision-Language Models

Researchers have introduced GlanceFace, an end-to-end framework that infers apparent personality traits from facial images using vision-language models. Unlike prior work that focuses on the Big Five personality model or relies on multimodal inputs, GlanceFace targets MBTI types and employs semantic-enhanced facial representations and uncertainty-aware learning to address subjective annotations. Experiments demonstrate strong performance on MBTI-based apparent personality benchmarks, suggesting that facial cues can meaningfully inform perceived personality traits.

Why it matters: This work advances the ability of embodied agents to infer personality from first impressions, potentially improving initial interaction strategies in social robotics.

ResearchOfficialarXiv Computer Vision

Rare Concept Generation via Counterfactual Inference in Diffusion Models

Researchers introduce CI-Diff, a diffusion model that applies counterfactual inference to improve the generation of images depicting rare concepts with unusual attributes. By reformulating classifier-free guidance, CI-Diff aims to reduce common knowledge bias and better capture atypical features in text-to-image synthesis. Experiments on the RareBench benchmark show that CI-Diff outperforms previous state-of-the-art diffusion models for rare concept generation.

Why it matters: This work demonstrates a novel application of causal inference to address a key limitation in diffusion models, enabling more accurate generation of rare or atypical concepts in text-to-image tasks.

ResearchOfficialarXiv Computer Vision

VIABench: A Video Benchmark for Evaluating MLLMs in Visually Impaired Assistance

Researchers have introduced VIABench, a video benchmark specifically designed to evaluate Multimodal Large Language Models (MLLMs) in the context of assisting visually impaired individuals. VIABench uses first-person videos from blind individuals and defines three core tasks: Proactive Reminder, Visual Question Answering, and Vision-Guided Interaction. Experimental results indicate that current MLLMs face significant challenges, particularly in proactive anticipation and real-time responsiveness.

Why it matters: VIABench highlights critical gaps in current MLLMs for real-world blind assistance, providing a new resource to drive research toward more effective navigation and interaction support for visually impaired individuals.

ResearchOfficialarXiv Computer Vision

SeeSE3: Emergence of 3D Space in Vision Features

A new preprint explores whether vision foundation models inherently encode properties of 3D Euclidean space. The authors introduce probes to assess topological and geometric alignment between model features and 3D transformations, finding that self-supervised models contain latent subspaces closely correlated with 3D space. Leveraging this, they demonstrate latent-space navigation techniques for visual odometry and localization without explicit 3D reconstruction.

Why it matters: This work suggests that self-supervised vision models can support visual odometry and localization tasks by leveraging implicit 3D structure in their latent spaces, potentially simplifying or improving such systems.

ResearchOfficialarXiv Computer Vision

MultiRef-Compass: Comprehensive Benchmark for Multi-Reference Audio-Video Generation

Researchers have introduced MultiRef-Compass, a benchmark designed to evaluate multi-reference-to-audio-video (MR2AV) generation systems. The benchmark consists of 350 curated samples that test capabilities such as multi-view subject preservation, multi-entity binding, and human-object-scene composition. It features 14 sub-metrics across four evaluation dimensions and integrates both automatic and model-based judging frameworks. Experiments on eight MR2AV systems demonstrate significant gaps in current model performance, highlighting the challenge of this task.

Why it matters: MultiRef-Compass addresses a critical gap in benchmarking models that must generate synchronized audio and video content from multiple references, supporting progress in advanced multimodal generation.