Models→Official→arXiv Computer Vision
OvisOCR2 is a 0.8B parameter end-to-end document parsing model that converts document page images into Markdown in natural reading order, handling text, formulas, tables, and visual regions. It achieves state-of-the-art scores of 96.58 on OmniDocBench v1.6 and 75.06 on PureDocBench, surpassing previous pipeline-based methods. The model's training involves a data engine combining real and synthetic data, reinforcement learning, and model fusion.
Why it matters: This result shows that compact end-to-end models can outperform complex pipeline methods in document parsing, potentially simplifying deployment and improving accuracy for document understanding tasks.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers have developed UniPhysGen, a model that automatically converts raw 3D assets into simulation-ready versions with unified physical semantics, including both articulation and intrinsic physical properties. The framework introduces a large-scale dataset (UniPhys-40K) and a benchmark (UniPhys-Bench), and demonstrates state-of-the-art performance on grounding tasks. The assets produced by UniPhysGen can be directly used in robotic simulation environments for realistic physical interaction.
Why it matters: This work addresses a major challenge in embodied AI and robotics by enabling scalable, automated creation of physically realistic 3D assets for simulation.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers introduce ThinkBLOX, a vision-language model (VLM)-based framework for generating 3D indoor scenes through iterative, step-by-step reasoning and action. The system leverages a new dataset with Chain-of-Thought rationales and employs a reinforcement learning scheme to improve the physical plausibility, semantic alignment, and editability of generated scenes. Experiments show ThinkBLOX outperforms recent one-shot and iterative baselines in these areas and supports both global and local scene generation and rearrangement.
Why it matters: This work represents a notable advance in 3D scene generation by enabling more physically and semantically plausible, editable layouts through progressive reasoning.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers introduce SARFA, a framework that enhances the Segment Anything Model (SAM) for medical image segmentation by incorporating probabilistic prompting and a radiomics-driven training objective. SARFA aligns anatomical and textural features of predicted segmentations with clinical ground truth using Fréchet Radiomic Distance and Direct Preference Optimization. The method demonstrates improved performance over existing ambiguous segmentation approaches on CT and MRI benchmarks.
Why it matters: This work offers a novel approach to addressing ambiguous boundaries in medical imaging, which could improve the accuracy of tumor delineation and support better clinical decision-making.
Jul 16, 2026
Research→Official→arXiv Computer Vision
A new framework, FM$^2$, is introduced for federated learning of medical foundation models across institutions with heterogeneous imaging modalities. FM$^2$ features dual Mixture-of-Experts modules and a Heterogeneous Modality Alignment regularizer to address both overlapped and non-overlapped modality distributions. It also leverages caption-enhanced learning using GPT-4o-generated captions to facilitate cross-client representation transfer. Experiments on classification, caption learning, and medical VQA tasks show FM$^2$ consistently outperforms existing federated baselines.
Why it matters: This work advances privacy-preserving medical AI by enabling collaborative training of multimodal foundation models across hospitals, even when participating sites have entirely different imaging modalities.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers have introduced a plug-and-play token reduction framework for vision-language models that eliminates the need for attention maps and pairwise similarity comparisons. By leveraging entropy-based importance estimation and transformation-induced consistency signals, the method selects a compact and diverse set of visual tokens. Experiments across multiple benchmarks show that the approach maintains competitive accuracy even under aggressive token compression, offering a favorable accuracy-efficiency trade-off.
Why it matters: This work could make vision-language models more practical for deployment on resource-constrained edge devices by reducing computational overhead without significant loss in performance.
Jul 16, 2026
Models→Official→arXiv Computer Vision
Kuaishou's Large Processing Model (LPM) is a diffusion-based generative framework for photorealistic video restoration, designed to handle diverse, real-world degradations in user-generated content. LPM is reportedly the first generative video restoration model deployed at industrial scale, processing videos that account for about 45% of total viewing time on Kuaishou. The system achieves a 20% bitrate reduction compared to Kuaishou's in-house codec, resulting in substantial annual bandwidth cost savings.
Why it matters: This work demonstrates the first industrial-scale deployment of generative video restoration, showing that such models can deliver practical, scalable, and cost-effective improvements in large-scale video processing.
Jul 16, 2026
Research→Official→arXiv Computer Vision
A new preprint demonstrates that open-vocabulary object detectors maintain nearly constant confidence scores even as the visible portion of a target object drops to one-eighth, and often report the target present in about 90% of scenes, even when only a same-category distractor is visible. This indicates that detector confidence signals the presence of the object category somewhere in the scene, rather than the visibility of the specific target. The finding holds across three detectors, nine object categories, multiple simulators, and real video, and exposes a fundamental flaw in using detector confidence as a proxy for occlusion or visibility.
Why it matters: This work challenges a common assumption in robotics and computer vision, showing that detector confidence cannot reliably indicate object visibility, which impacts evaluation, active perception, and downstream applications.
Jul 16, 2026
Research→Official→arXiv Computer Vision
MultiAnimate is a new framework that enables concurrent animation of multiple characters from separate reference images, preserving both identity and spatial relationships. It introduces an identity-specific reference net, an identity-aware pose encoder, and an optional interaction guider module to address challenges in multi-character animation. Experiments and ablation studies demonstrate its superiority over existing methods, especially in scenarios involving complex motion and inter-character interactions.
Why it matters: This work overcomes a major limitation of prior character animation methods by enabling controllable, identity-preserving animation of multiple characters, expanding the possibilities for interactive animation applications.
Jul 16, 2026
Research→Official→arXiv Computer Vision
A new deepfake detection system, BitMind Forensics (BMF), trained via an open adversarial competition that continually updates its training distribution, achieves an AUC of 0.936 on Sumsub and 0.872 pooled across four manipulation conditions, outperforming static open-source detectors that experience 45-50% AUC drops on real-world content. On Deepfake-Eval-2024, BMF matches the best commercial detector on images (0.915 vs 0.90) and surpasses it on video (0.822 vs 0.79). The system also demonstrates temporal improvement on held-out media from previously unseen generators.
Why it matters: This work shows that continuously evolving detection systems are more effective than static models at keeping pace with advances in generative AI, addressing a major challenge in real-world deepfake detection.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers propose a new finetuning method called Fréchet Distance loss (FD-loss) to improve diffusion generative models for medical images. By aligning feature statistics between real and generated images, FD-loss enhances the fidelity of synthetic tumor images, leading to over 5% improvement in downstream segmentation performance on liver and brain cancer datasets. The approach reduces segmentation hallucinations and produces more realistic tumor morphologies.
Why it matters: This work offers a practical advance for medical image synthesis by addressing the tendency of diffusion models to oversmooth irregular tumor boundaries, thereby improving the clinical utility of synthetic data for segmentation tasks.
Jul 16, 2026
Research→Official→arXiv Computer Vision
A new human-in-the-loop framework combines active learning and weak supervision to reduce the annotation effort required for surgical video segmentation by 50%. The approach leverages a foundation model to generate temporally consistent class activation maps and iteratively refines pseudo-masks with minimal expert input. This method eliminates the need for large, fully annotated datasets at the outset, enabling more scalable development of surgical tool segmentation models.
Why it matters: Reducing annotation effort makes it more feasible to develop and deploy surgical video analysis models in real-world clinical settings.
Jul 16, 2026
Research→Official→arXiv Computer Vision
A new preprint introduces the Visual Dependency Gap (VDG) metric to assess whether video LLM benchmarks truly measure visual understanding. By evaluating 20 models across various architectures, the study finds that benchmark accuracy can be dissociated from genuine visual dependency, with temporal order contributing little to performance. The authors propose VDG as a standard audit for visually grounded capability in video LLMs.
Why it matters: This work challenges the assumption that high benchmark scores in video LLMs reflect real visual understanding, highlighting the need for more rigorous evaluation methods.
Jul 16, 2026
Models→Official→arXiv Computer Vision
Boogu-Image-0.1 is an open-source family of unified multimodal understanding and generation models, including Base, Turbo, Edit, and Edit-Turbo variants. It delivers competitive performance in text-to-image generation, fast inference, instruction-based editing, and bilingual text rendering, consistently matching or surpassing other open-source models and achieving results that approach those of leading closed-source systems. The model was trained on 208.62 million unique images with a theoretical training cost of approximately $400K, and its weights, code, and recipes are released under Apache 2.0.
Why it matters: This work shows that targeted improvements and inference-time scaling can significantly boost multimodal generation performance under limited compute, advancing open-source capabilities in unified understanding and generation.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers introduce JITOMA, a closed-loop framework for constructing 3D scene graphs on demand in long-horizon robotics tasks. JITOMA uses a task heatmap to filter observations and leverages a large language model to dynamically activate only task-relevant anchors, reducing the size of the active scene graph and lowering captioning latency. The approach is evaluated on the new JITOMA-Bench benchmark, demonstrating stable processing times even during frequent task switching.
Why it matters: This work offers a novel solution to perceptual saturation in robotics, enabling more efficient and scalable real-time scene understanding for long-duration tasks.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers present FOLIO, a training-free semantic memory system for streaming video understanding that selectively retains detailed information about important entities while compressing less relevant context. FOLIO dynamically updates memory as video streams in, combining a short-term visual buffer with a long-term semantic memory organized around entities. The system achieves state-of-the-art results on OVO-Bench and StreamingBench benchmarks, while significantly reducing memory requirements.
Why it matters: This work offers a practical advance in efficient, accurate real-time video understanding by addressing the challenge of long-term memory management in streaming scenarios.
Jul 16, 2026
Research→Official→arXiv Computer Vision
A systematic study compares pretrain-finetuning (PFT) and joint training (JT) paradigms for self-supervised visual representation learning across eight methods and a range of vision tasks, including natural, medical, crisis response, and remote sensing data. The results show that JT improves data and training efficiency and is robust in low-label settings, while PFT tends to be more reliable in specialized domains. The study also analyzes representation quality, robustness, and cross-domain generalization, providing practical guidance for selecting training strategies.
Why it matters: This research offers comprehensive empirical benchmarks and practical insights for choosing between PFT and JT in self-supervised learning, potentially improving efficiency and performance in diverse vision applications.
Jul 16, 2026
Research→Official→arXiv Computer Vision
Researchers introduce MobileSAM2, a lightweight version of the SAM2 segmentation model designed for mobile devices. The model leverages a novel Hypergraphical Knowledge Distillation (HyperKD) technique, which includes Temporal and Granularity HyperKD to transfer temporal and multi-granularity knowledge from the original SAM2. MobileSAM2 is developed through architecture search and demonstrates promising results on segmentation tasks, including embodied AI benchmarks.
Why it matters: MobileSAM2 enables advanced segmentation capabilities on resource-constrained devices, expanding the practical deployment of spatial intelligence applications.
Jul 15, 2026
Research→Official→arXiv Computer Vision
A new preprint audits data leakage in whole-slide image (WSI) multimodal benchmarks and finds that patient-level and institutional-level overlaps significantly compromise reported zero-shot performance of vision-language models. The authors document case-level train-test overlaps of 92.3–100% on TCGA-derived benchmarks and show that this leakage is linearly decodable from foundation-model features. They recommend concrete steps for contamination-free evaluation practices.
Why it matters: This work reveals that widely-used WSI VQA benchmarks may not accurately measure genuine multimodal reasoning, calling into question reported advances in computational pathology.
Jul 15, 2026
Research→Official→arXiv Computer Vision
Researchers introduce ACID, a training-free wrapper that adaptively adjusts caching thresholds during video diffusion model inference. By dynamically switching between low and high thresholds based on the rate of change in the drift signal, ACID achieves up to 2.16x speedup over no-caching baselines and up to 38% additional speedup over conservative fixed-threshold caching, with negligible quality degradation (<0.3 dB PSNR). ACID is compatible with existing caching methods such as TeaCache, EasyCache, and DiCache, and works across multiple video diffusion models.
Why it matters: This approach advances the speed-quality tradeoff in video diffusion models, making them more practical for real-time applications without retraining.
Jul 15, 2026