EndoControlMag
Robust Endoscopic Vascular Motion Magnification with Periodic Reference Resetting and Hierarchical Tissue-aware Dual-Mask Control
The Chinese University of Hong Kong · CUHK Shenzhen Research Institute · Clinical and engineering collaborators
Quick preview
Reveal vascular motion. Preserve the scene.
Selective ×4 magnification on laparoscopic cholecystectomy footage. Both videos are synchronized.
TL;DR
EndoControlMag makes subtle vascular pulsations visible in dynamic surgical videos while keeping surrounding tissue stable—even through occlusion, deformation, instrument motion, and view change.
Abstract
Motion magnification built for real surgical scenes.
Accurate visualization of subtle vascular dynamics is a knowledge-intensive challenge in minimally invasive surgery. Conventional imaging systems struggle to reveal these imperceptible motions amidst camera movement, tissue deformation, and instrument occlusion.
EndoControlMag is a training-free Lagrangian framework that applies mask-conditioned magnification to target vessels while preserving surrounding tissue. Periodic Reference Resetting limits temporal drift, while Hierarchical Tissue-aware Magnification maintains spatial control with tracked inner masks and adaptively softened outer masks.
Method
Temporal stability meets tissue-aware control.
Two complementary mechanisms address the temporal and spatial failure modes of endoscopic motion magnification.
Temporal consistency
Periodic Reference Resetting
The input video is divided into short overlapping clips. Each clip receives an updated reference frame, preventing error accumulation without introducing abrupt temporal transitions.
Spatial selectivity
Hierarchical Tissue-aware Magnification
A pretrained tracker follows the vessel core while motion- or distance-based softening controls amplification across nearby deformable tissue.
Qualitative results
One framework across four surgical procedures.
Switch procedures to compare the original footage with EndoControlMag. The paired videos remain synchronized.
Laparoscopic Cholecystectomy
Magnification factor ×4
Controllable magnification
From subtle enhancement to close inspection.
A continuous range of magnification factors supports different clinical viewing needs.
Challenging scenarios
Robust when the surgical scene changes.
EndoControlMag maintains vessel localization and smooth magnification across four realistic sources of disruption.
Occlusion
Temporary coverage by surgical gauze or instruments.
Tool disturbance
Strong local motion caused by instrument interaction.
Vessel deformation
Non-rigid tissue stretching changes vessel appearance.
View change
Large camera movement and temporary vessel disappearance.
Evaluation
Measured for accuracy, quality, and clinical usefulness.
Image quality
SSIM, PSNR, and MUSIQ quantify fidelity and perceptual quality across magnification factors.
Magnification accuracy
Spatial-temporal analysis verifies periodic enhancement at the target vessel while surrounding tissue remains stable.
Surgeon assessment
A double-blind expert study evaluates visual quality, robustness, and perceived clinical usefulness.
Publication
Advanced Engineering Informatics
EndoControlMag: Robust endoscopic vascular motion magnification with periodic reference resetting and hierarchical tissue-aware dual-mask control
- Volume
- 72
- Article
- 104505
- Published
- May 2026
- Access
- Open access
@article{wang2026endocontrolmag,
title = {EndoControlMag: Robust endoscopic vascular
motion magnification with periodic reference
resetting and hierarchical tissue-aware
dual-mask control},
author = {Wang, An and Zhou, Rulin and Xu, Mengya and
Ye, Yiru and Gou, Longfei and Chang, Yiting
and Chen, Hao and Lim, Chwee Ming and
Wang, Jiankun and Ren, Hongliang},
journal = {Advanced Engineering Informatics},
volume = {72},
pages = {104505},
year = {2026},
doi = {10.1016/j.aei.2026.104505}
}