Journal of Chongqing University of Technology(Natural Science) ›› 2023, Vol. 37 ›› Issue (10): 127-135.

• “Extended Reality (XR) Theory,technology and Application”Special Column • Previous Articles     Next Articles

Multi-view 3D reconstruction combining attention mechanism and path aggregation

  

  • Online:2023-11-20 Published:2023-11-20

Abstract: Research on learning-based multi-view 3D reconstruction has achieved significant progress,issues like incomplete feature extraction and poor correlation between cost volume still exist,resulting in low reconstruction accuracy.To address these problems,a cascaded network called PAA-MVSNet is designed.Firstly,inspired by the idea of PANet,a “top-down” feature extraction network is designed to extract features at different scales.These features are then concatenated to reduce feature loss.This module outputs three different-scale feature layers,which are fed into the subsequent network to adaptively adjust the depth values and generate higher-precision depth maps.Additionally,to tackle the poor correlation between cost volume,an improved SE attention module is incorporated to optimize the regularization process of the 3D cost volume.This module enhances reconstruction accuracy and completeness.Experimental results on the DTU dataset and Tanks and Temples dataset demonstrate that PAA-MVSNet achieves generalization

CLC Number: 

  • TM391.4