Methods for refining the depth map obtained from depth sensors

Authors

  • Sergey B. Kondratyev Odesa National Polytechnic University, 1, Shevchenko Ave. Odesa, 65044, Ukraine
  • Svitlana G. Antoshchuk Odesa Polytechnic National University, 1, Shevchenko Ave. Odesa, 65044, Ukraine
  • Mykola A. Hodovychenko Odesa National Polytechnic University, 1, Shevchenko Ave. Odesa, 65044, Ukraine

DOI:

https://doi.org/10.15276/aait.07.2024.23

Keywords:

Depth maps, 3D reconstruction, image processing, spatial data analysis, data refinement, sensor-based imaging, edge detection, noise reduction, depth sensing, computational imaging, augmented reality, autonomous systems

Abstract

Depth maps are essential in applications such as robotics, augmented reality, autonomous vehicles, and medical imaging,
providing critical spatial information. However, depth maps from sensors like time-of-flight (ToF) and structured light systems often
suffer from low resolution, noise, and missing data. Addressing these challenges, this study presents an innovative method to refine
depth maps by integrating high-resolution color images. The proposed approach employs both hard- and soft-decision pixel
assignment strategies to adaptively enhance depth map quality. The hard-decision model simplifies edge classification, while the
soft-decision model, integrated within a Markov Random Field framework, improves edge consistency and reduces noise. By
analyzing discrepancies between edges in depth maps and color images, the method effectively mitigates artifacts such as texturecopying and blurred edges, ensuring better alignment between the datasets. Key innovations include the use of the Canny edge
detection operator to identify and categorize edge inconsistencies and anisotropic affinity calculations for precise structural
representation. The soft-decision model introduces advanced noise reduction techniques, improving depth map resolution and
preserving edge details better than traditional methods. Experimental validation on Middlebury benchmark datasets demonstrates that
the proposed method outperforms existing techniques in reducing Mean Absolute Difference values, especially in high-upscaling
scenarios. Visual comparisons highlight its ability to suppress artifacts and enhance edge sharpness, confirming its effectiveness
across various conditions. This approach holds significant potential for applications requiring high-quality depth maps, including
robotics, augmented reality, autonomous systems, and medical imaging. By addressing critical limitations of current methods, the
study offers a robust, versatile solution for depth map refinement, with opportunities for real-time optimization in dynamic
environments.

Downloads

Download data is not yet available.

Author Biographies

Sergey B. Kondratyev, Odesa National Polytechnic University, 1, Shevchenko Ave. Odesa, 65044, Ukraine

Senior lecturer, Department of Artificial Intelligence and Data Analysis 

Svitlana G. Antoshchuk, Odesa Polytechnic National University, 1, Shevchenko Ave. Odesa, 65044, Ukraine

Doctor of Engineering Sciences, Professor, Head of Computer Systems Institute

Scopus Author ID: 8393582500

Mykola A. Hodovychenko, Odesa National Polytechnic University, 1, Shevchenko Ave. Odesa, 65044, Ukraine

PhD (Eng), Associate professor, Department of Artificial Intelligence and Data Analysis

Scopus Author ID: 57188700773

Downloads

Published

2024-11-21

How to Cite

[1]
Kondratyev S.B.., Antoshchuk S.G.., Hodovychenko M.A.. “Methods for refining the depth map obtained from depth sensors”. Applied Aspects of Information Technology. 2024; Vol. 7, No. 4: 336–347. DOI:https://doi.org/10.15276/aait.07.2024.23.

Most read articles by the same author(s)