Improvement in video inpainting in presence of moving subjects

Abstract

Inpainting or completion is used with the purpose of restoring damaged images and video frames. This paper proposes an applicable algorithm to inpaint corrupted subjects in video frames. To begin with, background and foreground (moving subject) are separated from each other in each frame, with the aim of getting to a more visually pleasant result. Static background inpainting is done using a patch-based method. To inpaint the corrupted moving subject, a subject-based method that is an improvement on the rigid object-based method is used in this study to consider the special issue of inpainting the human body. To fill in the holes created by occluding subjects the most appropriate template is found using a similarity measure which is based on both contour and pixel values. The inpainted video is acquired by superimposing the completed foreground on the inpainted background