Shuffled rolling shutter for snapshot temporal imaging
Published in Optics Express, 2022
Recommended citation: E. Vera, F. Guzmán, and N. Diaz, “Shuffled rolling shutter for snapshot temporal imaging,” Opt. Express, vol. 30, pp. 887-901, 2022. [Paper], [DOI], [Code].
We propose a modification to the rolling shutter mechanism found in CMOS detectors by shuffling the pixels in every scanline. This potential hardware modification improves the sampling of the space-time datacube, allowing the recovery of high-speed videos from a single image using either tensor completion methods or reconstruction algorithms often used for compressive temporal video. We also present a design methodology for optimal sampling schemes and compare them to random shuffling. Simulations, and experimental results obtained by optically emulating the hardware, demonstrate the ability of the shuffled rolling shutter to capture images that allow reconstructing videos, which would otherwise be impossible when using the traditional rolling shutter mechanism.
Cite
@article{Vera:22,
author = {Esteban Vera and Felipe Guzm\'{a}n and Nelson D\'{i}az},
journal = {Opt. Express},
keywords = {Compressive imaging; Computational imaging; Digital micromirror devices; Image sensors; Neural networks; Reconstruction algorithms},
number = {2},
pages = {887--901},
publisher = {OSA},
title = {Shuffled rolling shutter for snapshot temporal imaging},
volume = {30},
month = {Jan},
year = {2022},
url = {http://www.osapublishing.org/oe/abstract.cfm?URI=oe-30-2-887},
doi = {10.1364/OE.444864},
abstract = {We propose a modification to the rolling shutter mechanism found in CMOS detectors by shuffling the pixels in every scanline. This potential hardware modification improves the sampling of the space-time datacube, allowing the recovery of high-speed videos from a single image using either tensor completion methods or reconstruction algorithms often used for compressive temporal video. We also present a design methodology for optimal sampling schemes and compare them to random shuffling. Simulations, and experimental results obtained by optically emulating the hardware, demonstrate the ability of the shuffled rolling shutter to capture images that allow reconstructing videos, which would otherwise be impossible when using the traditional rolling shutter mechanism.},
}