Spec-NeRF: Multi-Spectral Neural Radiance Fields

• DOI: 10.36227/techrxiv.24188235.v1
• Publication Date: 2023-10-02T15:32:28Z
• Authors: Jiabao Li; Yuqi Li; Ciliang Sun; Chong Wang; Jinhui Xiang
• Keywords: FOS: Computer and information sciences; Computer Science - Graphics; Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Computer Science - Computer Vision and Pattern Recognition; FOS: Electrical engineering, electronic engineering, information engineering; 0401 agriculture, forestry, and fisheries; 04 agricultural and veterinary sciences; Electrical Engineering and Systems Science - Image and Video Processing; Graphics (cs.GR)

<p>Spec-NeRF jointly optimizes the degradation parameters and achieves high-quality multi-spectral image reconstruction results at novel views, which only requires a low-cost camera (like a phone camera but in RAW mode) and several off-the-shelf color filters. We also provide real scenarios and synthetic datasets for related studies. Code is available at <a href="https://github.com/CPREgroup/SpecNeRF-v2" target="_blank">https://github.com/CPREgroup/SpecNeRF-v2</a></p>