Multispectral prior guided mobile phone image tone mapping method

By installing a multi-spectral sensor on the mobile terminal, the spectrum-perceptual self-attention module is used to fuse multi-spectral and RGB image features to generate transformation coefficients for tone enhancement, solving the problem of inaccurate tone enhancement in complex environments by mobile phone photography, and achieving better image enhancement effect and local color consistency.

CN119693285AActive Publication Date: 2025-03-25NANJING UNIV
4 Cites 0 Cited by

Patent Information

Application Number
CN202510215713.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-02-26
Publication Date
2025-03-25
Estimated Expiration
2045-02-26

AI Technical Summary

Technical Problem

Existing mobile phone photography technology is difficult to accurately enhance tone in complex environments, and fails to make full use of additional spectral information to improve image enhancement steps.

Method used

The multi-spectral prior guided mobile image tone mapping method is adopted. By installing a multi-spectral sensor on the mobile terminal, the multi-spectral image and RGB image are obtained, and the characteristic information is fused by the spectral perception self-attention module to generate a spectrum enhancement bilateral grid coefficient, and the transformation coefficient is generated through the guide map for tone enhancement.

Benefits of technology

Effectively fusing additional spectral information improves the local color consistency and image enhancement effect of mobile phone images, and overcomes the limitations of limited spectral imaging performance on mobile terminals.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention provides a multispectral prior guided mobile phone image tone mapping method, which comprises the following steps of: 1, carrying an additional multispectral sensor on a mobile terminal, acquiring a multispectral image of a scene in a visible light wave band, and simultaneously acquiring a visible light RGB (Red, Green, Blue) image shot by a main camera of the mobile terminal; 2, performing feature extraction on the multispectral image and the RGB image, and inputting the multispectral image and the RGB image into a spectrum sensing self-attention module through feature embedding to obtain a bilateral grid coefficient enhanced through a spectrum; and step 3, jointly adopting the RGB image and the multispectral image as a guide graph, and interpolating in the spectrum enhancement bilateral grid coefficient through the guide graph to obtain a color transformation coefficient of each pixel point, thereby obtaining a final hue enhancement output graph. According to the method, extra multi-spectral image information with low spatial resolution is fully utilized to be used for a tone enhancement task in a mobile phone image, and the defect that the spectral imaging performance of a mobile terminal is limited due to physical space limitation is overcome from the algorithm level link.
Need to check novelty before this filing date? Find Prior Art