An intelligent high-saturation snapshot method and system based on motion perception and adaptive white balance delay

Abstract

The application discloses an intelligent high-saturation snapshot method and system based on motion sensing and adaptive white balance delay, and belongs to the field of intelligent terminal image processing. The method is applied to an intelligent terminal comprising an inertial motion sensing module, an ambient light sensing module, a camera acquisition module and an end-side processing unit. Data is collected by the inertial motion sensing module, combined with dynamic threshold, trajectory continuity verification and false touch prevention condition identification effective swing. Based on ambient light data, a continuous mapping model is used to calculate the white balance delay time. Frame-level synchronous trigger shutter is adopted to collect images by using single camera continuous frames or double camera synchronous frames. After motion blur compensation and dynamic saturation enhancement, high-saturation clear images are output, and the output image metadata contains a special identification field. The application breaks through the industry technical prejudice, reduces the false trigger rate to below 0.5%, and improves the image forming rate to above 95%. Without adding new hardware, the application can be widely adapted to various intelligent terminals, solves the industry pain points of high false trigger, uncontrollable best imaging opportunity and swing blur of traditional snapshots, and reduces the difficulty of infringement and right protection evidence.

Description

Technical Field

[0001] This invention belongs to the field of intelligent terminal image processing technology, specifically relating to an intelligent high-saturation capture method and system based on motion perception and adaptive white balance delay. This invention is intended solely for legitimate and compliant user shooting scenarios, strictly adhering to relevant laws and regulations on personal information protection and privacy protection, and is not intended for any illegal shooting or privacy infringement purposes. Background Technology

[0002] With the development of smartphone imaging technology, users have increasingly higher requirements for the convenience and imaging effect of snapshots. However, existing mobile phone snapshot technologies have the following unavoidable technical defects: Manual shutter triggering cannot accurately capture the high-saturation original colors before white balance calibration, and the best imaging moment depends entirely on user luck, making it impossible to reliably reproduce. Conventional shake-triggered shooting only uses a single acceleration threshold for judgment, which easily leads to false triggering in scenarios such as daily walking, vehicle bumps, and pocket friction, with an industry average false triggering rate of >35%. During shake-triggered shooting, there is no time synchronization mechanism for shutter triggering, resulting in severe motion blur and an effective image success rate of only about 60%, which seriously affects the user experience. Existing automatic white balance solutions all aim to "quickly complete calibration" as their optimization goal, and no solution provides precise time control and imaging optimization for the "high saturation characteristics of uncalibrated white balance frames".

[0003] In existing technologies, in order to avoid color deviation caused by uncalibrated white balance, the industry generally adopts the fixed logic of "completing white balance calibration first and then triggering the shutter". They even use technical means such as pre-calibration and continuous calibration to shorten the calibration time. There is absolutely no motivation to actively delay white balance calibration, which has formed a common technical bias in the industry. Summary of the Invention

[0004] (a) Purpose of the invention The purpose of this invention is to overcome the above-mentioned defects of the prior art and provide an intelligent high-saturation capture method and system based on motion perception and adaptive white balance delay, so as to achieve intelligent capture with low false touch, high saturation and high definition, break through industry technical bias and solve the core pain points of the prior art.

[0005] (II) Technical Solution This invention provides an intelligent high-saturation snapshot method based on motion perception and adaptive white balance delay, applicable to an intelligent terminal comprising an inertial motion sensing module, an ambient light sensing module, a camera acquisition module, and an edge processing unit, comprising the following steps: S1. The device's three-dimensional acceleration data and gyroscope angular velocity data are collected through the inertial motion sensing module. Combined with dynamic threshold judgment, trajectory continuity verification, and anti-accidental touch auxiliary conditions, valid photo-taking and swinging actions are identified. S2. Collect ambient illuminance and color temperature data of the current scene through the ambient light sensing module, and calculate the white balance delay trigger time based on the preset continuous mapping model. S3. Based on the calculated white balance delay time, the shutter of the camera acquisition module is triggered through a frame-level hardware synchronization mechanism to acquire two original images by using single-camera continuous frame acquisition or dual-camera synchronous frame acquisition. S4. The end-side processing unit performs motion vector calculation and blur region identification on the two original images, completes motion blur compensation through frame fusion algorithm, and then outputs a highly saturated and clear image through dynamic saturation enhancement processing.

[0006] The present invention also provides an intelligent high-saturation capture system for performing the above-mentioned intelligent high-saturation capture method, comprising: an inertial motion sensing module (1), an ambient light sensing module (2), an auxiliary anti-accidental touch module (3), a camera acquisition module (4), and an end-side processing unit (5).

[0007] The single-camera continuous frame acquisition scheme and the dual-camera synchronous frame acquisition scheme of the present invention are both based on the unified core inventive concept of "dual-frame motion vector calculation + fuzzy region compensation". Only the acquisition method is adjusted due to the difference in terminal hardware configuration. They belong to a general inventive concept and meet the unity requirement of Article 31 of the Patent Law.

[0008] (III) Beneficial Effects Compared with the prior art, the present invention has the following significant advantages: The false trigger rate has been reduced from the industry average of 35% to below 0.5%, significantly reducing invalid triggers; the optimal capture rate for high saturation has been increased from 42% to 98%, stably achieving high-saturation imaging; the image blur rate has been reduced from 40% to below 5%, and the success rate of images has been increased from 60% to over 95%; no new hardware is required, and it is compatible with single / dual cameras and flagship / mid-range smart terminals, demonstrating strong compatibility and the ability to be deployed in batches; the metadata of the output images includes a unique identifier field, significantly reducing the difficulty of proving infringement and improving the convenience of rights protection.

[0009] Compared to existing technologies, the core breakthrough of this invention lies in its unconventional technical approach and the synergistic effect between multiple modules: Existing automatic white balance technologies all focus on "completing white balance calibration as quickly as possible," with the industry generally considering "images without proper white balance calibration to be unusable." This invention, however, takes the opposite approach, actively utilizing the high-saturation color characteristics of the original frame before white balance calibration. With "precise delayed white balance calibration" as its core, it links a motion detection module to achieve contactless triggering and a dual-frame fusion module to solve motion blur caused by motion. Ultimately, it achieves a synergistic effect of "low false trigger rate + stable high-saturation color capture + high-definition image," rather than simply adding functions together. This invention overcomes the prevalent technical bias in the industry, using proactive delayed calibration as its core to achieve a high-saturation, stable capture effect that existing technologies cannot reach, demonstrating outstanding substantive characteristics. Detailed Implementation

[0010] This embodiment provides a preferred implementation method that can be implemented on Android smartphones: Hardware adaptation: The device uses a universal inertial sensor (such as the MPU-6050 series), ambient light sensor, proximity sensor, and main / ultra-wide-angle dual-camera module built into the mobile phone. The on-device processing unit uses a universal mobile processor (such as the Snapdragon 8 Gen3 flagship platform). Those skilled in the art should understand that the above hardware models are only examples, and any inertial sensor or processor with the same function can be used to implement this invention.

[0011] The shake recognition algorithm has a default sampling rate of 50Hz, which is increased to 100Hz after a pre-trigger feature is detected. The dynamic threshold is calculated based on the user's daily action baseline over the past 7 days. The trajectory continuity is verified by calculating the rate of change of the direction angle. The anti-accidental touch is verified by dual sensors of light and distance.

[0012] White balance delay algorithm: A continuous mapping model with a negative correlation between white balance delay time and ambient illuminance is adopted. This mapping relationship was obtained through more than 1000 white balance calibration time calibration experiments under different ambient illuminance. The delay range of 40ms to 120ms and the saturation gain with a negative correlation with ambient illuminance are the optimal effect range calibrated by the experiments. The specific values ​​can be dynamically adjusted according to the hardware characteristics of different terminals. The specific values ​​in this specification are only preferred embodiments. The delay in strong light environment is about 40ms and the delay in low light environment is about 120ms. Frame-level synchronization triggering is achieved through the camera ISP hardware register.

[0013] Dual-frame fusion algorithm: In dual-camera scenarios, a long exposure frame from the main camera and a short exposure frame from the ultra-wide-angle lens are used. In single-camera scenarios, two consecutive frames with a 10ms interval are used. Feature points are extracted using an improved ORB algorithm, motion vectors are calculated, and deconvolution compensation is performed on blurred areas.

[0014] Saturation enhancement algorithm: The gain is higher in low light environment and lower in strong light environment. The gain value is negatively correlated with the ambient illuminance to avoid oversaturation and color banding.

[0015] Complete operation process: The user shakes the phone → The system collects data through the inertial motion sensor module (1) → Combines the detection results of dynamic threshold, trajectory continuity verification and anti-mistouch auxiliary module (3) to identify effective shaking → The ambient light sensor module (2) collects ambient illuminance and color temperature data → Calculates white balance delay time → Frame-level synchronous triggering of the shutter of the camera acquisition module (4) → Single-camera continuous frame or dual-camera synchronous frame to acquire two frames of original images → End-side processing unit (5) completes motion blur compensation and dynamic saturation enhancement → Outputs a high-saturation clear image, and the image metadata contains a special identifier field for high-saturation capture triggered by shaking.

[0016] This solution is compatible with scenarios where the device has a thick protective case and the user is wearing gloves. The dynamic threshold can be adaptively adjusted according to the weight of the device and the operating resistance. It is compatible with high and low temperature environments from -10℃ to 45℃, and the recognition accuracy is guaranteed by the sensor temperature drift compensation algorithm. It is compatible with extreme shooting scenarios such as underwater shooting, backlighting, and mixed color temperature. The white balance delay model can be dynamically adapted according to the scenario.

[0017] Alternative embodiments of the present invention include, but are not limited to: replacing the shaking trigger with a flipping, tapping, or voice pre-triggered trigger; replacing the linear mapping model with a nonlinear mapping model or a piecewise mapping model; and replacing two-frame fusion with three-frame or higher multi-frame fusion. All of the above alternative embodiments are based on the core concept of the present invention and fall within the protection scope of the present invention.

[0018] The core concept of the technical solution of this invention was proposed independently by the inventor. AI tools were used for format standardization and language polishing during the drafting of the patent application documents, but no AI tools were used to generate the core technical solution and the content of the claims. Attached Figure Description

[0019] Figure 1 is an overall flowchart of the intelligent high-saturation capture method of the present invention; Figure 2 is a logic block diagram of the swing recognition module of the present invention; Figure 3 is a logic block diagram of the white balance delay calculation module of the present invention; Figure 4 is a logic block diagram of the dual-frame motion blur compensation module of the present invention.

Claims

1. A smart high-saturation snapshot method based on motion perception and adaptive white balance delay, applied to a smart terminal including an inertial motion sensing module, an ambient light sensing module, a camera acquisition module, and an edge processing unit, characterized in that, The process includes the following steps: S1. Acquire three-dimensional acceleration data and gyroscope angular velocity data of the device through the inertial motion sensing module, and identify valid photo-taking shaking motions by combining dynamic threshold judgment, trajectory continuity verification, and anti-accidental touch auxiliary conditions; S2. Acquire ambient illuminance and color temperature data of the current scene through the ambient light sensing module, and calculate the white balance delay trigger time based on a preset continuous mapping model; S3. Trigger the shutter of the camera acquisition module through a frame-level hardware synchronization mechanism according to the calculated white balance delay time, and acquire two original images by using single-camera continuous frame acquisition or dual-camera synchronous frame acquisition; S4. Perform motion vector calculation and blurred region identification on the two original images through the end-side processing unit, complete motion blur compensation through frame fusion algorithm, and then output a highly saturated and clear image through dynamic saturation enhancement processing.

2. The method according to claim 1, characterized in that, The dynamic threshold in step S1 is adaptively calculated based on the user's daily action baseline using an exponentially weighted moving average algorithm. The trigger threshold is positively correlated with the intensity of environmental interference in the current scene.

3. The method according to claim 1, characterized in that, The trajectory continuity check in step S1 is to determine the continuity of the acceleration direction angle change of the swinging motion. Only when the continuity is ≥80% is it determined to be a valid swing.

4. The method according to claim 1, characterized in that, The anti-accidental touch auxiliary condition in step S1 is to determine the non-pocket-obstructed state of the device through the light sensor and distance sensor, and allow the shutter to be triggered only when the ambient illuminance is > 10 lux and the distance between the device and the obstacle is > 1 cm.

5. The method according to claim 1, characterized in that, The continuous mapping model in step S2 is as follows: the white balance delay time is negatively correlated with the ambient illuminance, and the delay time ranges from 40ms to 120ms.

6. The method according to claim 1, characterized in that, The single-camera continuous frame acquisition in step S3 is to simulate parallax by estimating the optical flow of two consecutive frames of images, thereby achieving motion blur compensation for the single-camera device.

7. The method according to claim 1, characterized in that, The dual-camera synchronous frame acquisition in step S3 involves the synchronous acquisition of high-definition frames from the main camera and high-speed frames from the secondary camera.

8. The method according to claim 1, characterized in that, The dynamic saturation enhancement in step S4 has a gain value that is negatively correlated with the ambient illuminance.

9. The method according to any one of claims 1-8, characterized in that, The metadata of the output high-saturation, clear image includes an identifier field that marks this capture as a high-saturation snapshot triggered by a shaking motion.

10. An intelligent high-saturation capture system, characterized in that, The method for executing the intelligent high-saturation capture method according to any one of claims 1-9 includes: an inertial motion sensing module (1), an ambient light sensing module (2), an auxiliary anti-accidental touch module (3), a camera acquisition module (4), and an end-side processing unit (5).

Images