Sun protection control method in a vehicle and vehicle

Abstract

The embodiment of the application provides a sunscreen control method in a vehicle and a vehicle, and relates to the technical field of vehicles. The method comprises the following steps: acquiring a first image and a second image of a copilot object in the vehicle, wherein the first image is a three-primary-color image of a preset part of the copilot object, the second image is an ultraviolet image of the preset part of the copilot object, and the preset part at least includes a face and a neck; performing spatial alignment on the first image and the second image with the first image as a reference to obtain a second aligned image, wherein the second aligned image is the second image after spatial alignment; determining a sunscreen thickness value of the copilot object in the second aligned image based on a fluorescence intensity value of the second aligned image; and performing a sunscreen control operation based on the sunscreen thickness value. The application solves the technical problem of poor ultraviolet protection effect in the vehicle in the related art.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and more specifically, to a method for controlling sun protection inside a vehicle and a vehicle. Background Technology

[0002] With the increasing popularity of long-distance road trips, the health protection needs of drivers and passengers are becoming increasingly prominent due to prolonged exposure to ultraviolet radiation inside the vehicle. Currently, methods such as adjusting the temperature and humidity inside and outside the vehicle, or relying on static warnings and single-point ultraviolet (UV) sensors for UV protection are not very effective.

[0003] There is currently no good solution to the above problems. Summary of the Invention

[0004] This application provides a method for controlling sun protection inside a vehicle and a vehicle, so as to at least solve the technical problem of poor ultraviolet protection effect inside vehicles in related technologies.

[0005] According to one aspect of the embodiments of this application, a method for controlling sun protection inside a vehicle is provided, comprising: acquiring a first image and a second image of a passenger in the vehicle, wherein the first image is a tri-color image taken of a preset part of the passenger, and the second image is an ultraviolet image taken of a preset part of the passenger, the preset part including at least the face and neck; spatially aligning the first image and the second image based on the first image to obtain a second aligned image, wherein the second aligned image is the spatially aligned second image; determining the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image; and performing a sun protection control operation based on the sunscreen thickness value.

[0006] Furthermore, acquiring the first and second images of the passenger in the vehicle includes: in response to the opening of the sun visor at the passenger position in the vehicle, acquiring the first and second images of the passenger in the vehicle, wherein the components integrated inside the sun visor include at least one of the following: a red-green-blue camera, an ultraviolet camera, and an ultraviolet supplementary light source.

[0007] Further, acquiring the first and second images of the passenger in the vehicle includes: acquiring a third and a fourth image of the passenger; performing a first preprocessing operation on the third image to obtain the first image, wherein the first preprocessing operation includes: white balance adjustment, bilateral filtering for noise reduction, and histogram equalization; performing a second preprocessing operation on the fourth image to obtain the second image, wherein the second preprocessing operation includes: dark field correction, flat field correction, median filtering for noise reduction, Gaussian filtering for noise reduction, and fluorescence signal enhancement processing.

[0008] Further, using the first image as a reference, spatial alignment of the first image and the second image to obtain the second aligned image includes: performing target point detection on the first image to obtain the target point coordinates in the first image; determining the target protection area of ​​the first image based on the target point coordinates; spatially aligning the protection areas of the first image and the second image based on camera calibration parameters and the target protection area to obtain a second initial aligned image; and spatially aligning the protection areas of the first image and the second initial aligned image based on the target protection area and the target point coordinates to obtain the second aligned image.

[0009] Further, determining the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image includes: extracting the fluorescence intensity value corresponding to the target protection area in the second aligned image; determining the scaling factor and correction factor based on the preset calibration curve and sunscreen type; and calculating the sunscreen thickness value corresponding to the target protection area based on the fluorescence intensity value, scaling factor, and correction factor.

[0010] Further, the sun protection control operation based on the sunscreen thickness value includes: determining the standard fluorescence intensity value corresponding to the sunscreen thickness value based on a preset calibration curve; in response to the fluorescence intensity value being lower than the fluorescence intensity threshold, controlling the vehicle to display a first prompt message and / or broadcast a first prompt voice, wherein the fluorescence intensity threshold is determined based on the standard fluorescence intensity value, the first prompt message is used to display in text form that the sunscreen application in the target protection area is uneven, and the first prompt voice is used to broadcast in audio form that the sunscreen application in the target protection area is uneven; in response to the fluorescence coverage area of ​​the target protection area being less than the coverage area threshold, controlling the vehicle to display a second prompt message and / or broadcast a second prompt voice, wherein the coverage area threshold is determined based on the total area of ​​the target protection area, the second prompt message is used to display in text form that the amount of sunscreen used in the target protection area is insufficient, and the second prompt voice is used to broadcast in audio form that the amount of sunscreen used in the target protection area is insufficient.

[0011] Furthermore, the method also includes: in response to a fluorescence intensity value being higher than or equal to a fluorescence intensity threshold and a fluorescence coverage area being greater than or equal to a coverage area threshold, recording the time when sun protection meets the standard and the performance coefficient of the sunscreen; calculating the sunscreen protection duration based on the sunscreen performance coefficient and the current UV index; and determining the remaining protection duration of the sunscreen based on the sunscreen protection duration, the current time, and the time when sun protection meets the standard.

[0012] Furthermore, the method also includes: in response to the remaining sunscreen protection time being less than or equal to a protection time threshold, or in response to the vehicle entering a target risk area, obtaining the current status of the passenger, wherein the target risk area is an area with an ultraviolet index greater than or equal to an ultraviolet index threshold; in response to the passenger being in a resting state, controlling the vehicle to perform at least one of the following: closing the sunshade of the passenger seat, closing the sunroof sunshade, adjusting the light transmittance of the passenger seat window, and adjusting the seat back angle of the passenger seat; in response to the passenger not being in a resting state, controlling the vehicle to display a third prompt message, and / or broadcast a third prompt voice, wherein the third prompt message is used to display at least one of the following in text form: remaining sunscreen protection time, current ultraviolet index, remaining driving mileage in the target risk area, and area to be reapplied with sunscreen, and the third prompt voice is used to broadcast at least one of the following in audio form: remaining sunscreen protection time, current ultraviolet index, remaining driving mileage in the target risk area, and area to be reapplied with sunscreen.

[0013] Furthermore, the method also includes: updating the current UV index based on a preset time interval; in response to the difference between the current UV index before the update and the current UV index after the update being greater than a preset difference, calculating a corrected sunscreen protection duration based on the current UV index before the update, the current UV index after the update, and the sunscreen protection duration; and updating the sunscreen protection duration based on the corrected sunscreen protection duration.

[0014] According to another aspect of the embodiments of this application, a sun protection control device for an in-vehicle vehicle is also provided, comprising: an acquisition module, configured to acquire a first image and a second image of a passenger in the vehicle, wherein the first image is a tri-color image of a preset part of the passenger, and the second image is an ultraviolet image of a preset part of the passenger, the preset part including at least the face and neck; an alignment module, configured to spatially align the first image and the second image based on the first image to obtain a second aligned image, wherein the second aligned image is the spatially aligned second image; a determination module, configured to determine the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image; and a control module, configured to perform sun protection control operations based on the sunscreen thickness value.

[0015] According to another aspect of the embodiments of this application, a vehicle is also provided, including: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods in various embodiments of this application when it runs.

[0016] According to another aspect of the embodiments of this application, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored executable program, wherein, when the executable program is running, it controls the device where the computer-readable storage medium is located to perform the methods of various embodiments of this application.

[0017] According to another aspect of the embodiments of this application, a computer program product is also provided, including a computer program that, when executed by a processor, implements the methods of various embodiments of this application.

[0018] In this embodiment, a first image and a second image of a passenger in a vehicle are acquired. The first image is a tri-color image of a predetermined part of the passenger, and the second image is an ultraviolet image of the predetermined part of the passenger, including at least the face and neck. Then, using the first image as a reference, the first and second images are spatially aligned to obtain a second aligned image. The second aligned image is the spatially aligned second image. Subsequently, the sunscreen thickness value of the passenger in the second aligned image is determined based on the fluorescence intensity value. Finally, sun protection control operations are performed based on the sunscreen thickness value. This achieves precise quantification of sun protection effectiveness, thus realizing personalized and verifiable dynamic ultraviolet protection, and solving the technical problem of poor in-vehicle ultraviolet protection in related technologies. Attached Figure Description

[0019] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0020] Figure 1 This is a flowchart of a vehicle interior sun protection control method according to one embodiment of this application;

[0021] Figure 2 This is a flowchart illustrating the overall logic according to one embodiment of this application;

[0022] Figure 3 This is a flowchart of a smear detection and recoating reminder according to one embodiment of this application;

[0023] Figure 4 This is another flowchart of a sun protection control method for an in-vehicle according to one embodiment of this application;

[0024] Figure 5 This is a structural block diagram of a vehicle-mounted sun protection control device according to one embodiment of this application. Detailed Implementation

[0025] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0026] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0027] With the increasing demand for long-distance road trips, drivers and passengers are exposed to the in-vehicle environment for extended periods, making UV protection an important requirement for healthy travel. Traditional protection solutions are as follows:

[0028] Option 1: Based on weather and in-vehicle temperature and humidity data, the system uses a model to predict and control the temperature and humidity of the windows. Option 1 focuses on optimizing the overall vehicle environment temperature and humidity, without addressing the detection of sunscreen application status, sunscreen effectiveness management, or differentiation based on seating position. It is unrelated to the personalized health protection needs of the front passenger and is merely a general environmental regulation solution.

[0029] Option 2: Utilize the sunshade display screen to indicate areas requiring sun protection and trigger the function. Option 2 does not record the sunscreen application time or estimated effective period, and the reapplication prompt lacks data support, failing to provide comprehensive dynamic protection.

[0030] Option 3: Based on data from the vehicle's onboard UV sensor, the sunshade and windows are linked to provide shading. Option 3 focuses only on real-time UV response and single hardware control, without incorporating sunscreen application status detection or user-specific adaptation.

[0031] Option 4: Facial segmentation and smear imaging are performed by acquiring facial images using UV. However, the detection accuracy of this single-modal feature comparison analysis is limited. Option 4 is only suitable for static environments and cannot adapt to the complex lighting environment of dynamic vehicle environments.

[0032] It is evident that traditional sun protection solutions fail to consider long-distance driving scenarios and navigation routes, failing to anticipate peak UV intensity periods and corresponding times, making it impossible for users to plan sun protection in advance. Furthermore, traditional solutions lack precise monitoring and recording of sunscreen application time, evenness, and thickness, making it difficult to scientifically determine sunscreen effectiveness and reapplication timing. Moreover, traditional solutions do not incorporate differentiated protection strategies based on the co-driver's different states (resting or awake), resulting in a lack of targeted intervention. Additionally, traditional solutions lack a complete system encompassing "trip prediction - sunscreen application detection - state adaptation - closed-loop reminders," and are not adapted to the co-driver's specific hardware and comfort needs, failing to meet the personalized UV protection requirements of co-drivers on long journeys.

[0033] According to an embodiment of this application, a method embodiment of a sun protection control method for an in-vehicle is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0034] This embodiment provides a method for controlling sun protection inside a vehicle. Figure 1 This is a flowchart of a vehicle interior sun protection control method according to one embodiment of this application, such as... Figure 1 As shown, the process includes the following steps:

[0035] Step S11: Obtain a first image and a second image of the passenger in the vehicle. The first image is a three-color image of a preset part of the passenger, and the second image is an ultraviolet image of a preset part of the passenger, including at least the face and neck.

[0036] In this embodiment of the application, the first image refers to a three-primary-color (red, green, blue) image captured by a red-green-blue (RGB) camera, i.e., an RGB image, which is used to present the texture, color, and structural information of the face and neck of the passenger.

[0037] The second image refers to an ultraviolet image acquired by an ultraviolet camera (i.e., a UV camera) under ultraviolet illumination, which is used to capture the fluorescence signal generated by sunscreen under ultraviolet light excitation.

[0038] The preset areas include at least the face and neck of the passenger, which are the areas of exposure to ultraviolet radiation that are most vulnerable to damage from ultraviolet rays.

[0039] As can be seen, this application acquires RGB and UV images of the passenger in the vehicle. For example, after the vehicle is started, this application activates the RGB and UV cameras integrated in the sun visor. When the passenger opens the sun visor to apply sunscreen, RGB and UV images of the passenger's face and neck are simultaneously acquired, ensuring that the acquired images cover a preset area of ​​the passenger.

[0040] Therefore, this application can achieve non-contact and non-disruptive dual-modal data acquisition, and the acquired RGB images can provide structural references, while the acquired UV images can provide information on the distribution of sunscreen substances, providing a data foundation for subsequent sun protection control.

[0041] Step S12: Using the first image as a reference, spatially align the first image and the second image to obtain a second aligned image, wherein the second aligned image is the second image after spatial alignment.

[0042] In this embodiment of the application, spatial alignment refers to the precise matching of two images with different imaging principles (such as RGB images and UV images), different perspectives, or distortions at the pixel level through image registration technology (such as affine transformation of facial key points based on the MediaPipe Face Mesh algorithm), so that the same physical region is in the same position in the two images.

[0043] The second aligned image refers to the registered second image, that is, the registered UV image. The pixel coordinates of the second aligned image correspond exactly to the first image, thereby ensuring that the fluorescence intensity of each sun protection area can be accurately mapped to the corresponding face area.

[0044] As can be seen, this application uses the first image as a reference to spatially align the first image and the second image to obtain a second aligned image. For example, this application can utilize facial key points in the RGB image to construct a three-dimensional facial deformation model, calculate the spatial transformation matrix between the model and the UV image, and thus perform geometric correction on the UV image.

[0045] Therefore, this application can avoid the spatial misalignment problem of UV images caused by illumination, angle, and lens distortion, so that subsequent steps can accurately realize the zoned repainting prompts.

[0046] Step S13: Determine the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image.

[0047] In this embodiment, the fluorescence intensity value refers to the intensity of the visible fluorescence signal emitted by the organic components in the sunscreen under 365 (nm) ultraviolet light excitation, and the unit is brightness value.

[0048] Sunscreen thickness value refers to the actual physical thickness of sunscreen on the skin surface.

[0049] As can be seen, this application determines the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image. For example, this application extracts the average fluorescence intensity from different parts of the second aligned image, and then, in conjunction with the type of sunscreen used by the passenger, calculates the actual sunscreen thickness value for each part according to a sunscreen thickness algorithm.

[0050] Therefore, compared to the limitations of traditional solutions that only detect the presence or absence of sunscreen, this application achieves accurate non-contact measurement of sunscreen thickness in a vehicle-mounted scenario.

[0051] Step S14: Perform sun protection control operation based on sunscreen thickness value.

[0052] In this embodiment, the sun protection control operation refers to the feedback mechanism triggered according to the thickness value of the sunscreen, such as: reapplication prompts, i.e., prompting missing areas through touch screen, headrest speakers, and mobile application (Application, App); physical protection linkage, i.e., automatically closing the sunshade and reducing the light transmittance of the windows; and data recording, i.e. storing the thickness, time, and location for subsequent algorithm optimization.

[0053] As can be seen, this application determines the corresponding sun protection control operation based on the sunscreen thickness value. For example, if the sunscreen thickness corresponding to any part in the second aligned image is <0.1mm, a zone reapplication reminder is triggered.

[0054] In summary, this application achieves non-contact raw data acquisition of sun-exposed areas by obtaining a tri-color image (i.e., the first image) of the passenger's face and neck, and an ultraviolet image (i.e., the second image). Then, the two images are spatially aligned using the first image as a reference to obtain a second aligned image, ensuring precise spatial matching between the ultraviolet fluorescence signal and the facial features. Subsequently, based on the fluorescence intensity value of the second aligned image, the thickness of the sunscreen applied to the passenger is determined, transforming the subjective application behavior into a quantifiable and verifiable physical parameter. Finally, sun protection control operations are performed based on this thickness value, allowing protective intervention to directly respond to the actual protective effect, achieving personalized and verifiable dynamic ultraviolet protection, thus improving the effectiveness of in-vehicle ultraviolet protection.

[0055] In other words, this application constructs a closed loop of "collection-alignment-quantification-response" in the vehicle scenario, realizing objective quantification, zone identification and precise intervention of sun protection effect, and solving the technical problem of poor ultraviolet protection effect in the vehicle in traditional solutions.

[0056] The above steps of this application involve acquiring a first image and a second image of the passenger in the vehicle. The first image is a tri-color image captured of a predetermined area of ​​the passenger, and the second image is an ultraviolet image captured of the same predetermined area, including at least the face and neck. Then, using the first image as a reference, the first and second images are spatially aligned to obtain a second aligned image. This second aligned image is the spatially aligned second image. Next, the sunscreen thickness value of the passenger in the second aligned image is determined based on its fluorescence intensity value. Finally, sun protection control operations are performed based on the sunscreen thickness value. This achieves the goal of accurately quantifying sun protection effectiveness, thus realizing a personalized and verifiable dynamic ultraviolet protection effect, and solving the technical problem of poor in-vehicle ultraviolet protection in related technologies.

[0057] Optionally, in step S11, acquiring the first and second images of the passenger-side object in the vehicle may include the following steps:

[0058] Step S111: In response to the opening of the sun visor in the passenger seat of the vehicle, a first image and a second image of the passenger seat object in the vehicle are acquired, wherein the components integrated inside the sun visor include at least one of the following: a red-green-blue camera, an ultraviolet camera, and an ultraviolet supplementary light source.

[0059] In this embodiment, the sun visor in the passenger seat refers to a foldable sun visor on the passenger side of the vehicle used to block sunlight. In this application, the inner side of the sun visor in the passenger seat integrates image acquisition and lighting components, and is not a traditional sun visor used solely for physical shading.

[0060] The components integrated inside the sun visor include at least one of the following: a red-green-blue camera, an ultraviolet camera, and an ultraviolet supplementary light source. Among them, the red-green-blue camera (RGB camera) is a standard color image sensor used to capture images within the visible spectrum of the human eye, and is used as a structural reference in this application.

[0061] An ultraviolet (UV) camera is a dedicated image sensor that is sensitive to the 365nm wavelength band and can capture the fluorescence of sunscreen, but is not sensitive to visible light.

[0062] Ultraviolet supplementary light source refers to a narrow-band ultraviolet light-emitting diode (LED) light source with an emission wavelength of 365nm, which is fixed on the inside of the sun visor. It is used to stably excite the fluorescent components in sunscreen in low-light or backlight environments inside the car, ensuring the reliability of UV image signals.

[0063] Typically, the passenger in the front seat will open the sun visor when applying sunscreen. Therefore, this application will acquire a first image and a second image of the passenger in the vehicle when it detects that the sun visor in the front seat is open.

[0064] For example, when the passenger opens the sun visor to apply sunscreen, the infrared trigger sensor or mechanical switch embedded in the sun visor detects the opening action, and the system is immediately awakened. The RGB camera, UV camera and ultraviolet light source are activated simultaneously, and dual-modal image acquisition is completed to ensure that the image capture timing is synchronized with the passenger's application action, avoiding accidental triggering or delayed acquisition.

[0065] Therefore, this application uses the opening of the sun visor as a trigger condition, connecting it with the passenger's sun protection behavior to achieve non-disruptive startup, while avoiding the waste of computing power caused by continuous shooting. Furthermore, a stable, directional, and wavelength-precise excitation light source is provided through an ultraviolet supplementary light source, overcoming complex environmental problems such as fluctuations in in-vehicle lighting and sunlight interference, ensuring the consistency of UV image quality and fluorescence signal.

[0066] Optionally, in step S11 or step S111, acquiring the first and second images of the passenger-side object in the vehicle may include the following steps:

[0067] Step S1111: Obtain the third and fourth images of the co-driver object.

[0068] Step S1112: Perform a first preprocessing operation on the third image to obtain a first image. The first preprocessing operation includes: white balance adjustment, bilateral filtering for noise reduction, and histogram equalization.

[0069] Step S1113: Perform a second preprocessing operation on the fourth image to obtain a second image. The second preprocessing operation includes: dark field correction, flat field correction, median filtering for noise reduction, Gaussian filtering for noise reduction, and fluorescence signal enhancement processing.

[0070] In this embodiment, the third image refers to the original visible light image initially captured by the RGB camera inside the sun visor; that is, the third image refers to an RGB image without any processing. Therefore, the third image may be affected by uneven lighting inside the vehicle, lens glare, or low illumination.

[0071] The fourth image refers to the raw ultraviolet image initially captured by the UV camera inside the sunshade; that is, the fourth image is the UV image without any processing. Therefore, the fourth image may contain noise, background interference, non-fluorescent signals, and the influence of sensor dark current, resulting in weakened or obscured fluorescence information.

[0072] The first preprocessing operation refers to the image enhancement process for the third image, which includes: white balance adjustment, bilateral filtering for noise reduction, and histogram equalization. White balance adjustment corrects color distortion caused by color temperature shifts in the vehicle's interior lighting, restoring true skin tone and the accurate color of sunscreen. Bilateral filtering for noise reduction suppresses speckle interference caused by low light or sensor noise while preserving edge details. Histogram equalization enhances image contrast, making facial textures and contours clearer, thus improving the accuracy of subsequent facial landmark detection.

[0073] The second preprocessing operation refers to the processing flow for the fourth image, including dark field correction, flat field correction, median filtering denoising, Gaussian filtering denoising, and fluorescence signal enhancement. Dark field correction eliminates background shift by subtracting the inherent noise (dark current) of the sensor when there is no light. Flat field correction compensates for light intensity attenuation at lens edges and uneven sensor response, resulting in a more uniform image brightness distribution. Median filtering denoising effectively removes bright spots from the sensor while preserving fluorescence edges. Gaussian filtering denoising smooths high-frequency random noise and improves image continuity. Fluorescence signal enhancement uses thresholding and nonlinear stretching to enhance the brightness of fluorescent areas in the sunscreen and suppress non-fluorescent reflections, such as glass reflections and skin reflections.

[0074] For example, after the sun visor on the passenger side is opened, the system first captures a third image (original RGB image) and a fourth image (original UV image) using the integrated RGB and UV cameras, respectively. Then, the third image is sequentially processed with white balance adjustment, bilateral filtering for denoising, and histogram equalization to obtain the first image. This first image is an optimized RGB image with high signal-to-noise ratio, accurate color, and enhanced contrast, providing a reliable structural reference for subsequent face segmentation and spatial alignment. Simultaneously, the fourth image is sequentially processed with dark field correction, flat field correction, median filtering for denoising, Gaussian filtering for denoising, and fluorescence signal enhancement to obtain the second image. This second image is an optimized UV image with a clean background, prominent fluorescence signal, and significantly improved signal-to-noise ratio, ensuring that the fluorescence intensity value accurately reflects the sunscreen thickness, rather than environmental interference.

[0075] Therefore, by preprocessing the images initially acquired by the RGB and UV cameras, the interference of complex lighting inside the vehicle is overcome, the quality of the RGB images is improved, and UV fluorescence image enhancement is achieved in the dynamic environment of the vehicle, ensuring the accuracy and robustness of subsequent spatial alignment and thickness calculation.

[0076] Optionally, in step S12, spatially aligning the first image and the second image based on the first image to obtain the second aligned image may include the following steps:

[0077] Step S121: Target point detection is performed on the first image to obtain the coordinates of the target points in the first image.

[0078] Step S122: Determine the target protection area of ​​the first image based on the target point coordinates.

[0079] Step S123: Based on the camera calibration parameters and the target protection area, the first image and the second image are spatially aligned to obtain a second initial aligned image.

[0080] Step S124: Based on the target protection area and target point coordinates, the first image and the second initial alignment image are spatially aligned to obtain the second alignment image.

[0081] In this embodiment of the application, target point detection refers to using the MediaPipe Face Mesh algorithm to detect multiple three-dimensional target points on the face in the first image, such as detecting 468 anatomical feature points covering the area around the eyes, nose, cheekbones, jaw, and neck.

[0082] The target point coordinates refer to the two-dimensional pixel coordinates of the aforementioned three-dimensional target point in the image plane. The target point coordinates are used to form a digital representation of the geometric structure of the face.

[0083] For example, the system of this application calls the MediaPipe Face Mesh model to perform real-time facial key point recognition on the first image, identifying 468 pixel-level 3D target points to form a complete facial contour and structural topology, which serves as the geometric reference for subsequent region segmentation and image registration. Thus, this application can achieve non-contact, high-precision facial structure modeling, adapting to real-world in-vehicle scenarios such as multiple poses of the passenger seat, low light, and the wearing of sunglasses.

[0084] The target protection area refers to multiple key protection areas automatically segmented based on the coordinates of the aforementioned target points. For example, the target protection area includes seven key protection areas: forehead, left cheek, right cheek, bridge of nose, chin, front of neck, and back of neck.

[0085] For example, the system of this application uses the bridge of the nose as the center, combined with target points such as the brow bone, cheekbone, and jawline, and uses triangulation or contour fitting algorithms to divide the face into 7 independent target protection areas. This achieves zone-level protection assessment, and compared to traditional overall detection, this application can accurately locate which areas are uncoated and how well they are coated in a vehicle-mounted environment.

[0086] Camera calibration parameters refer to the extrinsic parameter matrix (relative pose) and intrinsic parameter matrix (focal length, principal point, distortion coefficient) between the RGB camera and the UV camera, obtained through a standard calibration board before leaving the factory or during system initialization. These parameters are used to describe the spatial relationship between the two cameras.

[0087] The second initial aligned image refers to the aligned version obtained by performing a preliminary affine transformation or projection transformation on the original UV image (second image) according to the camera calibration parameters, but the second initial aligned image does not take into account changes in face pose.

[0088] For example, the system of this application uses calibration parameters to transform the second image (original UV image) from the UV camera coordinate system to the RGB camera coordinate system, and performs a coarse spatial transformation by combining the geometric center or boundary points of multiple target protection areas, so that the UV image as a whole roughly overlaps with the RGB image in the picture, thus obtaining the second initial aligned image.

[0089] The second aligned image is the final output UV image that corresponds completely to the first image in pixel-level space, ensuring that the fluorescence signal of each target protection area is precisely matched with the corresponding human body part in the RGB image.

[0090] For example, this application uses the boundary points of the target protection area and the coordinates of the target point to perform local fine-tuning on the second initial alignment image through affine transformation or thin plate spline (TPS) interpolation, thereby achieving fine alignment. That is, the system of this application uses the boundary points of multiple target protection areas in the first image as references to perform non-rigid fine-tuning on the second initial alignment image, so that the fluorescence distribution of each region in the second initial alignment image is completely aligned with the corresponding face region in the RGB image, generating the final second alignment image.

[0091] This enables subpixel-level precise registration, overcoming local misalignment caused by dynamic interference such as slight head movements of the passenger or seat tilt.

[0092] Optionally, in step S23, determining the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image may include the following steps:

[0093] Step S231: Extract the fluorescence intensity value corresponding to the target protection area in the second aligned image.

[0094] Step S232: Determine the proportional coefficient and correction coefficient based on the preset calibration curve and sunscreen type.

[0095] Step S233: Calculate the sunscreen thickness value corresponding to the target protection area based on the fluorescence intensity value, the proportionality coefficient, and the correction coefficient.

[0096] In this embodiment of the application, the fluorescence intensity value refers to the average gray value (or brightness value) of all effective pixels in each target protection area in the second aligned image, and the fluorescence intensity value represents the intensity of the fluorescence signal emitted by the sunscreen after being excited by ultraviolet light.

[0097] For example, the system of this application extracts all effective pixels in each target protection area in the second aligned image according to the pixel mask of the divided target protection areas, and then removes interference points such as reflections and noise, and calculates the average fluorescence intensity value of each target protection area as the fluorescence intensity value of the target protection area.

[0098] The preset calibration curve is a mathematical relationship curve between fluorescence intensity I and thickness d, obtained by linear fitting of standard samples of different thicknesses (e.g., 0.02mm, 0.05mm, 0.1mm, 0.15mm, 0.2mm) prepared using mainstream sunscreens on the market (e.g., Sun Protection Factor (SPF) 50+, Protection Grade of UVA (PA) ++++, etc.). Fluorescence intensity was collected under the same UV light source and shooting distance. The mathematical expression of the preset calibration curve is: Thickness d = Proportionality coefficient k × Fluorescence intensity I + Correction coefficient b.

[0099] The proportionality coefficient k represents the thickness increment corresponding to a unit fluorescence intensity, and is used to reflect the fluorescence response sensitivity of sunscreen.

[0100] The correction factor b represents the thickness offset when the fluorescence intensity is 0, and is used to correct system reference errors, such as background fluorescence and sensor zero-point drift.

[0101] The sunscreen type refers to the brand and model information that the passenger manually enters or obtains from the sunscreen bottle via Optical Character Recognition (OCR). Different sunscreen types with different ingredients have different proportional coefficients k and correction coefficients b.

[0102] For example, the system of this application extracts the proportional coefficient k and correction coefficient b corresponding to the type of sunscreen used by the passenger based on a preset calibration curve. By differentiating the calibration of different sunscreen products, the accuracy of thickness calculation is significantly improved.

[0103] Then, the fluorescence intensity value I of each target protection area, along with the proportional coefficient k and correction coefficient b of the corresponding sunscreen type, are substituted into the mathematical expression of the preset calibration curve to calculate the actual sunscreen thickness value of each target protection area, thereby achieving objective quantification of the sun protection effect.

[0104] Optionally, in step S14, performing the sun protection control operation based on the sunscreen thickness value may include the following steps:

[0105] Step S141: Determine the standard fluorescence intensity value corresponding to the sunscreen thickness value based on the preset calibration curve.

[0106] Step S142, in response to the fluorescence intensity value being lower than the fluorescence intensity threshold, control the vehicle to display a first prompt message and / or broadcast a first prompt voice, wherein the fluorescence intensity threshold is determined based on a standard fluorescence intensity value, the first prompt message is used to display in text form that the sunscreen is not applied evenly in the target protection area, and the first prompt voice is used to broadcast in audio form that the sunscreen is not applied evenly in the target protection area.

[0107] In step S143, in response to the fluorescent coverage area of ​​the target protection area being less than the coverage area threshold, the vehicle is controlled to display a second prompt message and / or broadcast a second prompt voice, wherein the coverage area threshold is determined based on the total area of ​​the target protection area, the second prompt message is used to display in text form that the amount of sunscreen used in the target protection area is insufficient, and the second prompt voice is used to broadcast in audio form that the amount of sunscreen used in the target protection area is insufficient.

[0108] In this embodiment of the application, the standard fluorescence intensity value refers to the theoretical fluorescence intensity value corresponding to different sunscreen thicknesses. The standard fluorescence intensity value corresponding to different sunscreen thicknesses can be determined by a preset calibration curve.

[0109] For example, the system of this application calculates the theoretical standard fluorescence intensity value corresponding to each target protection area in reverse based on the sunscreen thickness value corresponding to each target protection area and the preset calibration curve corresponding to the type of sunscreen currently used.

[0110] The fluorescence intensity threshold is a threshold determined based on the standard fluorescence intensity value, such as 80% of the standard fluorescence intensity value. This threshold can be determined according to actual conditions and is not restricted here. The fluorescence intensity threshold is used to determine whether the coating is uniform and thick enough. For example, if the fluorescence intensity value of any target protection area is lower than 80% of the standard fluorescence intensity value, it is considered uneven coating.

[0111] The first prompt message can be a text message displayed on the central control screen or the sun visor touch screen, such as "The fluorescence intensity on the left cheek is too low, and the sunscreen thickness is insufficient." The first prompt voice can be a voice prompt played by the headrest directional speaker, such as "Please focus on reapplying sunscreen to the left cheek, as the application is not up to standard." This is just an example and is not a limitation.

[0112] For example, the system of this application compares the fluorescence intensity value of each target protection area with a fluorescence intensity threshold. If the fluorescence intensity value of a target protection area is lower than the fluorescence intensity threshold, it is determined that the sunscreen application in that target protection area is uneven or insufficient in thickness. At this time, the system can display a first prompt message in the corresponding area of ​​the sun visor touch screen or the central control screen, and simultaneously play a first prompt voice message towards the passenger side through the headrest directional speakers to guide the passenger to apply sunscreen evenly.

[0113] Fluorescent coverage area refers to the proportion of pixels in the target protection area whose fluorescence intensity is higher than the background noise in the second aligned image. Fluorescent coverage area is used to reflect whether the sunscreen evenly covers the target protection area.

[0114] The coverage area threshold is determined based on the total area of ​​the target protection area, such as 90% of the total area. This threshold can be determined according to the actual situation and is not restricted here. For example, if the fluorescence coverage area of ​​the target protection area is less than 90% of the total area, it is considered insufficient.

[0115] The second prompt message can be a text message displayed on the central control screen or the sun visor touch screen, such as "The coverage area on the back of the neck is less than 85%, it is recommended to reapply". The second prompt voice can be a voice prompt played by the headrest directional speaker, such as "The sun protection coverage on the back of the neck is incomplete, please reapply". This is just an example and is not a limitation.

[0116] For example, the system of this application binarizes the UV image of each target protection area and calculates the proportion of fluorescent pixels to the total pixels of the target protection area, that is, the proportion of the fluorescent coverage area of ​​the target protection area to the total area. If this proportion is less than 90%, it is determined that the amount of sunscreen used is insufficient. At this time, the system can display a second prompt message in the corresponding area of ​​the sun visor touch screen or the central control screen, and simultaneously play a second prompt voice message towards the passenger side through the headrest directional speakers to guide the passenger to apply sunscreen in a targeted manner.

[0117] Therefore, this application judges whether the coating is even enough based on thickness and whether the coating is comprehensive enough based on coverage. It also provides zoned, precise, and non-intrusive touch-up reminders through text and directional voice, thus avoiding misjudgments.

[0118] Optionally, the method may further include the following execution steps:

[0119] Step S144: In response to the fluorescence intensity value being higher than or equal to the fluorescence intensity threshold and the fluorescence coverage area being greater than or equal to the coverage area threshold, record the time when sun protection meets the standard and the performance coefficient of the sunscreen.

[0120] Step S145: Calculate the duration of sun protection based on the sunscreen performance factor and the current UV index.

[0121] Step S146: Determine the remaining protection time of the sunscreen based on the sunscreen protection duration, the current time, and the time when the sun protection standard is met.

[0122] In this embodiment of the application, the moment when the sun protection meets the standard refers to the moment when all target protection areas simultaneously meet the standards for sunscreen thickness and fluorescence coverage area, and this moment when the sun protection meets the standard is accurate to at least the minute.

[0123] The performance factor of sunscreen refers to the SPF and PA ratings of sunscreen obtained from input by the passenger or OCR recognition.

[0124] For example, when the system confirms that the fluorescence intensity value of all target protection areas of the co-driver is higher than or equal to the fluorescence intensity threshold and the fluorescence coverage area is greater than or equal to the coverage area threshold, the system will record the current system time as the time when the sun protection meets the standard, and at the same time extract and store the performance coefficient of the sunscreen currently used by the co-driver.

[0125] The current UV index refers to the ambient UV intensity value collected in real time by the vehicle's onboard UV sensor after the vehicle is started.

[0126] Sunscreen protection duration refers to the theoretical duration for which this type of sunscreen can effectively protect against UV rays under the current UV environment. For example, the formula for calculating sunscreen protection duration in this application is: Sunscreen protection duration T = Basic protection duration × SPF factor × PA factor ÷ Current UV index U0.

[0127] The basic protection duration is a preset duration, such as 120 minutes, and is not limited here. Typically, SPF50 corresponds to an SPF factor of 2.5, SPF30 to 1.8, and SPF20 to 1.2. PA++++ corresponds to a PA factor of 2.0, PA+++ to 1.5, and PA++ to 1.0.

[0128] For example, if the passenger in the front seat uses sunscreen with SPF50 and PA++++, and the current UV index U0=6, then the sunscreen protection time T=120×2.5×2.0÷6=100 minutes. This 100 minutes is the theoretical effective protection time of the sunscreen under the current conditions.

[0129] Therefore, this application enables dynamic protection duration calculation based on real-time UV environment in vehicle environment, making protection assessment scientific and personalized.

[0130] The remaining protection time of sunscreen refers to the remaining time from the current moment when the sunscreen can still provide effective protection. For example, the formula for calculating the remaining protection time of sunscreen in this application is: Remaining protection time of sunscreen = Remaining protection time of sunscreen - Current moment - Time when sun protection is achieved T0.

[0131] For example, after calculating the remaining protection time of the sunscreen based on the sunscreen protection duration, the current time, and the time when the sun protection standard is met, the remaining protection time of the sunscreen can be updated in real time on the vehicle display screen and mobile APP to achieve dynamic updating of the remaining protection time of the sunscreen.

[0132] Optionally, the method may further include the following execution steps:

[0133] Step S147: In response to the remaining protection time of the sunscreen being less than or equal to the protection time threshold, or in response to the vehicle entering the target risk area, obtain the current status of the passenger, wherein the target risk area is an area where the UV index is greater than or equal to the UV index threshold.

[0134] In step S148, in response to the passenger being in a resting state, the vehicle is controlled to perform at least one of the following: close the sunshade of the passenger seat, close the sunroof sunshade, adjust the light transmittance of the passenger seat window, or adjust the seat back angle of the passenger seat.

[0135] In step S149, in response to the co-driver not being in a resting state, the vehicle is controlled to display a third prompt message and / or to play a third prompt voice message, wherein the third prompt message is used to display at least one of the following in text form: remaining sunscreen protection time, current UV index, remaining driving range of the target risk area, and area to be reapplied sunscreen, and the third prompt voice message is used to play at least one of the following in audio form: remaining sunscreen protection time, current UV index, remaining driving range of the target risk area, and area to be reapplied sunscreen.

[0136] In this embodiment of the application, the protection duration threshold is a preset threshold, such as 30 minutes, which is determined according to the actual situation and is not limited here.

[0137] The target risk area refers to the region along the vehicle's navigation path where the UV index is greater than or equal to the UV index threshold. Examples include sunny days, east-west unobstructed highway sections, and other geographically high-intensity areas with a high risk of exposure. The UV index threshold is a pre-set threshold, for example, set to 6. Areas with a UV index ≥ 6 are considered target risk areas and require proactive protection.

[0138] The current state of the passenger can be determined by capturing facial images of the passenger through a camera, and combining these images with the frequency of eyelid closure, pupil state, and head posture, using image analysis algorithms to determine whether the passenger is resting or awake.

[0139] For example, the system of this application continuously monitors the remaining protection time of sunscreen and the vehicle's driving area. If the remaining protection time of sunscreen is less than or equal to the protection time threshold, or if the vehicle enters the target risk area, the system calls the camera in the passenger area to collect the facial image of the passenger. By analyzing the frequency of eyelid closure and the pupil contraction state of the passenger, the system comprehensively judges whether the passenger is in a resting state.

[0140] When the system determines that the passenger is resting, to avoid disturbing them via voice or pop-up windows, this application will automatically activate non-intrusive physical protection, sending vehicle control commands to execute at least one of the following actions: completely closing the passenger-side sunshade, simultaneously closing the sunroof sunshade, adjusting the window light transmittance to the lowest level (e.g., 10%), and slightly adjusting the seat back angle (e.g., 5°–10°) to bring the head closer to the headrest, thus increasing the area of ​​shading. All operations are performed silently, without any prompts or screen pop-ups. This achieves a non-intrusive, highly protective, and proactively caring healthy travel experience.

[0141] If the passenger in the front seat is found to have their eyes open, their head facing forward, or are moving their limbs, it is determined that the passenger is not in a resting state.

[0142] The third prompt message can be a text message displayed on the central control screen or sun visor touchscreen, including at least one of the following: remaining sunscreen protection time, the current UV index, the remaining driving distance in the target risk area, and the area where sunscreen needs to be reapplied. The third prompt voice message can be a voice prompt played by the headrest directional speaker, such as "Your sunscreen has 22 minutes of effective time remaining, the current UV index is 7.2, the remaining driving distance in the high UV intensity area is 10 kilometers, it is recommended to reapply SPF50 sunscreen, focusing on covering the jawline and the back of the neck." This is just an example and is not a limitation.

[0143] When the system determines that the passenger in the front seat is not at rest, it activates a multimodal proactive alert mechanism. This includes highlighting the remaining time, current UV value, remaining mileage, and areas requiring repainting on the central control screen or sun visor touchscreen. Simultaneously, it plays voice prompts only towards the passenger through the headrest-mounted speakers to avoid disturbing the driver. Furthermore, a repainting notification can be simultaneously pushed to the linked mobile app. This multimodal collaborative alert improves information reception, and the targeted broadcast ensures a quiet environment, avoiding the impact of a full-vehicle broadcast on the driver and other passengers.

[0144] If the passenger in the front seat is not at rest and does not respond to the prompts, the system can repeat the prompts every 5 minutes until the passenger completes the reapplication check or the remaining sunscreen protection time is reduced to zero.

[0145] Optionally, the method may further include the following execution steps:

[0146] Step S150: Update the current UV index based on a preset time interval.

[0147] Step S151: In response to the difference between the current UV index before the update and the current UV index after the update being greater than a preset difference, calculate the corrected sunscreen protection duration based on the current UV index before the update, the current UV index after the update, and the sunscreen protection duration.

[0148] Step S152: Update the sunscreen protection duration based on the corrected sunscreen protection duration.

[0149] In this embodiment of the application, the preset time interval can be set to automatically read the ambient ultraviolet intensity data from the vehicle-mounted ultraviolet sensor every 5 minutes, that is, to obtain the current UV index every 5 minutes. The preset time interval is determined according to the actual situation and is not limited here.

[0150] The previous UV index refers to the UV index recorded earlier and is used to compare with the current UV index to determine the magnitude of the change.

[0151] For example, the system of this application reads the latest output value of the vehicle-mounted ultraviolet sensor every 5 minutes and uses the latest output value as the new current ultraviolet index, so as to realize high-frequency, stable and automated environmental UV index monitoring, while avoiding the waste of computing power or sensor drift caused by frequent sampling.

[0152] The preset difference refers to the threshold value for UV index change set by the system. For example, the preset difference can be set to 1, which means that when the difference between the current UV index before the update and the current UV index after the update is greater than 1, the correction mechanism is triggered.

[0153] The revised sunscreen protection duration is a new, more realistic effective duration calculated based on the previous and updated UV indexes and the current sunscreen protection duration. For example, the formula for calculating the revised sunscreen protection duration is: Revised sunscreen protection duration = Sunscreen protection duration T × Previous current UV index U0 ÷ Updated current UV index Ut.

[0154] For example, if U0=6 and Ut=7, then the corrected sunscreen protection time = sunscreen protection time T × 6 ÷ 7, thus avoiding protection failure or excessive warnings due to changes in UV intensity. Afterwards, the system will update the sunscreen protection time based on the calculated corrected sunscreen protection time, overwriting historical values. This achieves an online dynamic closed-loop update of the sunscreen protection time.

[0155] In summary, this application proposes a dynamic ultraviolet protection method for the co-pilot in a travel scenario, which includes the following four stages.

[0156] Trip prediction stage: After the vehicle starts, the complete driving route, departure time and estimated arrival time are obtained through the vehicle navigation and positioning module. Combined with ultraviolet prediction data, a three-dimensional risk curve of "road segment-time-UV index" is generated, high-risk road segments and corresponding times are marked, and reminders are pushed in advance.

[0157] Sunscreen application detection stage: The Red Green Blue – Ultraviolet (RGB-UV) dual-modal detection module is activated to perform professional preprocessing on the acquired images (white balance, noise reduction, and contrast enhancement for RGB images, and fluorescence signal purification for UV images). Seven key protection areas are segmented through facial key point detection, and spatial alignment is achieved through RGB-UV dual-modal image registration. Based on the principle that "the fluorescence intensity of sunscreen under 365nm UV light is proportional to its thickness," the fluorescence intensity is converted into an actual thickness value through a calibration curve. Combined with the sun protection level (0-3) and coverage (≥90%), it is determined whether the standard thickness (≥0.1mm) has been reached. If the standard is not met, a reminder to reapply to the affected area is sent.

[0158] Dynamic validity calculation and differentiated protection phase: After passing the test, the application time and sunscreen SPF / PA rating are recorded. Combining the sunscreen SPF / PA rating and real-time UV index, the initial effective period is calculated using a composite algorithm. During driving, the UV index is updated in real time by the onboard UV sensor, dynamically correcting the remaining effective time. When the remaining time is less than or equal to the threshold or when entering a high-risk area, the passenger's status is identified through camera and millimeter-wave radar fusion. When the passenger is resting, hardware such as independent sunshades and adjustable light transmittance windows are activated to form undisturbed physical protection. When the passenger is awake, multimodal prompts provide information for reapplication.

[0159] Trip data storage stage: After the trip is completed, UV risk curves, smear detection data, protective intervention logs, etc. are stored in local cache and cloud server to support algorithm optimization and personalized adaptation.

[0160] As can be seen, this application breaks through the limitations of traditional solutions in real-time response by integrating navigation and meteorological data into a risk prediction structure, allowing users to plan the timing of sunscreen application in advance.

[0161] This application utilizes an RGB-UV dual-modal sunscreen detection module. Through image preprocessing, face region segmentation, dual-modal registration, fluorescence intensity-thickness calibration, and quantification, it achieves accurate detection of the uniformity, thickness, coverage, and amount of sunscreen applied to key areas such as the face and neck of the passenger. Combined with a zoned reapplication prompt function, it effectively solves the problems of traditional solutions lacking application status detection and lacking data support for reapplication, ensuring that the sunscreen effect meets the standards from the source.

[0162] This application utilizes a camera-based state perception structure to accurately identify whether the passenger is resting or awake and implement differentiated protection accordingly. When resting, it automatically activates the physical protection structure of an independent sunshade and adjustable light-transmitting windows to create a non-intrusive protective barrier, avoiding the drawbacks of traditional solutions where a single protection mode can easily disturb the user. When awake, it uses a multi-modal prompt structure through headrest-oriented speakers, touchscreen pop-ups, and mobile app push notifications to simultaneously display the remaining time, current UV index, and key areas for repainting. This solves the problems of traditional solutions having a single prompt method and low reach, fully adapting to the diverse needs of the passenger.

[0163] This application's closed-loop structure of "trip prediction - sunscreen application detection - dynamic protection - data storage," combined with a dynamic correction algorithm for the remaining sunscreen duration, not only ensures the accuracy of protection throughout long-distance travel by updating data in real time and accurately correcting the effective period through the vehicle's UV sensor, but also guarantees the effectiveness of UV protection throughout long-distance travel. Through data iteration, the system's accuracy is continuously optimized, and personalized protection capabilities are constantly enhanced, achieving a long-term upgrade in the protection experience.

[0164] Figure 2 This is a flowchart illustrating the overall logic according to one embodiment of this application, such as... Figure 2 As shown, the system first performs a UV risk prediction for the entire trip, integrating navigation and UV data to generate a risk curve. Next, it performs sunscreen application detection and reapplication reminders, using dual-modal technology to detect indicators such as uniformity and thickness to ensure basic protection meets standards. Then, it implements dynamic sunscreen failure management, correcting failures in real time and providing differentiated protection based on user status. Finally, it stores all data for algorithm iteration, forming a long-term optimization mechanism.

[0165] Right now, Figure 2 The core closed-loop logic of this application, namely "prediction-detection-protection-storage", is clearly presented. Each stage is progressive, realizing full-process protection from early prediction to long-term optimization.

[0166] Specifically, Figure 3 This is a flowchart of a smear detection and touch-up reminder according to one embodiment of this application, such as... Figure 3 As shown, the RGB-UV dual-modal detection module is activated first. When the passenger opens the sun visor, the infrared trigger sensor built into the sun visor automatically activates the detection module. The RGB-UV dual-modal detection module includes a high-definition RGB camera, a UV camera, and a UV supplementary light source, all of which are integrated on the inside of the sun visor to ensure that the shooting angle covers the key areas of the passenger's face and neck.

[0167] Then, image preprocessing optimization is performed: for RGB images, white balance adjustment, bilateral filtering for noise reduction, and CLAHE adaptive histogram equalization are performed sequentially. For UV images, dark field correction, flat field correction, median + Gaussian filtering for noise reduction, and adaptive fluorescence detail enhancement are performed sequentially to ensure that both types of images meet the detection accuracy requirements.

[0168] Next, facial landmark detection and RGB-UV image registration are performed. The MediaPipe Face Mesh algorithm is used to detect facial landmarks in the preprocessed RGB image, accurately locating key feature points such as the eyes, facial contours, and neck. Based on the coordinates of the detected 468 landmarks, seven key protection regions are automatically segmented: forehead, left and right cheeks, nose, chin, jawline, front of neck, and back of neck, laying the foundation for regional detection. Coarse registration is performed based on camera calibration parameters, followed by fine registration based on the affine transformation matrix estimated from the facial landmarks. The registration error is <3 pixels, with a success rate ≥90%, ensuring spatial alignment of the key protection regions between the RGB and UV images and avoiding detection bias.

[0169] Next, the fluorescence intensity value of the UV image was extracted. That is, the fluorescence intensity value of the registered UV image was extracted from the seven segmented regions. Reflective interference points were removed, and the average fluorescence intensity of the effective pixels in each region was taken as the final intensity value of that region. A standard calibration curve was established. Standard samples with thicknesses of 0.02mm, 0.05mm, 0.1mm, 0.15mm, and 0.2mm were prepared by selecting mainstream sunscreens on the market. Fluorescence intensity values ​​were collected under the same UV light source and shooting distance, and the calibration curve was obtained by fitting. The formula is: thickness d=k×I+b (where k is the proportionality coefficient, I is the fluorescence intensity value, and b is the correction coefficient, which is dynamically adjusted according to different sunscreen types).

[0170] Next, the evenness and coverage of sunscreen application are evaluated by extracting the fluorescence intensity values ​​of key areas in the UV image and substituting them into a calibration curve to calculate the actual thickness value of each area. Furthermore, a "fluorescence intensity analysis + area comparison" technique is used to compare the fluorescence intensity of each area with preset standard values. If the fluorescence intensity of any area is lower than 80% of the standard value, it is considered uneven application. If the overall fluorescence coverage area is lower than 90% of the total area of ​​the key areas, it is considered insufficient application. The system uses a touchscreen to mark the substandard areas (e.g., "insufficient fluorescence intensity and thickness on the left cheek and back of the neck") and uses a headrest-mounted speaker to indicate the direction for reapplication. After the user reapplies, the system re-tests until all areas meet the standards.

[0171] Finally, the system records the test data. Once all areas meet the standards, the system records the thickness value, coverage, and first application time (accurate to the minute, denoted as T0) of each area, providing support for subsequent timeliness calculations.

[0172] Figure 4 This is another flowchart of a vehicle interior sun protection control method according to one embodiment of this application, such as... Figure 4 As shown, the complete execution process of this application is divided into three stages: "pre-trip preparation, in-trip monitoring, and trip end". The execution logic and technical details of each stage are as follows.

[0173] (a) The stage before the trip begins after the vehicle is started (preparation before the trip).

[0174] The vehicle navigation and positioning module acquires the complete driving route, departure time, estimated arrival time, and key geographical coordinates along the way, including areas prone to direct ultraviolet radiation such as highways, mountainous areas, and unobstructed open roads. The system connects to a meteorological information center or third-party meteorological platform via vehicle-to-everything (V2X) communication to obtain future ultraviolet (UV) forecast data for the areas traversed during the trip. It also integrates the following multi-dimensional data to achieve accurate predictions: 1. Road segment characteristic data: road direction (east-west / north-south), altitude, and distribution of surrounding obstructions (e.g., the proportion of obstruction by trees, mountains, and buildings); 2. Time dimension data: time period coefficients (10:00-14:00 × 1.1, other time periods × 0.9); 3. Meteorological auxiliary data: cloud cover rate (sunny × 1.0, cloudy × 0.7, overcast × 0.4). Through a weighted fusion algorithm (UV prediction value = basic UV prediction value × road segment coefficient × time coefficient × meteorological coefficient), a three-dimensional risk curve of "road segment-time-UV index" is generated, clearly marking high-risk periods with a UV index ≥ 6 and their corresponding geographical coordinates.

[0175] For example, if a user departs at 10:00, the navigation system will show that the user will be traveling on a certain highway section (east-west direction, altitude 500 meters, unobstructed view, sunny day) from 11:20 to 12:00. The basic UV prediction value is 6.8, and after coefficient correction, the UV prediction value is 7.5. The system will display a pop-up window on the screen saying, "This trip will be traveling on a certain road section from 11:20 to 12:00 (UV peak 7.5). It is recommended to apply SPF50+ and PA++++ sunscreen in advance." This will be accompanied by voice broadcasts and push notifications from the mobile app to ensure that the user is informed in a timely manner.

[0176] Sunscreen application detection validity period: After receiving the reminder, the user opens the sunshade and applies sunscreen; the system then processes the application as described above. Figure 3The system implements a detailed application detection and reapplication reminder process. Once the target is met, the system automatically records the first application time (accurate to the minute, denoted as T0) and the sunscreen rating (the user manually enters the SPF value and PA rating, or the system can automatically extract relevant parameters by taking a picture of the sunscreen bottle label with a camera and using OCR recognition technology). Combined with the real-time UV index (denoted as U0), the effective period is calculated using a composite algorithm: "Effective period (T) = Basic protection duration (120 minutes) × SPF coefficient (SPF50 corresponds to 2.5, SPF30 corresponds to 1.8, SPF20 corresponds to 1.2) × PA coefficient (PA++++ corresponds to 2.0, PA+++ corresponds to 1.5, PA++ corresponds to 1.0) ÷ U0 real-time UV index coefficient".

[0177] (ii) Monitoring during the trip.

[0178] Dynamic Timeliness Correction: The system collects the current environmental UV index (denoted as Ut) in real time through the vehicle-mounted ultraviolet sensor and updates it every 5 minutes. If the difference between Ut and the initial U0 exceeds 1, the system automatically triggers timeliness correction, recalculates the effective duration according to "corrected effective period = initial effective period × U0 ÷ Ut", and updates the remaining effective time synchronously to ensure the accuracy of timeliness judgment.

[0179] The system identifies the passenger's status and provides differentiated protection. When the remaining valid time is ≤30 minutes, or when the vehicle is driving in a high-risk area, the system automatically initiates a protection process: it captures eye images through the passenger-side camera, analyzes eyelid closure frequency and pupil status, and determines whether the user is resting. If the user is determined to be resting, the system automatically activates the hardware control module and sends control commands: the independent sunshade is completely closed, the sunroof sunshade is closed, the window light transmittance is adjusted, and the seat back angle is slightly adjusted to increase head protection, forming a comprehensive physical protection barrier without triggering voice or pop-up prompts to avoid disturbing the user's rest. If the user is determined to be awake, the system will initiate a multimodal reapplication prompt: the headrest directional speaker will play a personalized voice message saying, "Your sunscreen has 25 minutes of remaining effective time. The current UV index is 7. It is recommended to reapply SPF50+ sunscreen, focusing on protecting the jawline and neck." The touchscreen will display a pop-up message including the remaining effective time, the current UV index, and the remaining driving range for high-risk areas, while also marking the key areas for reapplication. The linked mobile app will simultaneously push a reapplication notification. These three prompts will continue to trigger until the user completes the reapplication check or the remaining effective time reaches zero.

[0180] (iii) End of the trip.

[0181] The system monitors the in-vehicle navigation's trip status in real time. If the navigation indicates arrival at the destination or the user manually closes the navigation, the trip is considered complete. If the trip is not yet complete, it returns to the in-trip phase for continuous monitoring and looping. After the trip ends, the system automatically summarizes and stores relevant data, including UV risk distribution curves, application time, detection data for each area, intervention operation logs (hardware linkage records, prompt trigger records), and user status change data. This data is simultaneously stored in local cache and on the cloud server. The stored data serves two purposes: first, it allows users to query historical trip protection records via a mobile app; second, it provides data support for the system to subsequently optimize UV ​​risk prediction algorithms, application detection accuracy, and prompt timing and methods, continuously improving the system's personalized adaptability.

[0182] Therefore, this application can predict in advance the high-risk sections and times of ultraviolet radiation during long journeys, allowing the passenger in the front seat to prepare for sun protection in advance and improve the foresight of protection.

[0183] This application can accurately detect the uniformity and amount of sunscreen applied by the passenger in the front seat. Through RGB-UV dual-modal fusion, quantitative grading, zone detection and sunscreen thickness quantification, it can accurately detect whether the uniformity, coverage, amount and standard thickness of sunscreen application meet the standards, solving the problem of insufficient disclosure in traditional solutions and ensuring that the protective effect meets the standards.

[0184] This application can combine the dynamic changes of UV index during driving to establish a scientific calculation and dynamic correction scheme for sun protection time, clarify the calculation logic and correction mechanism of the remaining time, and provide differentiated protection schemes for different states of the passenger in the front seat, such as resting or waking up, so as to achieve accurate time management throughout the entire process.

[0185] This application can form a closed-loop protection system throughout the entire process. Through multimodal prompts and dedicated hardware linkage, it ensures that the recoating prompts are accurately delivered, while storing the protection data of the process to support subsequent optimization.

[0186] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0187] According to an embodiment of this application, an apparatus embodiment for a vehicle interior sun protection control method is provided. It should be noted that the apparatus can be used to execute the above-described vehicle interior sun protection control method.

[0188] Figure 5This is a structural block diagram of a vehicle interior sun protection control device according to one embodiment of this application, such as... Figure 5 As shown, the sun protection control device in the vehicle includes: an acquisition module 501, used to acquire a first image and a second image of a passenger in the vehicle, wherein the first image is a tri-color image taken of a preset part of the passenger, and the second image is an ultraviolet image taken of a preset part of the passenger, the preset part including at least the face and neck; an alignment module 502, used to spatially align the first image and the second image based on the first image to obtain a second aligned image, wherein the second aligned image is the second image after spatial alignment; a determination module 503, used to determine the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image; and a control module 504, used to perform sun protection control operations based on the sunscreen thickness value.

[0189] Furthermore, the acquisition module 501 is also used to: in response to the opening of the sun visor in the passenger seat of the vehicle, acquire a first image and a second image of the passenger seat object in the vehicle, wherein the components integrated inside the sun visor include at least one of the following: a red-green-blue camera, an ultraviolet camera, and an ultraviolet supplementary light source.

[0190] Furthermore, the acquisition module 501 is also used to: acquire a third image and a fourth image of the co-driver object; perform a first preprocessing operation on the third image to obtain a first image, wherein the first preprocessing operation includes: white balance adjustment, bilateral filtering for noise reduction, and histogram equalization; perform a second preprocessing operation on the fourth image to obtain a second image, wherein the second preprocessing operation includes: dark field correction, flat field correction, median filtering for noise reduction, Gaussian filtering for noise reduction, and fluorescence signal enhancement processing.

[0191] Furthermore, the alignment module 502 is also used to: perform target point detection on the first image to obtain the target point coordinates in the first image; determine the target protection area of ​​the first image based on the target point coordinates; perform protection area spatial alignment between the first image and the second image based on the camera calibration parameters and the target protection area to obtain a second initial aligned image; and perform protection area spatial alignment between the first image and the second initial aligned image based on the target protection area and the target point coordinates to obtain a second aligned image.

[0192] Furthermore, the aforementioned determining module 503 is also used to: extract the fluorescence intensity value corresponding to the target protection area in the second aligned image; determine the scaling factor and correction factor based on the preset calibration curve and sunscreen type; and calculate the sunscreen thickness value corresponding to the target protection area based on the fluorescence intensity value, scaling factor, and correction factor.

[0193] Furthermore, the aforementioned control module 504 is also configured to: determine the standard fluorescence intensity value corresponding to the sunscreen thickness value based on a preset calibration curve; in response to a fluorescence intensity value lower than a fluorescence intensity threshold, control the vehicle to display a first prompt message and / or broadcast a first prompt voice, wherein the fluorescence intensity threshold is determined based on the standard fluorescence intensity value, the first prompt message is used to display in text form that the sunscreen application in the target protection area is uneven, and the first prompt voice is used to broadcast in audio form that the sunscreen application in the target protection area is uneven; in response to a fluorescence coverage area of ​​the target protection area being less than a coverage area threshold, control the vehicle to display a second prompt message and / or broadcast a second prompt voice, wherein the coverage area threshold is determined based on the total area of ​​the target protection area, the second prompt message is used to display in text form that the amount of sunscreen used in the target protection area is insufficient, and the second prompt voice is used to broadcast in audio form that the amount of sunscreen used in the target protection area is insufficient.

[0194] Furthermore, the device also includes: a sub-determination module, used to record the time when sun protection meets the standard and the performance coefficient of sunscreen in response to a fluorescence intensity value higher than or equal to a fluorescence intensity threshold and a fluorescence coverage area greater than or equal to a coverage area threshold; calculate the sunscreen protection duration based on the sunscreen performance coefficient and the current UV index; and determine the remaining protection duration of sunscreen based on the sunscreen protection duration, the current time, and the time when sun protection meets the standard.

[0195] Furthermore, the device also includes: a sub-control module, configured to: obtain the current status of the passenger in response to the remaining sunscreen protection time being less than or equal to a protection time threshold, or in response to the vehicle entering a target risk area, wherein the target risk area is an area with an ultraviolet index greater than or equal to an ultraviolet index threshold; control the vehicle to perform at least one of the following actions in response to the passenger being in a resting state: closing the sunshade of the passenger seat, closing the sunroof sunshade, adjusting the light transmittance of the window in the passenger seat, and adjusting the seat back angle in the passenger seat; and control the vehicle to display a third prompt message and / or broadcast a third prompt voice message in response to the passenger not being in a resting state, wherein the third prompt message is used to display at least one of the following in text form: remaining sunscreen protection time, current ultraviolet index, remaining driving mileage in the target risk area, and area to be reapplied with sunscreen, and the third prompt voice message is used to broadcast at least one of the following in audio form: remaining sunscreen protection time, current ultraviolet index, remaining driving mileage in the target risk area, and area to be reapplied with sunscreen.

[0196] Furthermore, the device also includes: an update module, used to update the current UV index based on a preset time interval; in response to the difference between the current UV index before the update and the current UV index after the update being greater than a preset difference, calculating a corrected sunscreen protection duration based on the current UV index before the update, the current UV index after the update, and the sunscreen protection duration; and updating the sunscreen protection duration based on the corrected sunscreen protection duration.

[0197] Embodiments of this application also provide a vehicle, including: a memory storing an executable program; and a processor for running the program, wherein the program executes the methods described in various embodiments of this application when it runs.

[0198] Embodiments of this application also provide a computer-readable storage medium including a stored executable program, wherein, when the executable program is running, it controls the device where the computer-readable storage medium is located to perform the methods of various embodiments of this application.

[0199] Embodiments of this application also provide a computer program product, including a computer program that, when executed by a processor, implements the methods of various embodiments of this application.

[0200] Embodiments of this application also provide a computer program product, including a non-volatile computer-readable storage medium for storing a computer program that, when executed by a processor, implements the methods in various embodiments of this application.

[0201] Embodiments of this application also provide a computer program that, when executed by a processor, implements the methods described in the various embodiments of this application.

[0202] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0203] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0204] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0205] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0206] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard drive, magnetic disk, or optical disk.

[0207] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A method for controlling sun protection inside a vehicle, characterized in that, The method includes: Acquire a first image and a second image of a passenger in a vehicle, wherein the first image is a three-color image of a preset part of the passenger, and the second image is an ultraviolet image of the preset part of the passenger, wherein the preset part includes at least the face and neck; Using the first image as a reference, the first image and the second image are spatially aligned to obtain a second aligned image, wherein the second aligned image is the second image after spatial alignment; The sunscreen thickness value of the co-driver in the second aligned image is determined based on the fluorescence intensity value of the second aligned image; Sun protection control operations are performed based on the sunscreen thickness value.

2. The method according to claim 1, characterized in that, The acquisition of the first and second images of the passenger in the vehicle includes: In response to the opening of the sun visor in the passenger seat of the vehicle, the system acquires the first image and the second image of the passenger in the vehicle, wherein the components integrated inside the sun visor include at least one of the following: a red-green-blue camera, an ultraviolet camera, and an ultraviolet supplementary light source.

3. The method according to claim 1 or 2, characterized in that, The step of acquiring the first image and the second image of the passenger in the vehicle includes: Obtain the third and fourth images of the co-driver object; Perform a first preprocessing operation on the third image to obtain the first image, wherein the first preprocessing operation includes: white balance adjustment, bilateral filtering for noise reduction, and histogram equalization; The second preprocessing operation is performed on the fourth image to obtain the second image. The second preprocessing operation includes: dark field correction, flat field correction, median filtering denoising, Gaussian filtering denoising, and fluorescence signal enhancement processing.

4. The method according to claim 1, characterized in that, The step of spatially aligning the first image and the second image based on the first image to obtain the second aligned image includes: Target point detection is performed on the first image to obtain the coordinates of the target points in the first image; The target protection area of ​​the first image is determined based on the coordinates of the target point. Based on the camera calibration parameters and the target protection area, the first image and the second image are spatially aligned in terms of the protection area to obtain a second initial aligned image. Based on the target protection area and the target point coordinates, the first image and the second initial alignment image are spatially aligned to obtain the second alignment image.

5. The method according to claim 4, characterized in that, Determining the sunscreen thickness value of the passenger in the second aligned image based on the fluorescence intensity value of the second aligned image includes: Extract the fluorescence intensity value corresponding to the target protection area in the second aligned image; Based on the preset calibration curve and sunscreen type, determine the proportional coefficient and correction coefficient; The sunscreen thickness value corresponding to the target protection area is calculated based on the fluorescence intensity value, the proportionality coefficient, and the correction coefficient.

6. The method according to claim 5, characterized in that, The process of performing sun protection control based on the sunscreen thickness value includes: The standard fluorescence intensity value corresponding to the sunscreen thickness value is determined based on the preset calibration curve. In response to the fluorescence intensity value being lower than the fluorescence intensity threshold, the vehicle is controlled to display a first prompt message and / or broadcast a first prompt voice, wherein the fluorescence intensity threshold is determined based on the standard fluorescence intensity value, the first prompt message is used to display in text form that the sunscreen is not applied evenly in the target protection area, and the first prompt voice is used to broadcast in audio form that the sunscreen is not applied evenly in the target protection area; In response to the fluorescent coverage area of ​​the target protection area being less than a coverage area threshold, the vehicle is controlled to display a second prompt message and / or broadcast a second prompt voice, wherein the coverage area threshold is determined based on the total area of ​​the target protection area, the second prompt message is used to display in text form that the amount of sunscreen used in the target protection area is insufficient, and the second prompt voice is used to broadcast in audio form that the amount of sunscreen used in the target protection area is insufficient.

7. The method according to claim 6, characterized in that, The method further includes: In response to the fluorescence intensity value being higher than or equal to the fluorescence intensity threshold, and the fluorescence coverage area being greater than or equal to the coverage area threshold, the time when sun protection meets the standard and the performance coefficient of the sunscreen are recorded; Calculate the duration of sun protection based on the sunscreen's performance coefficient and the current UV index; The remaining protection time of the sunscreen is determined based on the sunscreen's protection duration, the current time, and the time when the sun protection standard is met.

8. The method according to claim 7, characterized in that, The method further includes: In response to the remaining protection time of the sunscreen being less than or equal to a protection time threshold, or in response to the vehicle entering a target risk area, the current status of the passenger is obtained, wherein the target risk area is an area with an ultraviolet index greater than or equal to an ultraviolet index threshold. In response to the passenger being in a resting state, the vehicle is controlled to perform at least one of the following: close the sunshade of the passenger seat, close the sunroof sunshade, adjust the light transmittance of the window of the passenger seat, and adjust the seat back angle of the passenger seat; In response to the co-driver not being in the resting state, the vehicle is controlled to display a third prompt message and / or play a third prompt voice message, wherein the third prompt message is used to display at least one of the following in text form: the remaining protection time of the sunscreen, the current UV index, the remaining driving range of the target risk area, and the area to be reapplied with sunscreen, and the third prompt voice message is used to play at least one of the following in audio form: the remaining protection time of the sunscreen, the current UV index, the remaining driving range of the target risk area, and the area to be reapplied with sunscreen.

9. The method according to claim 8, characterized in that, The method further includes: The current ultraviolet index is updated based on a preset time interval; If the difference between the current UV index before the update and the current UV index after the update is greater than a preset difference, the corrected sunscreen protection time is calculated based on the current UV index before the update, the current UV index after the update, and the sunscreen protection time. The sunscreen protection duration is updated based on the revised sunscreen protection duration.

10. A vehicle, characterized in that, include: Memory, which stores executable programs; A processor for running the program, wherein the program, when running, performs the in-vehicle sun protection control method as described in any one of claims 1 to 9.

Images