In-vehicle intelligent light supplementing method and system, and storage medium

Abstract

An in-vehicle intelligent light supplementing method and system, and a storage medium. The method comprises: acquiring a target image, wherein the target image comprises a target object in a vehicle; adjusting a light supplementing array (30) on the basis of image information of the target image to obtain an adjusted light supplementing array (30), wherein the light supplementing array (30) comprises a plurality of lamp beads (31); and performing light supplementing adjustment on the target object by means of the adjusted light supplementing array (30).

Description

In-vehicle intelligent supplemental lighting methods, systems and storage media

[0001] Related applications

[0002] This application claims priority to Chinese patent application filed on June 28, 2024, application number 202410866869.8, entitled "Method, System and Storage Medium for In-Vehicle Intelligent Lighting", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of intelligent vehicle technology, and in particular to an in-vehicle intelligent supplementary lighting method, system and storage medium. Background Technology

[0004] With the development of intelligent vehicles, the application of intelligent cockpit DMS (Driver Monitor System) / OMS (Occupancy Monitoring System) is becoming increasingly widespread. These systems can perform a range of detection functions, including driver identification, fatigue detection, dangerous behavior monitoring, and passenger gesture interaction. DMS / OMS typically require cameras and corresponding supplemental lighting systems to provide illumination for the driver and passengers in the cockpit, thereby enhancing the effectiveness of the DMS / OMS.

[0005] Currently, DMS / OMS systems typically use one or more infrared LEDs for supplemental lighting. However, due to limitations in the number of infrared LEDs and their installation location, they often cannot effectively address issues such as uneven lighting, excessive darkness, and backlighting in the detection area caused by complex ambient light conditions. This results in poor supplemental lighting effects, preventing DMS / OMS from achieving its optimal performance.

[0006] There is currently no effective solution to the problem of poor in-vehicle lighting in related technologies. Summary of the Invention

[0007] According to various embodiments of this application, an in-vehicle intelligent supplementary lighting method, system, and storage medium are provided.

[0008] Firstly, this embodiment provides a vehicle-mounted intelligent supplementary lighting method, the method comprising:

[0009] Acquire a target image, wherein the target image contains a target object inside the vehicle;

[0010] Based on the image information of the target image, the fill light array is adjusted to obtain the adjusted fill light array, wherein the fill light array includes a number of LED beads;

[0011] The target object is illuminated by the adjusted fill light array.

[0012] In some embodiments, the image information of the target image includes overall image information and target object image information, wherein the target object image information includes the brightness information and pose information of the target object.

[0013] In some embodiments, adjusting the fill light array based on image information of the target image includes:

[0014] Based on the image information of the target object, the target LED bead in the supplementary lighting array corresponding to the target object is determined;

[0015] The fill light angle and / or fill light intensity of the target LED bead are adjusted.

[0016] In some embodiments, adjusting the fill light angle and / or fill light intensity of the target LED includes:

[0017] Based on the target object image information, the fill light angle and / or fill light intensity of different LED beads in the target LED beads are dynamically controlled.

[0018] In some embodiments, adjusting the fill light angle and / or fill light intensity of the target LED includes:

[0019] Based on the target object image information, control the opening and / or closing of different LED beads in the target LED beads.

[0020] In some embodiments, adjusting the fill light array based on the image information of the target image further includes:

[0021] Based on the overall image information, adjust the exposure parameter settings of the LEDs in the fill light array.

[0022] In some embodiments, adjusting the exposure parameter settings of the LEDs in the fill light array based on the overall image information includes:

[0023] Determine the average brightness of each sub-region in the target image;

[0024] Based on the preset target brightness and the average brightness of each sub-region, the exposure parameter settings of the corresponding LED beads in each sub-region are adjusted.

[0025] In some of these embodiments, it also includes:

[0026] Based on the target image, the camera's extrinsic parameters are calibrated.

[0027] Secondly, this embodiment provides an in-vehicle intelligent supplementary lighting system, including: a camera, an intelligent supplementary lighting processor, and a supplementary lighting array, wherein the supplementary lighting array includes a plurality of LED beads;

[0028] The camera is used to acquire a target image, wherein the target image contains a target object;

[0029] The intelligent fill light processor is used to adjust the fill light array according to the image information of the target image to obtain the adjusted fill light array;

[0030] The supplementary lighting array is used to adjust the supplementary lighting for the target object.

[0031] Thirdly, this embodiment provides a storage medium storing a computer program that, when executed by a processor, implements the vehicle-mounted intelligent supplementary lighting method described in the first aspect above.

[0032] Details of one or more embodiments of this application are set forth in the following drawings and description to make other features, objects and advantages of this application more readily apparent. Attached Figure Description

[0033] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the published drawings without creative effort.

[0034] Figure 1 is a hardware structure block diagram of the terminal of the vehicle-mounted intelligent supplementary lighting method in one embodiment.

[0035] Figure 2 is a structural block diagram of an in-vehicle intelligent supplementary lighting system in one embodiment.

[0036] Figure 3 is a schematic diagram of the camera and fill light array in the rearview mirror in one embodiment.

[0037] Figures 4A and 4B are schematic diagrams of an embodiment of the application of an in-vehicle intelligent supplementary lighting system.

[0038] Figure 5 is a flowchart of an embodiment of an in-vehicle intelligent supplementary lighting method.

[0039] Figure 6 is a schematic diagram of the overall supplementary lighting adjustment process in one embodiment.

[0040] Figures 7A and 7B are schematic diagrams illustrating the process of dynamically adjusting the supplementary light intensity and supplementary light angle of different LEDs in the target LED based on the DMS algorithm in one embodiment.

[0041] Figure 8 is a schematic diagram of the process of dynamically adjusting the supplementary light intensity of different LEDs in the target LED based on the OMS algorithm in one embodiment.

[0042] Figure 9 is a schematic diagram of the external parameter calibration process in one embodiment.

[0043] Figure 10 is a flowchart of an in-vehicle intelligent supplementary lighting method in another embodiment.

[0044] In the diagram: 102, processor; 104, memory; 106, transmission device; 108, input / output device; 10, camera; 20, intelligent fill light processor; 30, fill light array; 31, LED bead. Detailed Implementation

[0045] To better understand the purpose, technical solution, and advantages of this application, the application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0046] Unless otherwise defined, the technical or scientific terms used in this application shall have the general meaning as understood by one of ordinary skill in the art to which this application pertains. Words such as “a,” “an,” “an,” “the,” “the,” and “these,” used in this application, do not indicate quantitative limitation and may be singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that comprises a series of steps or modules (units) is not limited to the listed steps or modules (units) but may include steps or modules (units) not listed, or may include other steps or modules (units) inherent to such processes, methods, products, or devices. The terms “connected,” “linked,” and “coupled,” used in this application, are not limited to physical or mechanical connections but may include electrical connections, whether direct or indirect. The term “multiple” used in this application refers to two or more. The "and / or" operator describes the relationship between related objects, indicating that three relationships can exist. For example, "A and / or B" can represent three cases: A alone, A and B simultaneously, and B alone. Typically, the character " / " indicates that the objects before and after it are in an "or" relationship. The terms "first," "second," and "third," etc., used in this application are merely for distinguishing similar objects and do not represent a specific ordering of the objects.

[0047] The method embodiments provided in this example can be executed in a terminal, computer, or similar computing device. For example, when running on a terminal, Figure 1 is a hardware structure block diagram of the terminal of the vehicle-mounted intelligent supplementary lighting method of this embodiment. As shown in Figure 1, the terminal may include one or more (only one is shown in Figure 1) processors 102 and a memory 104 for storing data, wherein the processor 102 may be, but is not limited to, a processing device such as a microprocessor (MCU) or a programmable logic device (FPGA). The terminal may also include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that the structure shown in Figure 1 is only illustrative and does not limit the structure of the terminal. For example, the terminal may include more or fewer components than shown in Figure 1, or have a different configuration than shown in Figure 1.

[0048] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the vehicle-mounted intelligent supplementary lighting method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102. These remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0049] The transmission device 106 is used to receive or send data via a network. This network includes a wireless network provided by the terminal's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 can be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0050] With the development of intelligent vehicles, the application of intelligent cockpit DMS (Driver Monitor System) / OMS (Occupancy Monitoring System) is becoming increasingly widespread. These systems can perform a range of detection functions, including driver identification, fatigue detection, dangerous behavior monitoring, and passenger gesture interaction. DMS / OMS typically require cameras and corresponding supplemental lighting systems to provide illumination for the driver and passengers in the cockpit, thereby enhancing the effectiveness of the DMS / OMS.

[0051] Currently, DMS / OMS systems typically use one or more infrared LEDs for supplemental lighting. However, due to limitations in the number of infrared LEDs and their installation location, they often cannot effectively address issues such as uneven lighting, excessive darkness, and backlighting in the detection area caused by complex ambient light conditions. This results in poor supplemental lighting effects, preventing DMS / OMS from achieving its optimal performance.

[0052] To address the above issues, this embodiment provides an in-vehicle intelligent supplementary lighting system. Figure 2 is a structural block diagram of the in-vehicle intelligent supplementary lighting system in this embodiment. As shown in Figure 2, the system includes: a camera 10, an intelligent supplementary lighting processor 20, and a supplementary lighting array 30. The supplementary lighting array 30 includes a plurality of LED beads 31.

[0053] Camera 10 is used to acquire a target image, wherein the target image contains a target object;

[0054] The intelligent fill light processor 20 is used to adjust the fill light array 30 according to the image information of the target image to obtain the adjusted fill light array;

[0055] The supplementary lighting array 30 is used to adjust the supplementary lighting for the target object.

[0056] The camera 10 can monitor both the driver and passengers in each row of the vehicle, acquiring target images. Target objects include, but are not limited to, the driver's face and other body parts, passengers' faces and other body parts, as well as localized areas such as the steering wheel and seats.

[0057] Figure 3 is a schematic diagram of the camera and supplementary lighting array in the rearview mirror in this embodiment. As shown in Figure 3, both the camera and the supplementary lighting array are located in the rearview mirror. The circle represents the camera, and the rectangle represents the LED. Several LEDs constitute the supplementary lighting array. There are no restrictions on the number and arrangement of the LEDs in the supplementary lighting array. For example, the camera can be positioned in the center of the rearview mirror to cover a larger monitoring range. The LEDs can be infrared LEDs with different FOVs (Field of View), and the exposure parameters, supplementary lighting angle, and supplementary lighting intensity of each LED are adjustable.

[0058] In some embodiments, the camera and fill light array can be placed in other locations inside the vehicle, such as the roof or A-pillar, depending on the vehicle model requirements; the camera and fill light array can be located in different positions inside the vehicle.

[0059] In some of these embodiments, the number of cameras and fill light arrays is not limited.

[0060] Figures 4A and 4B are schematic diagrams of the application of an in-vehicle intelligent supplementary lighting system. As shown in Figures 4A and 4B, through a camera and supplementary lighting array set in the rearview mirror of the vehicle, the supplementary lighting system can cover the driver, passengers in each row, and local areas such as the steering wheel and seats, thus achieving the best effect in conjunction with the DMS / OMS system.

[0061] In this embodiment, the vehicle-mounted intelligent supplementary lighting system acquires target images through a camera, and adjusts different LED beads in the supplementary lighting array according to the image information of the target image in the intelligent supplementary lighting processor to obtain an adjusted supplementary lighting array, and then uses the adjusted supplementary lighting array to adjust the supplementary lighting of the target object.

[0062] In some of these embodiments, the intelligent supplemental lighting processor can be located in the interior rearview mirror, or in the DMS system and OMS system.

[0063] In some embodiments, the image information of the target image may include overall image information and target object image information. The overall image information may include image quality information, such as the brightness information of the target image, while the target object image information may include the brightness information, pose information, etc. of the target object.

[0064] The system provided in this embodiment uses a camera installed in the rearview mirror to acquire a target image. The intelligent fill light processor adjusts different LEDs in the fill light array according to the image information of the target image to provide fill light to the target object and improve the image quality. Compared with the configuration scheme of camera and fill light LEDs in related technologies, the camera and fill light array in this embodiment have a larger coverage area and are more flexible in adjustment. It can take into account and adapt to the functional implementation of the DMS / OMS system without the need to configure a separate fill light system. At the same time, it performs intelligent fill light adjustment on the target object for functions such as identity recognition, fatigue driving detection, steering wheel hands-off detection, and gesture interaction in the DMS / OMS system to ensure image quality and solve the problem of poor in-vehicle fill light effect.

[0065] This embodiment provides a vehicle-mounted intelligent supplementary lighting method, which is applied to the vehicle-mounted intelligent supplementary lighting system in the above embodiments. Figure 5 is a flowchart of the vehicle-mounted intelligent supplementary lighting method of this embodiment. As shown in Figure 5, the method includes the following steps:

[0066] Step S510: Obtain the target image, wherein the target image contains the target object inside the vehicle.

[0067] Specifically, one or more cameras can be used to monitor both the driver and passengers in each row of the vehicle, acquiring target images containing the target objects. The target objects can be the objects to be detected in the DMS / OMS system, including but not limited to the driver's face and other body parts, passenger faces and other body parts, and localized areas such as the steering wheel and seats. For example, the camera can be positioned in the center of the rearview mirror to cover a wider monitoring range.

[0068] Step S520: Adjust the fill light array according to the image information of the target image to obtain the adjusted fill light array, wherein the fill light array includes a number of LED beads.

[0069] Specifically, based on the target image acquired by the camera, the intelligent fill light processor adjusts the fill light array by adjusting different LEDs in the fill light array according to the image information of the target image. The adjusted fill light array then provides fill light to the target object. To achieve a fill light effect compatible with the DMS / OMS system and to provide a higher quality target image for the DMS / OMS system, the image information of the target image can include brightness information, pose information, and image quality. For example, the LEDs can be infrared LEDs with different FOVs (Field of View), and the exposure parameters, fill light angle, and fill light intensity of each LED are adjustable.

[0070] Step S530: Adjust the supplementary lighting on the target object using the adjusted supplementary lighting array.

[0071] Specifically, the adjusted fill light array can adjust the fill light on the target object according to the different functions of the DMS / OMS system to ensure image quality and thus better adapt to the DMS / OMS system.

[0072] The method provided in this embodiment acquires a target image using a camera installed in the rearview mirror. Based on the image information of the target image inside the vehicle, different LEDs in the supplementary lighting array are adjusted to provide supplementary lighting for the target object, thereby improving the image quality. Compared with the configuration schemes of cameras and supplementary lighting LEDs in related technologies, the camera and supplementary lighting array in this embodiment have a wider coverage and more flexible adjustment, and can accommodate and adapt to the functional implementation of the DMS / OMS system without the need for separate supplementary lighting system configuration. At the same time, for functions such as identity recognition, fatigue driving detection, steering wheel hands-off detection, and gesture interaction in the DMS / OMS system, intelligent supplementary lighting adjustment is performed on the target object under various complex ambient lighting conditions to ensure image quality and solve the problem of poor supplementary lighting effect inside the vehicle.

[0073] In some embodiments, the image information includes overall image information and target object image information, wherein the target object image information includes the brightness information and pose information of the target object.

[0074] Specifically, for the target image acquired by the camera, its overall image information refers to the image information of the entire target image, which may include brightness information, etc., and is used to adjust the exposure parameters of the supplementary lighting array as a whole. At the same time, the target image contains target objects inside the vehicle, and the corresponding image information is the target object image information, including but not limited to the brightness and pose information of the driver's face and other body parts, the passenger's face and other body parts, as well as the brightness information of local areas such as the steering wheel and seat, which is used to adjust the local supplementary lighting of the target object.

[0075] Based on the overall image information and target object image information of the target image in this embodiment, further overall and local supplementary lighting adjustments can be made.

[0076] The following examples illustrate overall fill light adjustment and local fill light adjustment. Overall fill light adjustment and local fill light adjustment can be combined or adjusted separately.

[0077] In some embodiments, step S520 above, which adjusts the supplementary light array based on the image information of the target image, includes the following steps:

[0078] Adjust the exposure parameter settings of the LEDs in the fill light array based on the overall image information.

[0079] Specifically, different brightness levels will cause changes in the camera's exposure time. For example, if the brightness is insufficient, the image noise will become greater. Therefore, it is necessary to improve the image quality by adjusting the exposure parameter settings of different LEDs in the fill light array according to the overall image information.

[0080] For example, the average brightness of each sub-region in the target image can be determined; based on the preset target brightness and the average brightness of each sub-region, the exposure parameter settings of the corresponding LED beads in each sub-region can be adjusted.

[0081] Figure 6 illustrates the overall supplementary lighting adjustment process in this embodiment. As shown in Figure 6, firstly, the target image is acquired under the camera's default parameters; the target image is divided into multiple sub-regions, and the average brightness of each sub-region and the corresponding LED bead are determined; based on the preset target brightness and the average brightness of each sub-region, the direction (e.g., brighter or weaker) and degree of brightness adjustment are determined, thereby determining the required exposure parameter settings for the LED bead corresponding to each sub-region; by adjusting the exposure parameter settings of the LED bead corresponding to each sub-region, the average brightness of each sub-region is made close to the preset target brightness. The target brightness can be set according to different application scenarios.

[0082] Furthermore, for the preset target brightness, the exposure time of the corresponding LED beads in each sub-area can be adjusted first. When the exposure time reaches the upper limit, the ISO (International Organization for Standardization) sensitivity can be adjusted.

[0083] By adjusting the exposure parameters of the LED beads according to the overall image information in this embodiment, the overall lighting of the target image can be adjusted, thereby improving the image quality of the target image.

[0084] In some embodiments, step S520 above, which adjusts the supplementary light array based on the image information of the target image, includes the following steps:

[0085] Step S521: Based on the image information of the target object, determine the target LED beads in the supplementary lighting array that correspond to the target object.

[0086] Specifically, considering the various driving tasks of the driver during driving (such as checking the rearview mirror) and the passengers' ability to adjust their seat posture and their own posture, which may cause changes in the facial, head, hand, and other limb postures of the driver and passengers, this embodiment performs local supplementary lighting adjustment for the target object. This requires first determining the target LED in the supplementary lighting array that corresponds to the target object, i.e., the LED with the optimal illumination angle. Specifically, the target object is detected and tracked in real-time based on video image sequence frames to determine its position and brightness information, thereby identifying the corresponding target LED. For target objects such as faces, which are easily affected by uneven supplementary lighting, it is necessary to further detect the angle and orientation of the face using a pose estimation algorithm to determine the target LED.

[0087] Step S522: Adjust the fill light angle and / or fill light intensity of the target LED.

[0088] Specifically, the DMS / OMS system's functional algorithms detect the brightness and pose information of the target object in real time, such as changes in brightness and pose. By adjusting the fill light angle and / or fill light intensity of the target LED beads, the fill light angle and / or fill light intensity of the entire fill light array can be adjusted. The following is a detailed explanation of how to adjust the fill light angle and / or fill light intensity of the target LED beads:

[0089] In some embodiments, the fill light angle and / or fill light intensity of different LEDs in the target LED can be dynamically controlled based on the target object image information.

[0090] Specifically, the DMS algorithm judges the light at the target object based on brightness and pose information. When the target object is overexposed or has uneven lighting, it dynamically adjusts the brightness and angle of the target LEDs to ensure sufficient and uniform lighting at the target object, improving the image quality of the target object and increasing the recognition accuracy of the DMS algorithm, thereby enhancing the DMS function. Figures 7A and 7B are schematic diagrams illustrating the process of dynamically adjusting the lighting intensity and angle of different LEDs in the target LED array based on the DMS algorithm in this embodiment. As shown in Figures 7A and 7B, the camera acquires the target image, in which the driver's face is the target object. The DMS algorithm detects whether the target object is overexposed or has an excessively high lighting angle. As shown in Figure 7A, when the driver's face area is overexposed, the onboard intelligent lighting system needs to adjust the lighting intensity of the driver's face area, that is, by reducing the lighting intensity of the target LEDs in the lighting array to reduce the lighting intensity of the driver's face area. As shown in Figure 7B, when the fill light angle of the driver's face area is too high, it can easily cause shadows or dividing lines on the target object. The vehicle intelligent fill light system needs to adjust the fill light angle of the driver's face area, that is, by adjusting the target LED beads in the fill light array to lower the fill light angle of the driver's face area.

[0091] Specifically, the OMS algorithm judges the light intensity at the target object based on brightness and pose information. When the target object is overexposed or has uneven lighting, the algorithm dynamically adjusts the lighting intensity of the target LEDs to ensure sufficient and uniform lighting at the target object, improving the image quality of the target object and increasing the recognition accuracy of the OMS algorithm, thereby enhancing the OMS function, such as improving the accuracy of gesture recognition algorithms. Figure 8 is a schematic diagram of the process of dynamically adjusting the lighting intensity of different LEDs in the target LED array based on the OMS algorithm in this embodiment. As shown in Figure 8, the camera acquires the target image, in which the passenger's hand is selected as the target object in the target image. The OMS algorithm detects whether the target object is overexposed or has an excessively high lighting angle. When the passenger's hand area is too dark, the vehicle-mounted intelligent lighting system needs to adjust the lighting intensity of the passenger's hand area, that is, by increasing the lighting intensity of the target LEDs in the lighting array to enhance the lighting intensity of the passenger's hand area.

[0092] In some embodiments, the on and / or off of different LEDs in the target LED can be controlled based on the target object image information.

[0093] The switching on and / or off of the LED beads is controlled by a dedicated LED driver chip. The angle and / or intensity of the supplementary lighting can also be adjusted by controlling the switching on and off of different LED beads.

[0094] Furthermore, depending on the vehicle model, the lighting angle and / or intensity of the fill light array can be dynamically adjusted for different areas and target objects without redesigning the hardware and structure of the fill light array.

[0095] In this embodiment, different LEDs in the fill light array are adjusted according to the image information of the target image to obtain the adjusted fill light array. This array can perform local fill light adjustment for the target object of the DMS / OMS algorithm, thereby providing better image quality for DMS / OMS and better realizing the corresponding functions.

[0096] In some embodiments, the method further includes the following steps:

[0097] Based on the target image, perform extrinsic parameter calibration on the camera.

[0098] Specifically, considering that the DMS / OMS system needs to accurately detect the position of the target object when implementing its functions, it is necessary to calibrate the extrinsic parameters of the camera's own pose. Especially when the rearview mirror moves, calibrating the extrinsic parameters of the camera can improve the performance of the DMS / OMS system.

[0099] Figure 9 is a schematic diagram of the extrinsic parameter calibration process in this embodiment. As shown in Figure 9, the camera acquires a target image and uses an automatic calibration algorithm to detect whether a reference region is visible in the target image. If the reference region is not visible, a calibration failure error is reported, and the calibration process exits. If the reference region is visible, it is further determined whether the light in the reference region is sufficient. If the light in the reference region is sufficient, the automatic calibration algorithm accurately detects the features of the reference region and calculates the camera's extrinsic parameters based on the features, such as the camera's spatial position and orientation, thereby completing the camera's extrinsic parameter calibration. If the light in the reference region is insufficient, the area with insufficient light is identified as the target region, and the target region is supplemented with light by adjusting different LEDs in the supplementary lighting array. The reference region is one or more truth reference regions used to calibrate the camera's extrinsic parameters.

[0100] By calibrating the camera's external parameters in this embodiment, the position of the target object can be accurately detected, thereby improving the performance of the DMS / OMS system.

[0101] The present embodiment will be described and illustrated below through optional embodiments.

[0102] Figure 10 is a flowchart of the vehicle-mounted intelligent supplementary lighting method of this embodiment. The method is applied to the vehicle-mounted intelligent supplementary lighting system in the above embodiments. As shown in Figure 10, the method includes the following steps:

[0103] Step S110: Acquire a target image using a camera, wherein the target image contains the target object inside the vehicle.

[0104] Step S120: Adjust the exposure parameter settings of the LEDs in the fill light array according to the overall image information of the target image.

[0105] Step S130: Based on the target object image information of the target image, determine the target LED beads in the supplementary light array that correspond to the target object.

[0106] Step S140: Based on the target object image information, dynamically control the supplementary lighting angle and / or supplementary lighting intensity of different LED beads in the target LED beads.

[0107] Step S150: Based on the target object image information, control the opening and / or closing of different LED beads in the target LED beads.

[0108] Step S160: Perform extrinsic parameter calibration on the camera based on the target image.

[0109] In this embodiment, a target image is acquired by a camera. Based on the image information of the target image inside the vehicle, different LEDs in the fill light array are adjusted to perform overall and local fill light adjustment on the fill light array. This achieves intelligent fill light adjustment for the target object, ensuring image quality and solving the problem of poor fill light effect inside the vehicle.

[0110] It should be noted that the steps shown in the above process or in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowcharts, in some cases, the steps shown or described may be executed in a different order than that shown here. For example, the overall fill light adjustment in step S120 and the local fill light adjustment in steps S130-S150 are not limited in their execution order.

[0111] This embodiment also provides a computer device, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform the steps in any of the above method embodiments.

[0112] Optionally, the computer device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0113] It should be noted that the specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated in this embodiment.

[0114] Furthermore, in conjunction with the vehicle-mounted intelligent supplementary lighting method provided in the above embodiments, this embodiment can also provide a storage medium for implementation. This storage medium stores a computer program; when executed by a processor, the computer program implements any of the vehicle-mounted intelligent supplementary lighting methods described in the above embodiments.

[0115] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0116] It should be understood that the specific embodiments described herein are merely illustrative of the application and not intended to limit it. All other embodiments derived by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0117] Obviously, the accompanying drawings are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar situations based on these drawings without any creative effort. Furthermore, it is understood that although the work done in this development process may be complex and lengthy, for those skilled in the art, certain design, manufacturing, or production modifications made based on the technical content disclosed in this application are merely conventional technical means and should not be considered as insufficient disclosure of this application.

[0118] The term "embodiment" in this application refers to a specific feature, structure, or characteristic described in connection with an embodiment that may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily imply the same embodiment, nor does it imply that it is mutually exclusive with or alternative to other embodiments. It will be clearly or implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0119] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the appended claims.

Claims

1. A vehicle-mounted intelligent supplementary lighting method, characterized in that, The method includes: Acquire a target image, wherein the target image contains a target object inside the vehicle; Based on the image information of the target image, the fill light array is adjusted to obtain the adjusted fill light array, wherein the fill light array includes a number of LED beads; The target object is illuminated by the adjusted fill light array.

2. The vehicle-mounted intelligent supplementary lighting method according to claim 1, wherein, The image information of the target image includes overall image information and target object image information, wherein the target object image information includes the brightness information and pose information of the target object.

3. The vehicle-mounted intelligent supplementary lighting method according to claim 2, wherein, The step of adjusting the supplementary light array based on the image information of the target image includes: Based on the image information of the target object, the target LED bead in the supplementary lighting array corresponding to the target object is determined; The fill light angle and / or fill light intensity of the target LED bead are adjusted.

4. The vehicle-mounted intelligent supplementary lighting method according to claim 3, wherein, The adjustment of the fill light angle and / or fill light intensity of the target LED includes: Based on the target object image information, the fill light angle and / or fill light intensity of different LED beads in the target LED beads are dynamically controlled.

5. The vehicle-mounted intelligent supplementary lighting method according to claim 3, wherein, The adjustment of the fill light angle and / or fill light intensity of the target LED includes: Based on the target object image information, control the opening and / or closing of different LED beads in the target LED beads.

6. The vehicle-mounted intelligent supplementary lighting method according to claim 2, wherein, The step of adjusting the supplementary light array based on the image information of the target image further includes: Based on the overall image information, adjust the exposure parameter settings of the LEDs in the fill light array.

7. The vehicle-mounted intelligent supplementary lighting method according to claim 6, wherein, The step of adjusting the exposure parameter settings of the LEDs in the fill light array based on the overall image information includes: Determine the average brightness of each sub-region in the target image; Based on the preset target brightness and the average brightness of each sub-region, the exposure parameter settings of the corresponding LED beads in each sub-region are adjusted.

8. The vehicle-mounted intelligent supplementary lighting method according to claim 1, wherein, Also includes: Based on the target image, the camera's extrinsic parameters are calibrated.

9. A vehicle-mounted intelligent supplementary lighting system, characterized in that, include: A camera, an intelligent fill light processor, and a fill light array, wherein the fill light array includes a number of LED beads; The camera is used to acquire a target image, wherein the target image contains a target object; The intelligent fill light processor is used to adjust the fill light array according to the image information of the target image to obtain the adjusted fill light array; The supplementary lighting array is used to adjust the supplementary lighting for the target object.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the vehicle-mounted intelligent supplementary lighting method according to any one of claims 1 to 8.

Images