Driver monitoring system, infrared light control method, electronic device, and medium

Abstract

The application provides a driver monitoring system, an infrared lamp control method, an electronic device and a medium, and the driver monitoring system comprises: an image signal processor, an image sensor and an infrared lamp; the image signal processor comprises a timer module, and the image sensor and the infrared lamp are respectively in communication connection with a first general-purpose input / output pin and a second general-purpose input / output pin of the image signal processor. The application utilizes the image signal processor to detect the state of an exposure trigger signal generated by the image sensor (such as a rolling shutter image sensor) during exposure in real time, and controls the second general-purpose input / output pin to output high and low levels according to the state, so as to accurately control the lighting and extinguishing of the infrared lamp, thereby realizing the synchronous opening of light compensation during exposure, and further enabling the driver monitoring system provided by the application to meet the requirements of wide dynamic range and infrared lamp control simultaneously, wherein the image sensor does not have a dedicated infrared lamp control pin.

Description

Technical Field

[0001] This invention relates to the field of vehicle cabin monitoring technology, and in particular to a driver monitoring system, an infrared light control method, electronic equipment, and a medium. Background Technology

[0002] Currently, in-vehicle driver monitoring systems (DMS) typically use image sensors as the core data acquisition component, and these image sensors are mostly global shutter image sensors. However, this approach is costly and limited by design and manufacturing processes. These image sensors generally do not support wide dynamic range (WDR) exposure methods, and their dynamic range is generally only around 70dB. In sunny outdoor scenarios, when sunlight shines directly on the driver's face or body, due to the large contrast in lighting inside the vehicle, the use of global shutter image sensors is prone to local overexposure or underexposure (i.e., "half-exposed face"), resulting in a significant decrease in the quality of the acquired image. This directly affects the accurate identification and judgment of driver fatigue, distraction, and other states, thereby reducing the reliability of the entire driver monitoring system and posing potential safety hazards to driving safety.

[0003] To address the aforementioned issues, a relatively cost-effective image sensor (such as a rolling shutter image sensor) that provides a wide dynamic range can be used instead of the global shutter sensor in the driver monitoring system. This solution utilizes multi-frame exposure synthesis technology to enhance the dynamic range to 90dB or even higher, effectively mitigating the "half-light face" problem in high-dynamic scenes. This improves the stability and reliability of the solution under different lighting conditions and demonstrates good engineering feasibility.

[0004] However, the driver monitoring system typically requires simultaneous activation of supplemental lighting during exposure to ensure image brightness and signal-to-noise ratio. When using the global shutter image sensor for the driver monitoring system application, please refer to [link to relevant documentation]. Figure 1 , Figure 1 A simplified schematic diagram of a driver monitoring system employing a global shutter image sensor, as shown below. Figure 1As shown, the global shutter image sensor 1 can control the infrared light 2 (IR) using its built-in strobe pin, and its brightness is adjusted by adaptively modulating the duty cycle according to changes in exposure. However, when using an image sensor that is relatively cost-effective and provides a wide dynamic range (such as a rolling shutter image sensor), it is difficult to directly control the infrared light 2 because such image sensors typically do not have a dedicated strobe pin for controlling the IR light 2. Therefore, for driver monitoring systems using image sensors without dedicated infrared light control pins, how to control the infrared light has become one of the problems that urgently needs to be solved by those skilled in the art.

[0005] It should be noted that the information disclosed in the background section of this invention is intended only to enhance the understanding of the general background of this invention, and should not be construed as an admission or in any way implying that the information constitutes prior art known to those skilled in the art. Summary of the Invention

[0006] The purpose of this invention is to provide a driver monitoring system, an infrared light control method, an electronic device, and a medium to solve the technical problems of infrared light control in existing driver monitoring systems that use image sensors without dedicated infrared light control pins.

[0007] To achieve the above objectives, the present invention provides the following technical solution: a driver monitoring system, comprising an image signal processor (ISP), an image sensor, and an infrared lamp, wherein the image signal processor includes a timer module, and the image sensor and the infrared lamp are respectively communicatively connected to the first general-purpose input / output (GPIO) pin and the second general-purpose input / output pin of the image signal processor;

[0008] The first general-purpose input / output pin is configured in input mode, and the second general-purpose input / output pin is configured in output mode and multiplexed as a timer mode;

[0009] The image sensor is configured to send an exposure trigger signal to the image signal processor via the first general-purpose input / output pin when exposure begins.

[0010] The image signal processor is configured to output a first-level signal to the infrared lamp through the second general-purpose input / output pin when the exposure trigger signal is detected, so as to control the infrared lamp to light up and trigger the timer module to start timing, so that the duration of the first-level signal is a preset timing duration; and when the timing of the timer module reaches the preset timing duration, output a second-level signal to the infrared lamp through the second general-purpose input / output pin, so as to control the infrared lamp to turn off and reset the timer module.

[0011] Optionally, the image sensor is a rolling shutter image sensor.

[0012] Based on the same inventive concept, this invention also proposes an infrared light control method, applied to the driver monitoring system described above. The method includes: configuring the first general-purpose input / output pin as an input mode, configuring the second general-purpose input / output pin as an output mode and multiplexing it as a timer mode, and setting the timing duration of the timer module.

[0013] When the image sensor begins exposure, it sends an exposure trigger signal to the image signal processor through the first general-purpose input / output pin.

[0014] When the exposure trigger signal is detected, the image signal processor outputs a first level signal to the infrared lamp through the second general-purpose input / output pin to control the infrared lamp to light up and trigger the timer module to start timing, so that the duration of the first level signal is the timing duration;

[0015] When the timer module reaches the set time, the image signal processor outputs a second level signal to the infrared lamp through the second general-purpose input / output pin to control the infrared lamp to turn off and reset the timer module.

[0016] Optionally, the exposure trigger signal includes a pulse signal, and the image signal processor detects the rising edge of the pulse signal to determine the exposure trigger signal.

[0017] Optionally, the timing duration is greater than or equal to the maximum exposure time of the image sensor.

[0018] Optionally, the timing duration is 7~12ms.

[0019] Optionally, the first level signal is high level and the second level signal is low level.

[0020] Optionally, the method further includes configuring the timer module to a single-count mode.

[0021] Based on the same inventive concept, the present invention also provides an electronic device, including a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, it implements the infrared lamp control method described above.

[0022] Based on the same inventive concept, the present invention also provides a readable storage medium storing a computer program, which, when executed by a processor, implements the infrared lamp control method described above.

[0023] Compared with the prior art, the driver monitoring system, infrared lamp control method, electronic device and medium provided by the present invention have the following beneficial effects: The driver monitoring system provided by the present invention connects the first general-purpose input / output pin of the image signal processor to the image sensor and the second general-purpose input / output pin to the infrared lamp. The image signal processor uses the image signal processor to detect in real time the state of the exposure trigger signal generated by the image sensor (such as a rolling shutter image sensor) during exposure, and controls the output of the second general-purpose input / output pin to output high and low levels according to the state, thereby precisely controlling the lighting and extinguishing of the infrared lamp, thereby realizing the synchronous activation of supplementary lighting during exposure. Thus, the driver monitoring system provided by the present invention, which uses an image sensor without a dedicated infrared lamp control pin, can simultaneously meet the requirements of wide dynamic range and infrared lamp control.

[0024] Furthermore, by presetting the timing duration of the timer module, the present invention can ensure that the illumination duration of the infrared lamp covers the maximum exposure time of the image sensor; at the same time, the present invention only utilizes two previously unused general-purpose input / output pins on the image signal processor, without adding any additional components, to achieve a wide dynamic range while precisely controlling the infrared lamp, thereby significantly reducing the cost of the driver monitoring system.

[0025] Furthermore, the infrared light control method, electronic device, and readable storage medium provided by this invention belong to the same inventive concept as the driver monitoring system provided by this invention. Therefore, the infrared light control method, electronic device, and readable storage medium provided by this invention have at least all the beneficial effects of the driver monitoring system provided by this invention. For details, please refer to the relevant descriptions of the beneficial effects of the driver monitoring system provided by this invention above. Therefore, the beneficial effects of the infrared light control method, electronic device, and readable storage medium provided by this invention will not be elaborated here. Attached Figure Description

[0026] Figure 1 A simplified schematic diagram of a driver monitoring system employing a global shutter image sensor;

[0027] Figure 2This is a simplified schematic diagram of the driver monitoring system provided in the first embodiment of the present invention;

[0028] Figure 3 A flowchart illustrating the infrared lamp control method provided in the second embodiment of the present invention;

[0029] Figure 4 A simplified schematic diagram illustrating the principle of the infrared lamp control method provided in the second embodiment of the present invention;

[0030] Figure 5 A block diagram illustrating the structure of an electronic device provided in a third embodiment of the present invention;

[0031] The reference numerals in the attached figures are as follows: 1-Global shutter image sensor, 2-Infrared lamp, 3-Image signal processor, 31-Timer module, 4-Rolling shutter image sensor, 51-Processor, 52-Memory, 53-Communication interface, 54-Communication bus. Detailed Implementation

[0032] The driver monitoring system, infrared light control method, electronic device, and medium proposed in this invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. The advantages and features of this invention will become clearer from the following description. It should be noted that the drawings are all in a very simplified form and use non-precise proportions, only used to facilitate and clarify the illustration of the embodiments of this invention. Please refer to the drawings to make the objectives, features, and advantages of this invention more apparent and understandable. It should be understood that the structures, proportions, sizes, etc., depicted in the accompanying drawings are only used to complement the content disclosed in the specification, for those skilled in the art to understand and read, and are not intended to limit the implementation conditions of this invention. Any modifications to the structure, changes in proportions, or adjustments to the size, if they are the same as or similar to the effects and objectives achieved by this invention, should still fall within the scope of the technical content disclosed in this invention. Specific design features of the invention disclosed herein, including, for example, specific dimensions, orientations, positions, and shapes, will be determined in part by the specific application and usage environment.

[0033] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element. The singular forms “a,” “an,” and “the” include plural objects. The term “or” is generally used to mean “and / or,” the term “several” is generally used to mean “at least one,” and the term “at least two” is generally used to mean “two or more.” Furthermore, the terms “first,” “second,” and “third” are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0034] The core idea of ​​this invention is to provide a driver monitoring system, an infrared light control method, an electronic device, and a medium. This invention can meet the requirements of a driver monitoring system (specifically, a driver monitoring system using an image sensor without a dedicated infrared light control pin) for wide dynamic range and infrared light control without adding any additional components, and can significantly reduce the cost of the driver monitoring system.

[0035] To achieve the above-mentioned goals, a first embodiment of the present invention provides a driver monitoring system. For example, please refer to... Figure 2 , Figure 2 This is a simplified schematic diagram of a driver monitoring system provided in a first embodiment of the present invention. Figure 2 As shown, the driver monitoring system includes an image signal processor 3 and an image sensor ( Figure 2 Example of a rolling shutter image sensor 4) and an infrared lamp 2; the image signal processor 3 includes a timer module 31, and the image sensor and the infrared lamp 2 are respectively connected to the first general-purpose input / output pin of the image signal processor 3 ( Figure 2 (Example using GPIO 0) and the second general purpose input / output pin ( Figure 2(Example using GPIO 4) Communication connection; the first general-purpose input / output pin is configured as input mode, and the second general-purpose input / output pin is configured as output mode and multiplexed as timer mode; the image sensor is configured to send an exposure trigger signal to the image signal processor 3 through the first general-purpose input / output pin when exposure begins; the image signal processor 3 is configured to output a first level signal to the infrared lamp 2 through the second general-purpose input / output pin when the exposure trigger signal is detected, so as to control the infrared lamp 2 to light up and trigger the timer module 31 to start timing, so that the duration of the first level signal is a preset timing duration; and when the timing of the timer module 31 reaches the preset timing duration, output a second level signal to the infrared lamp 2 through the second general-purpose input / output pin, so as to control the infrared lamp 2 to turn off and reset the timer module 31.

[0036] Therefore, the driver monitoring system provided by the present invention connects the first general-purpose input / output pin of the image signal processor 3 to the image sensor and the second general-purpose input / output pin to the infrared lamp 2. The image signal processor 3 uses the image signal processor 3 to detect in real time the state of the exposure trigger signal generated by the image sensor (such as the rolling shutter image sensor 4) during exposure, and controls the output of the second general-purpose input / output pin to output high and low levels according to the state, thereby precisely controlling the lighting and extinguishing of the infrared lamp 2, thereby realizing the synchronous activation of supplementary lighting during exposure. Thus, the driver monitoring system provided by the present invention, which uses an image sensor without a dedicated infrared lamp control pin, can simultaneously meet the requirements of wide dynamic range and infrared lamp control.

[0037] It should be noted that this invention does not limit the specific type of the image sensor. Those skilled in the art will understand that image sensors used in the driver monitoring system that need to balance cost and wide dynamic range, but do not have a pin to directly control the infrared lamp 2 (for example, the STOBE pin of a global shutter image sensor can directly control the infrared lamp), can all utilize the connection method provided in this invention to achieve brightness control of the infrared lamp 2. Exemplarily, in some exemplary embodiments, the image sensor is a rolling shutter image sensor 4.

[0038] For example, please continue to see Figure 2In some exemplary embodiments, the first general-purpose input / output pin (CPIO 0) and the second general-purpose input / output pin (CPIO 4) are two previously unused general-purpose input / output pins on the image signal processor 3. Thus, this invention achieves brightness control of the infrared lamp 2 by utilizing these idle, unused general-purpose input / output pins on the image signal processor 3, without requiring any additional external components. This avoids additional modifications to the original circuitry, achieving precise control of the infrared lamp 2 while significantly reducing system cost and circuit layout complexity.

[0039] A second embodiment of the present invention provides an infrared light control method applied to the driver monitoring system described above. For example, please continue to refer to... Figure 2 and Figure 3 , Figure 3 This is a flowchart illustrating the infrared lamp control method provided in the second embodiment of the present invention. Figure 3 As shown, the infrared lamp control method includes:

[0040] Step S1: Configure the first general-purpose input / output pin as input mode, configure the second general-purpose input / output pin as output mode and multiplex it as timer mode, and set the timing duration of the timer module;

[0041] In step S2, the image sensor sends an exposure trigger signal to the image signal processor 3 through the first general-purpose input / output pin when the exposure begins;

[0042] Step S3: When the exposure trigger signal is detected, the image signal processor 3 outputs a first level signal to the infrared lamp 2 through the second general-purpose input / output pin to control the infrared lamp 2 to light up and trigger the timer module 31 to start timing, so that the duration of the first level signal is the timing duration.

[0043] Step S4: When the timer module 31 reaches the set time duration, the image signal processor 3 outputs a second level signal to the infrared lamp 2 through the second general-purpose input / output pin to control the infrared lamp 2 to turn off and reset the timer module 31.

[0044] Therefore, the infrared lamp control method provided in this embodiment can establish a connection between the exposure trigger signal of the image sensor and the control terminal of the infrared lamp 2 through only two general-purpose input / output pins inside the image signal processor 3 and the timer module 31, ensuring that the brightness time of the infrared lamp 2 can cover the maximum exposure time of the image sensor; at the same time, by flexibly adjusting the timing duration of the timer module 31, the lamp control logic can be dynamically adjusted for different frame rates or exposure modes, thereby greatly improving the system integration and maintainability without adding any external components.

[0045] In summary, by using the first general-purpose input / output pin of the image signal processor 3 connected to the image sensor, and the second general-purpose input / output pin connected to the infrared lamp 2, the driver monitoring system can lay a good foundation for the infrared lamp control method provided in this embodiment. This method utilizes the exposure trigger signal generated by the image sensor (such as a rolling shutter image sensor) during exposure and transmits it to the infrared lamp 2 through the image signal processor 3. The image signal processor 3 can precisely control the lighting and extinguishing of the infrared lamp 2 by detecting the state of the exposure trigger signal in real time and controlling the output of the second general-purpose input / output pin according to the state. This enables synchronous activation of supplementary lighting during exposure, thereby simultaneously meeting the requirements of the driver monitoring system provided by this invention for wide dynamic range and infrared lamp control.

[0046] It should be noted that those skilled in the art should understand that, as a preferred embodiment, steps S2 to S4 need to be executed every time the image sensor is exposed, while the step S1 of “configuring the first general-purpose input / output pin to input mode, configuring the second general-purpose input / output pin to output mode and multiplexing it to timer mode, and setting the timing duration of the timer module” can be executed only once when the driver monitoring system is powered on.

[0047] Exemplary, in some exemplary embodiments, the exposure trigger signal includes a pulse signal, and the image signal processor 3 detects the rising edge of the pulse signal to determine the exposure trigger signal. Therefore, the infrared lamp control method provided in this embodiment, by detecting the rising edge of the pulse signal to determine the exposure trigger signal, can ensure that the image signal processor 3 can immediately output the first level signal to the infrared lamp 2 through the second general-purpose input / output pin when the exposure trigger signal arrives, and promptly control the infrared lamp to light up, thereby significantly improving the system reliability and the timing accuracy of exposure compensation.

[0048] Further, please see Figure 4This is a simplified schematic diagram illustrating the principle of the infrared lamp control method provided in this embodiment. To more clearly describe the infrared lamp control method provided in this embodiment, the following will be combined with... Figure 2 and Figure 4 A detailed description will be provided, exemplified below. For example... Figure 4 As shown, when the image sensor ( Figure 4 When an image sensor (e.g., a rolling shutter) begins exposure, it generates an exposure trigger signal. The image signal processor 3 performs edge detection on this signal through the first general-purpose input / output pin, and detects the rising edge (when the image sensor begins exposure). Figure 4 As shown by the red line in the image, the first level signal is output to the infrared lamp 2 through the second general-purpose input / output pin. Figure 4 (Using a high-level signal as an example), to control the infrared lamp 2 to light up, and simultaneously trigger the timer module 31 to start timing. When the timer module 31 reaches the specified timing duration, the image signal processor 3 outputs the second-level signal to the infrared lamp 2 through the second general-purpose input / output pin. Figure 4 (Example: low level) to control the infrared lamp 2 to turn off and reset the timer module 31.

[0049] Furthermore, in order to ensure that the brightness time of the infrared lamp 2 can cover the maximum exposure time of the image sensor, in some exemplary embodiments, the timing duration is greater than or equal to the maximum exposure time of the image sensor.

[0050] It should be noted that the specific value of the timing duration is not limited in the embodiments of the present invention, and those skilled in the art can make adaptive configurations based on the exposure characteristics of the image sensor. For example, in some exemplary embodiments, the timing duration is 7~12ms. Preferably, the timing duration is 10ms. Thus, the present invention sets the timing duration within the range of 7~12ms, thereby avoiding insufficient illumination due to an excessively short timing duration and excessive power consumption due to an excessively long timing duration.

[0051] It should also be noted that the lighting logic of the infrared lamp 2 may differ in different driver monitoring systems (e.g., high-level lighting or low-level lighting). Therefore, those skilled in the art will understand that the embodiments of the present invention do not limit the specific polarity of the first level signal and the second level signal used to control the lighting and extinguishing of the infrared lamp 2. For example, in one exemplary embodiment, the first level signal is high (lighting the infrared lamp) and the second level signal is low (extinguishing the infrared lamp); in another exemplary embodiment, the first level signal is low (lighting the infrared lamp) and the second level signal is high (extinguishing the infrared lamp). Thus, this configuration can adapt to different driver monitoring systems, thereby improving the applicability of the method of the present invention.

[0052] For example, to further simplify the control logic, in some exemplary embodiments, the method further includes configuring the timer module 31 to a single-count mode. This allows the timer module 31 to automatically stop and enter an idle state after a single count, thereby significantly reducing the operating power consumption of the timer module 31 and consequently reducing the overall power consumption of the entire system.

[0053] Furthermore, the method also includes: when the driver monitoring system is powered on again, re-initializing and configuring the first general-purpose input / output pin, the second general-purpose input / output pin, and the timer module 31 to restore control over the infrared lamp 2. Thus, this invention achieves brightness control of the infrared lamp 2 through power-on reconfiguration after a power outage, without the need for dedicated control pins, thereby reducing system hardware costs.

[0054] A third embodiment of the present invention provides an electronic device, for example, please refer to [link to relevant documentation]. Figure 5 , Figure 5 This is a block diagram of the electronic device provided in this embodiment. Figure 5 As shown, the electronic device provided in this embodiment includes a processor 51 and a memory 52. ​​The memory 52 stores a computer program. When the computer program is executed by the processor 51, it implements the infrared light control method of the driver monitoring system described above.

[0055] Since the electronic device provided in this embodiment belongs to the same inventive concept as the infrared lamp control method provided in the second embodiment of the present invention and the present invention, the electronic device provided in this embodiment has at least all the advantages of the infrared lamp control method provided in the second embodiment of the present invention. For details, please refer to the relevant description of the beneficial effects of the infrared lamp control method above, which will not be repeated here.

[0056] For example, such as Figure 5 As shown, the electronic device may further include a communication interface 53 and a communication bus 54, wherein the processor 51, the communication interface 53, and the memory 52 communicate with each other via the communication bus 54. For ease of illustration, only one thick line is used to represent this in the figure, but this does not indicate that there is only one bus or one type of bus. The communication interface 53 is used for communication between the aforementioned electronic device and other electronic devices.

[0057] The processor 51 referred to in this invention can be a microcontroller unit (MCU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. The processor 51 is the control center of the electronic device, connecting various parts of the entire electronic device through various interfaces and lines.

[0058] The memory 52 can be used to store the computer program. The processor 51 implements various functions of the electronic device by running or executing the computer program stored in the memory 52 and calling the data stored in the memory 52.

[0059] The memory 52 may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), dual data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), RAMbus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and RAMbus dynamic RAM (RDRAM), etc.

[0060] A fourth embodiment of the present invention provides a readable storage medium storing a computer program. When executed by a processor, the computer program can implement the infrared lamp control method described above. Since the readable storage medium provided in this embodiment belongs to the same inventive concept as the infrared lamp control method provided in the second embodiment of the present invention, the readable storage medium provided in this embodiment possesses at least all the advantages of the infrared lamp control method provided in the second embodiment of the present invention. For details regarding the beneficial effects of the readable storage medium provided in this embodiment, please refer to the above description of the beneficial effects of the infrared lamp control method provided in the second embodiment of the present invention; further details will not be repeated here.

[0061] The readable storage medium of embodiments of the present invention can be any combination of one or more computer-readable media. The readable medium can be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (not exhaustive examples) of a computer-readable storage medium include: an electrical connection having one or more wires, a portable computer hard disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus, or device.

[0062] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device.

[0063] Computer program code for performing the operations of this invention can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0064] Compared with the prior art, the driver monitoring system, infrared lamp control method, electronic device and medium provided by the present invention have the following beneficial effects: The driver monitoring system provided by the present invention connects the first general-purpose input / output pin of the image signal processor to the image sensor and the second general-purpose input / output pin to the infrared lamp. The image signal processor uses the image signal processor to detect in real time the state of the exposure trigger signal generated by the image sensor (such as a rolling shutter image sensor) during exposure, and controls the output of the second general-purpose input / output pin to output high and low levels according to the state, thereby precisely controlling the lighting and extinguishing of the infrared lamp, thereby realizing the synchronous activation of supplementary lighting during exposure. Thus, the driver monitoring system provided by the present invention, which uses an image sensor without a dedicated infrared lamp control pin, can simultaneously meet the requirements of wide dynamic range and infrared lamp control.

[0065] Furthermore, by presetting the timing duration of the timer module, the present invention can ensure that the illumination duration of the infrared lamp covers the maximum exposure time of the image sensor; at the same time, the present invention only utilizes two previously unused general-purpose input / output pins on the image signal processor, without adding any additional components, to achieve a wide dynamic range while precisely controlling the infrared lamp, thereby significantly reducing the cost of the driver monitoring system.

[0066] In the description of this specification, references to terms such as "one embodiment," "some embodiments," "example," or "specific example," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments. In addition, those skilled in the art can combine and integrate the different embodiments or examples described in this specification.

[0067] The above are merely preferred embodiments of the present invention and do not constitute any limitation on the present invention. Any equivalent substitutions or modifications made by those skilled in the art to the technical solutions and content disclosed in the present invention without departing from the scope of the present invention shall be deemed to have remained within the protection scope of the present invention.

Claims

1. A driver monitoring system, characterized in that, It includes an image signal processor, an image sensor, and an infrared lamp; the image signal processor includes a timer module, and the image sensor and the infrared lamp are respectively communicatively connected to the first general-purpose input / output pin and the second general-purpose input / output pin of the image signal processor. The first general-purpose input / output pin is configured in input mode, and the second general-purpose input / output pin is configured in output mode and multiplexed as a timer mode; The image sensor is configured to send an exposure trigger signal to the image signal processor via the first general-purpose input / output pin when exposure begins. The image signal processor is configured to output a first level signal to the infrared lamp through the second general-purpose input / output pin when the exposure trigger signal is detected, so as to control the infrared lamp to light up and trigger the timer module to start timing, so that the duration of the first level signal is a preset timing duration; When the timer module reaches the set time, it outputs a second level signal to the infrared lamp through the second general-purpose input / output pin to control the infrared lamp to turn off and reset the timer module.

2. The driver monitoring system as described in claim 1, characterized in that, The image sensor is a rolling shutter image sensor.

3. An infrared lamp control method, characterized in that, The method, applied to the driver monitoring system of claim 1 or 2, comprises: Configure the first general-purpose input / output pin as input mode, configure the second general-purpose input / output pin as output mode and multiplex it as timer mode, and set the timing duration of the timer module; When the image sensor begins exposure, it sends an exposure trigger signal to the image signal processor through the first general-purpose input / output pin. When the exposure trigger signal is detected, the image signal processor outputs a first level signal to the infrared lamp through the second general-purpose input / output pin to control the infrared lamp to light up and trigger the timer module to start timing, so that the duration of the first level signal is the timing duration; When the timer module reaches the set time, the image signal processor outputs a second level signal to the infrared lamp through the second general-purpose input / output pin to control the infrared lamp to turn off and reset the timer module.

4. The infrared lamp control method as described in claim 3, characterized in that, The exposure trigger signal includes a pulse signal, and the image signal processor detects the rising edge of the pulse signal to determine the exposure trigger signal.

5. The infrared lamp control method as described in claim 3, characterized in that, The timing duration is greater than or equal to the maximum exposure time of the image sensor.

6. The infrared lamp control method as described in claim 5, characterized in that, The timing duration is 7~12ms.

7. The infrared lamp control method as described in claim 3, characterized in that, The first level signal is high level, and the second level signal is low level.

8. The infrared lamp control method as described in claim 3, characterized in that, The method further includes configuring the timer module to a single-count mode.

9. An electronic device, characterized in that, It includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, it implements the infrared lamp control method according to any one of claims 3 to 8.

10. A readable storage medium, characterized in that, The readable storage medium stores a computer program, which, when executed by a processor, implements the infrared lamp control method according to any one of claims 3 to 8.

Images