Vehicle-mounted monitoring display system

Abstract

The invention discloses a vehicle-mounted monitoring display system. The vehicle-mounted monitoring display system comprises an image controller, a transparent display device and an image sensor. The image controller provides a picture display signal and a picture synchronization signal. The transparent display device is coupled to the image controller to display based on the picture display signal. The image sensor is shaded by a part of the transparent display devices and is coupled with the image controller so as to acquire images based on the picture synchronization signal when the part of the transparent display devices are transparent.

Description

Technical Field

[0001] The invention relates to a monitoring system, and in particular to a vehicle-mounted monitoring display system. Background Art

[0002] Driver Monitoring System (DMS) and Occupant Monitoring System (OMS), also known as cockpit monitoring system, is a vehicle safety system that uses image cameras or sensors to monitor driving behavior / status, and is used to warn the driver when necessary, or provide automatic driving for steering or braking. However, image cameras or sensors are usually configured separately from display devices, affecting the configuration and visual perception of the interior space. Summary of the invention

[0003] The invention provides a vehicle-mounted monitoring display system, which enables an image sensor and a transparent display device to be overlapped, thereby increasing the configurability of the vehicle interior space and improving the visual perception of the vehicle interior space.

[0004] The vehicle-mounted monitoring display system of the present invention comprises an image controller, a transparent display device and an image sensor. The image controller provides a picture display signal and a picture synchronization signal. The transparent display device is coupled to the image controller to display based on the picture display signal. The image sensor is covered by a portion of the transparent display device and is coupled to the image controller to acquire an image based on the picture synchronization signal when a portion of the transparent display device is transparent.

[0005] Based on the above, in the vehicle monitoring display system of the embodiment of the present invention, the transparent display device and the image sensor can be operated synchronously based on the screen synchronization signal, so that the image sensor can acquire images without being masked by the image displayed by the transparent display device. Therefore, the image sensor can be set under the panel without affecting the image acquisition, so as to omit the corresponding configuration space, thereby improving the configurability of the interior space of the vehicle and improving the visual perception of the interior space of the vehicle.

[0006] In order to make the above features and advantages of the present invention more obvious and easy to understand, embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 FIG. 4 is a system diagram of a vehicle monitoring and display system according to an embodiment of the present invention.

[0008] Figure 2 FIG. 4 is a schematic diagram of a first operation sequence of a vehicle monitoring and display system according to an embodiment of the present invention.

[0009] Figure 3 FIG. 4 is a schematic diagram of a second operation timing sequence of a vehicle-mounted monitoring and display system according to an embodiment of the present invention.

[0010] Figure 4 FIG. 4 is a schematic diagram of a third operation timing sequence of a vehicle-mounted monitoring and display system according to an embodiment of the present invention.

[0011] Figure 5 FIG. 4 is a schematic diagram of transmitting a picture synchronization signal of a vehicle-mounted monitoring display system according to an embodiment of the present invention.

[0012] Figure 6 FIG. 4 is a schematic diagram of transmitting a picture synchronization signal of a vehicle-mounted monitoring display system according to another embodiment of the present invention.

[0013] Figure 7 FIG. 4 is a schematic diagram of transmitting timing information of a vehicle monitoring and display system according to an embodiment of the present invention.

[0014] Figure 8 FIG. 4 is a schematic diagram of transmitting timing information of a vehicle monitoring and display system according to another embodiment of the present invention.

[0015] Description of reference numerals:

[0016] 100: Vehicle monitoring display system

[0017] 110: Transparent display device

[0018] 120: Image controller

[0019] 130: Display interface circuit

[0020] 140: Image sensor

[0021] 150: Image interface circuit

[0022] 200: Control circuit

[0023] 201: Cable Power Generator

[0024] 202, 223: Cable connector

[0025] 203: Control unit

[0026] 204: Control interface circuit

[0027] 220: Camera module

[0028] 221: Power circuit

[0029] 222: Cable power filter

[0030] 225: Memory

[0031] 226: Reset Circuit

[0032] 227: Image Processor

[0033] 240: Oscillator

[0034] CLK: Clock signal

[0035] Dctl: Control Data

[0036] Dext: External Data

[0037] Dimage: Image data

[0038] Dint: internal data

[0039] DP: Display signal

[0040] Frame_Sync: Screen synchronization signal

[0041] Frame1~Frame4:Screen duration

[0042] L01~L04:Acquisition period

[0043] Reset: Reset signal

[0044] Scam: photography control signal

[0045] Sdp: screen display signal

[0046] Simage: Image signal

[0047] TXP, TXF: Transmission path

[0048] Vop: operating voltage DETAILED DESCRIPTION

[0049] Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs. It will be further understood that terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology and the present invention, and will not be interpreted as an idealized or overly formal meaning unless explicitly defined as such herein.

[0050] It should be understood that although the terms "first", "second", "third", etc. can be used to describe various elements, components, regions, layers and / or parts in this article, these elements, components, regions, and / or parts should not be limited by these terms. These terms are only used to distinguish one element, component, region, layer or part from another element, component, region, layer or part. Therefore, the "first element", "component", "region", "layer" or "part" discussed below can be referred to as a second element, component, region, layer or part without departing from the teachings of this article.

[0051] The terms used herein are only for the purpose of describing specific embodiments and are not restrictive. As used herein, unless the content clearly indicates, the singular forms "one", "an" and "the" are intended to include plural forms, including "at least one". "Or" means "and / or". As used herein, the term "and / or" includes any and all combinations of one or more related listed items. It should also be understood that when used in this specification, the terms "include" and / or "include" specify the presence and / or parts of the features, regions, entireties, steps, operations, elements, but do not exclude the presence or addition of one or more other features, regions, entireties, steps, operations, elements, parts and / or their combinations.

[0052] Figure 1 This is a schematic diagram of a vehicle monitoring and display system according to an embodiment of the present invention. Figure 1 In this embodiment, the vehicle monitoring display system 100 can be applied to a driving monitoring system and / or a passenger monitoring system, that is, the vehicle monitoring display system 100 can be a part of the driving monitoring system or the passenger monitoring system. In this embodiment, the vehicle monitoring display system 100 includes a transparent display device 110, an image controller 120, a display interface circuit 130, an image sensor 140, and an image interface circuit 150.

[0053] The image controller 120 provides a screen display signal Sdp and a screen synchronization signal Frame_Sync. The transparent display device 110 is coupled to the image controller 120 to display based on the screen display signal Sdp. The image sensor 140 is masked by a portion of the transparent display device 110 and is coupled to the image controller 120 to acquire an image based on the screen synchronization signal Frame_Sync when a portion of the transparent display device 110 is not lit (i.e., transparent).

[0054] According to the above, the transparent display device 110 and the image sensor 140 can be operated synchronously based on the frame synchronization signal Frame_Sync, so that the image sensor 140 can acquire images without being masked by the image displayed by the transparent display device 110. Therefore, the image sensor 140 can be arranged under the panel without affecting the image acquisition, so as to omit the corresponding configuration space, thereby improving the configurability of the interior space of the vehicle and improving the visual perception of the interior space of the vehicle.

[0055] In this embodiment, the display interface circuit 130 is coupled to the image controller 120 and receives information from an external control circuit (eg, Figure 5 The control circuit 200 is shown in FIG. 1 ) to generate a display signal DP based on the external data Dext to the image controller 120. Furthermore, the image controller 120 generates a frame display signal Sdp and a frame synchronization signal Frame_Sync based on the display signal DP.

[0056] In this embodiment, the image interface circuit 150 is coupled to the image sensor 140 and receives signals from an external control circuit (eg, Figure 5 The control circuit 200 shown in FIG. 1 is used to provide the control data Dctl to provide the photography control signal Scam to the image sensor 140 to control the photography behavior of the image sensor 140. In addition, the image interface circuit 150 generates the image data Dimage based on the image signal Simage from the image sensor 140 to provide it to the corresponding external control circuit (such as Figure 5 Control circuit 200 shown).

[0057] In the embodiment of the present invention, the frame synchronization signal Frame_Sync may be a voltage level signal (ie, a signal switching between a high voltage level and a low voltage level), or an Inter-Integrated Circuit (I 2 C) signal or a control command transmitted by a serial peripheral interface (Serial Peripheral Interface, SPI) signal, but the embodiment of the present invention is not limited thereto.

[0058] In the embodiment of the present invention, the transparent display device 110 may be a micro light emitting diode (LED) display, but the embodiment of the present invention is not limited thereto.

[0059] In the embodiment of the present invention, the display interface circuit 130 and the display interface circuit 150 may respectively include at least one of a serializer and a deserializer, but the embodiment of the present invention is not limited thereto.

[0060] In the embodiment of the present invention, the transparent display device 110 can be a transparent display that is lit up in the entire area at the same time (i.e., a transparent display that is not lit up in sequence in line scanning). At this time, the image controller 120 calculates the black screen insertion timing (i.e., the acquisition period L01, L02) according to the exposure time and frequency of the image sensor 140. When the image controller 120 sends the frame synchronization signal Frame_Sync, the image sensor 140 acquires the image according to the frame synchronization signal Frame_Sync.

[0061] In the embodiment of the present invention, the transparent display device 110 may be a transparent display that is lit up in sequence during scanning. At this time, the image sensor 140 may acquire an image when the pixel column area covering the image sensor 140 (i.e., the pixel column of the image sensor 140 covered by the projection area) is not lit up according to the frame synchronization signal Frame_Sync of the image controller 120.

[0062] In the embodiment of the present invention, the exposure time and the sampling frequency may be changed due to different application environments (such as day and night) of the image sensor 140, thereby using different timing configurations for display and image acquisition.

[0063] Figure 2 This is a schematic diagram of the first operation sequence of the vehicle monitoring display system according to an embodiment of the present invention. Figure 1 and Figure 2 In this embodiment, the period during which the transparent display device 110 performs display (ie, non-transparent) and the period during which the image sensor 140 performs image acquisition (ie, the period during which the transparent display device 110 does not perform display but appears transparent) are separated in terms of timing. Figure 2 As shown, the transparent display device 110 performs display in frame periods (such as Frame1 to Frame4 ) based on the frame display signal Sdp, and the image sensor 140 performs image acquisition in acquisition periods (such as L01 and L02 ).

[0064] In this embodiment, two frame periods (such as Frame1 to Frame4) are grouped together, and the two frame periods (such as Frame1 to Frame4) in a group are respectively compressed forward in time to arrange acquisition periods L01 and L02 that can be used for image acquisition by the image sensor 140. In other words, the two frame periods (such as Frame1 to Frame4) adjacent to each of the acquisition periods (such as L01 and L02) are different from the two frame periods (such as Frame1 to Frame4) adjacent to the other of the acquisition periods (such as L01 and L02).

[0065] Furthermore, in this embodiment, since each of the acquisition periods (such as L01, L02) is obtained by compressing two adjacent frame periods (such as Frame1 to Frame4), it can have a longer exposure time and can be performed at night. In other words, the time configuration in which the two frame periods (such as Frame1 to Frame4) adjacent to each of the acquisition periods (such as L01, L02) are different from the two frame periods (such as Frame1 to Frame4) adjacent to the other of the acquisition periods (such as L01, L02) can be performed during the night.

[0066] Figure 3 This is a schematic diagram of the second operation sequence of the vehicle monitoring display system according to an embodiment of the present invention. Figure 1 and Figure 3 In this embodiment, the period during which the transparent display device 110 performs display (ie, non-transparent) and the period during which the image sensor 140 performs image acquisition (ie, the period during which the transparent display device 110 does not perform display but appears transparent) are separated in terms of timing. Figure 3 As shown, the transparent display device 110 performs display in the frame periods (Frame1-Frame4) based on the frame display signal Sdp, and the image sensor 140 performs image acquisition in the acquisition periods L01-L04.

[0067] In this embodiment, the frame periods (such as Frame1 to Frame4) and the acquisition periods (such as L01 to L04) are arranged alternately, that is, each frame period (such as Frame1 to Frame4) is compressed forward to discharge the corresponding acquisition period (such as L01 to L04). Figure 2 If the frame rate of the transparent display device 110 remains the same, Figure 3 The acquisition period shown (such as L01 to L04) will be shorter than Figure 2 The acquisition periods (such as L01 and L02) shown in the figure can be performed in the evening or when entering a tunnel, but at night or when insufficient light is present, the imaging effect of the image sensor 140 will be affected. In other words, the image periods (such as Frame1 to Frame4) and the acquisition periods (such as L01 to L04) are alternately configured and can be performed in the evening or when traveling in a tunnel.

[0068] Figure 4 This is a schematic diagram of the third operation sequence of the vehicle monitoring display system according to an embodiment of the present invention. Figure 1 and Figure 4In this embodiment, the period during which the transparent display device 110 performs display (ie, non-transparent) and the period during which the image sensor 140 performs image acquisition (ie, the period during which the transparent display device 110 does not perform display but appears transparent) are separated in terms of timing. Figure 4 As shown, the transparent display device 110 performs display in the frame periods (Frame1-Frame3) based on the frame display signal Sdp, and the image sensor 140 performs image acquisition in the acquisition periods (such as L01 and L02).

[0069] In this embodiment, each of the acquisition periods (such as L01 to L04) and the corresponding one of the frame periods (such as Frame1 to Frame4) are partially overlapped. Here, the acquisition period L01 and the frame period Frame2 are reset, and it is assumed that the position of the image sensor 140 is corresponding to the center point position of the transparent display device 110. Therefore, when the frame period Frame2 starts scanning, the center point position of the transparent display device 110 should not be lit (that is, the point where the image is not displayed). At this time, the center point position of the transparent display device 110 is transparent, so the image sensor 140 can use this to acquire the image, as shown in the acquisition period L01.

[0070] In this embodiment, since the acquisition period (such as L01, L02) occupies part of the pixel columns in the frame period (Frame1-Frame3), it has a relatively low exposure time and can be performed during the day, but the evening or weak light conditions will affect the imaging of the image sensor 140. In other words, each of the acquisition periods (such as L01, L02) and the corresponding one of the frame periods (such as Frame1-Frame3) are overlapped and are performed during the day.

[0071] In this embodiment, execution in daytime / sunset / night corresponds to the lighting conditions, so Figures 2 to 4 In the embodiment of the present invention, the application can be selected according to whether the image of the image sensor 140 is overexposed or underexposed. Figures 2 to 4 An embodiment of one of the embodiments. Figure 2 For example, if the image is overexposed, you can jump to Figure 4 Example, or underexposure can jump to Figure 2 However, the embodiments of the present invention are not limited thereto.

[0072] Figure 5 FIG. 1 is a schematic diagram of transmitting a picture synchronization signal of a vehicle-mounted monitoring display system according to an embodiment of the present invention. Figure 1 and Figure 5In this embodiment, the image sensor 140 and the image interface circuit 150 may be located in the camera module 220 , that is, the vehicle monitoring display system 100 may further include the camera module 220 , and the camera module 220 is coupled to the control circuit 200 .

[0073] In this embodiment, the control circuit 200 includes a cable power generator 201, a cable connector 202, a control unit 203, and a control interface circuit 204. In addition, the camera module 220 also includes a power circuit 221, a cable power filter 222, a cable connector 223, an oscillator 240, a memory 225, a reset circuit 226, and an image processor 227.

[0074] The control interface circuit 204 is coupled to the cable power generator 201, the cable connector 202 and the control unit 203. The cable connector 202 is coupled to the cable connector 223 through the cable 210. The power circuit 221 is coupled to the cable connector 223 through the cable power filter 222, and the power circuit 221 is coupled to the oscillator 240, the memory 225, the reset circuit 226 and the image interface circuit 150 to provide the operation voltage Vop required for operation. The image processor 227 is coupled to the image interface circuit 150, the oscillator 240, the memory 225, the reset circuit 226 to receive the clock signal CLK from the oscillator 240, the internal data Dint from the memory 225, and the reset signal Reset from the reset circuit 226. In addition, the image interface circuit 150 is coupled to the cable connector 223.

[0075] In this embodiment, the frame synchronization signal Frame_Sync from the image controller 120 is transmitted to the image sensor 140 by a separate line. The image sensor 140 can start exposure at the rising edge of the frame synchronization signal Frame_Sync. In addition, the image sensor 140 completes the exposure of the three primary colors of red, green, and blue and / or near-infrared (NIR) exposure within a limited time (the time limited by the frame synchronization signal Frame_Sync). The frame synchronization signal Frame_Sync and the exposure cycle of the image sensor 140 must be precisely synchronized. In addition, additional lines / components are required to transmit the frame synchronization signal Frame_Sync.

[0076] Figure 6 FIG. 1 is a schematic diagram of transmitting a picture synchronization signal of a vehicle-mounted monitoring display system according to another embodiment of the present invention. Figure 1 , Figure 5 and Figure 6, wherein the same or similar elements are numbered the same or similarly. In the present embodiment, the image interface circuit 150 is coupled to the image sensor 140, and the frame synchronization signal Frame_Sync is transmitted to the image sensor 140 along the transmission path TXP. That is, the control interface circuit 204 sends the frame synchronization signal Frame_Sync through the cable 210. At this time, the image sensor 140 is always in a standby state. Moreover, the image sensor 140 completes the exposure of the three primary colors of red, green, and blue and / or near-infrared (NIR) exposure within a limited time (the time limited by the frame synchronization signal Frame_Sync). The frame synchronization signal Frame_Sync, the line delay, and the exposure control of the image sensor 140 must be precisely synchronized.

[0077] Figure 7 FIG. 1 is a schematic diagram of the transmission of timing information of a vehicle monitoring and display system according to an embodiment of the present invention. Figure 1 , Figure 5 and Figure 7 , wherein the same or similar components are numbered the same or similarly. In this embodiment, the image sensor 140 refreshes the image signal Simage fixedly, and provides a synchronization signal Inf_Sync related to the frame refresh rate to the image controller 120 via a separate line. At this time, the image sensor 140 can change from passive shooting to active shooting, and is linked with the transparent display device 110. The linkage method can refer to Figures 1 to 4 As shown, no further details will be given here.

[0078] Figure 8 FIG. 1 is a schematic diagram of the transmission of timing information of a vehicle monitoring display system according to another embodiment of the present invention. Figure 1 , Figure 5 and Figure 7 , wherein the same or similar components are numbered the same or similarly. In this embodiment, the image sensor 140 refreshes the image signal Simage fixedly, and provides a synchronization signal Inf_Sync related to the frame refresh rate to the image controller 120 along the transmission path TXF. At this time, the image sensor 140 can change from passive shooting to active shooting, and is linked with the transparent display device 110. The linkage method can refer to Figures 1 to 4 As shown, no further details will be given here.

[0079] In summary, in the vehicle monitoring display system of the embodiment of the present invention, the transparent display device and the image sensor can be operated synchronously based on the screen synchronization signal, so that the image sensor can acquire images without being masked by the image displayed by the transparent display device. Therefore, the image sensor can be set under the panel without affecting the image acquisition, so as to omit the corresponding configuration space, thereby improving the configurability of the interior space of the vehicle and improving the visual perception of the interior space of the vehicle.

[0080] Although the present invention has been disclosed as above by way of embodiments, it is not intended to limit the present invention. Any person skilled in the art may make some changes and modifications without departing from the concept and scope of the present invention. Therefore, the protection scope of the present invention shall be determined by the claims.

Claims

1. A vehicle-mounted monitoring and display system, comprising: An image controller provides a picture display signal and a picture synchronization signal; a transparent display device coupled to the image controller to display based on the image display signal; and An image sensor is covered by a portion of the transparent display device and is coupled to the image controller to acquire images when the portion of the transparent display device is transparent based on the frame synchronization signal.

2. The vehicle-mounted monitoring display system as claimed in claim 1, wherein the transparent display device performs display in a plurality of frame periods based on the frame display signal, and the image sensor performs image acquisition in a plurality of acquisition periods. 3 . The vehicle-mounted monitoring display system as claimed in claim 2 , wherein the frame periods and the acquisition periods are alternately arranged. 4 . The vehicle-mounted monitoring display system as claimed in claim 3 , wherein the frame periods and the acquisition periods are alternately arranged and are executed during an evening period or a period of traveling in a tunnel. 5 . The vehicle-mounted monitoring display system as claimed in claim 2 , wherein two frame periods adjacent to each of the acquisition periods are different from two frame periods adjacent to another of the acquisition periods. 6 . The vehicle monitoring display system as claimed in claim 5 , wherein the time arrangement in which two frame periods adjacent to each of the acquisition periods are different from two frame periods adjacent to another of the acquisition periods is performed during a night period. 7 . The vehicle-mounted monitoring display system as claimed in claim 2 , wherein each of the acquisition periods and a portion of a corresponding one of the frame periods are overlapped. 8 . The vehicle-mounted monitoring display system as claimed in claim 7 , wherein each of the acquisition periods and a corresponding one of the frame periods are overlapped and executed during a daytime period.

Images