Display system

By integrating image processor circuits and central processor circuits in the display system, analyzing and detecting signals and generating integrated instructions, the problem of large data transmission bandwidth in the prior art is solved, and real-time analysis and safety warnings for driving or passenger violations are realized.

CN119953279APending Publication Date: 2025-05-09INNOLUX CORP +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311472720.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-11-07
Publication Date
2025-05-09

AI Technical Summary

Technical Problem

In the prior art, the sensor component module and the display module are independently designed, resulting in that all images must be analyzed at the head end, requiring a large data transmission bandwidth.

Method used

A display system is designed, including a display, a plurality of first sensor components and a system chip. The system chip includes an image processor circuit, a central processor circuit and a timing controller circuit. The image processor circuit analyzes and detects signals, the central processor circuit generates integrated instructions, and the timing controller circuit drives the display to display images.

Benefits of technology

By integrating image processing functions in the display system, the data transmission bandwidth between the system chip and the head end is reduced, real-time analysis and safety warning of driving or passenger violations is achieved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119953279A_ABST
    Figure CN119953279A_ABST
Patent Text Reader

Abstract

A display system includes a display, a plurality of first sensor assemblies, and a system-on-chip. The first sensor assembly is used for providing a plurality of detection signals. The system-on-chip is electrically connected to the display and the first sensor assembly. The system chip comprises an image processor circuit, a central processor circuit and a time schedule controller circuit. The image processor circuit is electrically connected to the first sensor assembly. The image processor circuit is used for analyzing the detection signal. The central processor circuit is electrically connected to the image processor circuit. The central processor circuit is used for generating an integration instruction according to the plurality of analyzed detection signals. The time schedule controller circuit is electrically connected to the central processor circuit. The time schedule controller circuit is used for driving the display to display an image according to the integration instruction.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a display system, and in particular to a display system for a transportation device. Background Art

[0002] The vehicle may include a display and multiple sensor components to monitor and analyze whether the driver or passengers have violated the rules and issue safety warnings. However, in the prior art, the sensor component module and the display module are designed independently. For car manufacturers, all images must be analyzed at the head end, which requires a large data transmission bandwidth. Summary of the invention

[0003] The present disclosure provides a display system, including a display, a plurality of first sensor components and a system chip. The first sensor component is used to provide a plurality of detection signals. The system chip is electrically connected to the display and the first sensor component. The system chip includes an image processor circuit, a central processing unit circuit and a timing controller circuit. The image processor circuit is electrically connected to the first sensor component. The image processor circuit is used to analyze the detection signal. The central processing unit circuit is electrically connected to the image processor circuit. The central processing unit circuit is used to generate an integration instruction according to the analyzed plurality of detection signals. The timing controller circuit is electrically connected to the central processing unit circuit. The timing controller circuit is used to drive the display to display an image according to the integration instruction. BRIEF DESCRIPTION OF THE DRAWINGS

[0004] Figure 1 A block diagram showing a transport device according to an embodiment of the present disclosure;

[0005] Figure 2 Show Figure 1 A block diagram of a display system of an embodiment;

[0006] Figure 3 A block diagram showing a display system according to an embodiment of the present disclosure;

[0007] Figure 4 Show Figure 3 A flowchart of a method for operating a display system according to an embodiment;

[0008] Figure 5 A block diagram showing a display system according to another embodiment of the present disclosure;

[0009] Figure 6 Show Figure 5 A flow chart of a method of operating a display system according to an embodiment. DETAILED DESCRIPTION

[0010] The present disclosure can be understood by referring to the following detailed description in conjunction with the accompanying drawings. It should be noted that in order to make it easier for readers to understand and for the simplicity of the drawings, the multiple drawings in the present disclosure only depict a portion of the electronic device, and the specific components in the drawings are not drawn according to the actual scale. In addition, the number and size of each component in the figure are only for illustration and are not intended to limit the scope of the present disclosure.

[0011] In the following description and claims, the words “including” and “comprising” are open-ended words and thus should be interpreted as meaning “including but not limited to…”.

[0012] It should be understood that although the terms first, second, third, ... can be used to describe a variety of components, the components are not limited to these terms. These terms are only used to distinguish a single component from other components in the specification. The same terms may not be used in the claims, but may be replaced by first, second, third, ... according to the order of the components declared in the claims. Therefore, in the following description, the first component may be the second component in the claims.

[0013] In some embodiments of the present disclosure, terms related to joining and connection, such as "connection", "interconnection", etc., unless otherwise defined, may refer to two structures being in direct contact, or may also refer to two structures not being in direct contact, wherein other structures are disposed between the two structures. And such terms related to joining and connection may also include situations where both structures are movable, or where both structures are fixed. In addition, the term "coupling" includes any direct and indirect electrical connection means. In the case of direct electrical connection, the endpoints of components on the two circuits are directly connected or interconnected by a conductor segment, and in the case of indirect electrical connection, there are switches, diodes, capacitors, inductors, resistors, other suitable components, or combinations of the above components between the endpoints of the components on the two circuits, but not limited thereto.

[0014] The electronic device disclosed herein may include a display device, an antenna device, a sensing device, a light-emitting device, or a splicing device, but is not limited thereto. The electronic device may include a bendable or flexible electronic device. The electronic device may include an electronic component. The electronic device may include, for example, a liquid crystal layer or a light emitting diode (LED). The electronic component may include passive components and active components, such as capacitors, resistors, inductors, variable capacitors, filters, diodes, transistors, sensors, micro-electromechanical system components (MEMS), liquid crystal chips, controllers, etc., but are not limited thereto. The diode may include a light-emitting diode or a photodiode. The light-emitting diode may include, for example, an organic light emitting diode (OLED), a sub-millimeter light-emitting diode (miniLED), a micro light-emitting diode (micro LED), a quantum dot light-emitting diode (quantum dot LED), fluorescence, phosphorescence, or other suitable materials, or a combination thereof, but is not limited thereto. The sensor may include, for example, a capacitive sensor, an optical sensor, an electromagnetic sensor, a fingerprint sensor (FPS), a touch sensor, an antenna, or a pen sensor, etc., but is not limited thereto. The controller may include, for example, a timing controller, etc., but is not limited thereto. The following text will use a display device as an electronic device to illustrate the content of the present disclosure, but the present disclosure is not limited thereto.

[0015] Reference will now be made in detail to exemplary embodiments of the present disclosure, examples of which are illustrated in the accompanying drawings. Whenever possible, the same reference numerals are used in the drawings and the description to refer to the same or like parts.

[0016] Figure 1 A block diagram of a transport device according to an embodiment of the present disclosure is shown. Figure 1The transport device 100 includes a head end 110. The display system 200 is used in the transport device 100. The display system 200 is electrically connected to the head end 110 via a bus line 120. The transport device 100 is a vehicle capable of carrying people, including a vehicle, an airplane, or a ship. Taking a vehicle as an example, the bus line 120 is, for example, a vehicle bus of a controller area network (CAN).

[0017] Figure 2 Show Figure 1 A block diagram of a display system of an embodiment. Please refer to Figure 2 The display system 200 includes a display 210 , a plurality of first sensor components 220_1 , 220_2 , 220_3 , 220_4 , and a system chip 230 .

[0018] The display 210 includes a liquid crystal display, a light emitting diode display or an organic light emitting diode display. The first sensor components 220_1, 220_2, 220_3, 220_4 are used to provide a plurality of detection signals S1 to the system chip 230. The first sensor components 220_1, 220_2, 220_3, 220_4 are sensor components of the same type, for example, infrared sensors or charge coupled devices (CCD). The number and type of the first sensor components are not limited to the present disclosure.

[0019] The system chip 230 is electrically connected to the display 210 and the first sensor components 220_1, 220_2, 220_3, and 220_4. The first transmission interface IF1 includes, for example, a Mobile Industry Processor Interface (MIPI), an Ethernet interface, or a Wireless Fidelity (Wi-Fi) interface. The system chip 230 is electrically connected to the head end 110 via a second transmission interface IF2. The second transmission interface IF2 includes, for example, a CAN interface.

[0020] The system chip 230 includes an image processor circuit 232, a central processing unit circuit 234, and a timing controller circuit 236. The image processor circuit 232 is electrically connected to the first sensor components 220_1, 220_2, 220_3, and 220_4 through a first transmission interface IF1. The central processing unit circuit 234 is electrically connected to the image processor circuit 232. The central processing unit circuit 234 is electrically connected to the head end 110 through a second transmission interface IF2. The timing controller circuit 236 is electrically connected to the central processing unit circuit 234. The image processor circuit 232 is used to analyze the detection signal S1 provided by the first sensor components 220_1, 220_2, 220_3, and 220_4, and output the analyzed detection signal S1 to the central processing unit circuit 234. The central processing unit circuit 234 is used to generate an integration instruction S2 according to the analyzed detection signal S1, and give the integration instruction S2 to the timing controller circuit 236. The integration instruction S2 includes the image content to be displayed on the display 210 and optimized by the image processor circuit 232. The timing controller circuit 236 is used to drive the display 210 to display images according to the integrated instruction S2.

[0021] The integrated instruction S2 is provided to both the timing controller circuit 236 and the head end 110. For example, the CPU circuit 234 outputs the integrated instruction S2 to the head end 110 via the second transmission interface IF2. The head end 110 can control the transport device 100 to perform corresponding actions according to the integrated instruction S2.

[0022] In this embodiment, the image processor circuit 232, the central processing unit circuit 234 and the timing controller circuit 236 may include a controller or a processor, which is a circuit component with computing capabilities. Alternatively, the controller or processor included in the processor circuit can be designed by hardware description languages ​​(HDL) or any other design method for digital circuits familiar to those skilled in the art, and can be a hardware circuit implemented by a field programmable gate array (FPGA), a complex programmable logic device (CPLD) or an application-specific integrated circuit (ASIC). The image processor circuit 232 can also be an image processing module, which is implemented as a plurality of program codes. These program codes will be stored in the memory, and these program codes will be executed by a circuit component with computing capabilities to perform the corresponding image processing operations. The present disclosure does not limit the implementation of each circuit module in the system chip 230 by software or hardware.

[0023] Figure 3 A block diagram of a display system according to an embodiment of the present disclosure is shown. Figure 3 The display system 300 further includes a third sensor component 250, and the system chip 230 further includes a local dimming circuit 238. The display 210 includes a display panel 212 and a light source module 214. The third sensor component 250 is electrically connected to the system chip 230. The local dimming circuit 238 is electrically connected to the central processing unit circuit 234.

[0024] Specifically, the third sensor component 250 is electrically connected to the CPU circuit 234 via the third transmission interface IF3. The third transmission interface IF3 is, for example, an Inter-Integrated Circuit (I2C) interface. The third sensor component 250 is, for example, an ambient light sensor for providing an ambient light signal S3. The number and type of the third sensor components are not intended to limit the present disclosure.

[0025] The head end 110 generates a first image signal S4 according to the integrated instruction S2. The first image signal S4 is provided to the central processing unit circuit 234 through the second transmission interface IF2. For example, when the head end 110 is to perform a safety warning through the display 210, the first image signal S4 can be provided to the central processing unit circuit 234. The central processing unit circuit 234 then drives the timing controller circuit 236 and the local dimming circuit 238 according to the first image signal S4. The timing controller circuit 236 provides the second image signal S5 to the display panel 212 to drive the display panel 212 to display an image screen. The image screen includes a safety warning. The local dimming circuit 238 provides a third image signal S6 to the light source module 214 to control the light source module 214 to perform a local dimming function.

[0026] Figure 4 Show Figure 3 Flow chart of the operating method of the display system of the embodiment. Please refer to Figure 3 and Figure 4 , taking vehicles as an example, Figure 3 The display system 300 of the embodiment is, for example, an electronic device used in a vehicle cockpit system. Therefore, the display system 300 includes a vehicle display, which can receive data signals and image signals from devices such as a vehicle computer or an electronic control unit (ECU) to display dashboard information and image information respectively, but the present disclosure is not limited to receiving signals from a vehicle computer and an electronic control unit.

[0027] The first sensor components 220_1, 220_2, and 220_3 are, for example, arranged at the front seat of the vehicle, and the first sensor component 220_4 is, for example, arranged at the rear seat of the vehicle. The image processor circuit 232 may select the detection signal S1 for analysis according to the actual situation in the vehicle. For example, the first sensor components 220_1, 220_2, 220_3, and 220_4 may first perform a preliminary scan. If the central processing unit circuit 234 determines that there is no one in the rear seat, the image processor circuit 232 may select the detection signal S1 of the three first sensor components 220_1, 220_2, and 220_3 of the front seat for analysis. In other words, the image processor circuit 232 analyzes the detection signal S1 provided by the first sensor components 220_1, 220_2, and 220_3 of the front seat, but does not analyze the detection signal S1 provided by the first sensor component 220_4 of the rear seat. In addition, the central processing unit circuit 234 may also determine whether there is someone in the rear seat according to whether the door of the rear seat has been opened first or the time when it was opened. In another embodiment, the selection of the first sensor components 220_1, 220_2, 220_3, 220_4 may also be determined by the driver through a vehicle interface, which may include a mobile phone application or a vehicle control panel.

[0028] Therefore, in step S100, the image processor circuit 232 selects, for example, the detection signal S1 provided by the first sensor components 220_1, 220_2, and 220_3 for analysis. Next, in step S110, the image processor circuit 232 analyzes the detection signal S1 provided by the first sensor components 220_1, 220_2, and 220_3, for example, analyzing the image content of the detection signal S1 to determine in real time whether the driver or the passenger has violated the rules. The image processor circuit 232 may also perform conventional image processing operations on the image content of the detection signal S1, for example, optimizing image characteristics such as image resolution and image brightness to improve the image display quality of the display 210. The image processor circuit 232 provides the image processing result (i.e., the analyzed detection signal S1) to the central processing unit circuit 234.

[0029] In step S120, the CPU circuit 234 generates an integrated instruction S2 according to the analyzed detection signal S1, and provides the integrated instruction S2 to the head end 110. For example, the CPU circuit 234 can provide a flag related to the driver monitoring system (DMS) to the head end 110, informing the head end 110 whether the driver or the passenger has violated the rules, and the head end 110 issues a safety warning. In other words, the CPU circuit 234 does not need to provide a large amount of image data to the head end 110, and the head end 110 does not need to perform image processing operations. According to the integrated instruction S2 (including the DMS flag) provided by the CPU circuit 234, the head end 110 can know whether the driver or the passenger has violated the rules, and thus issue a safety warning. In this way, the bandwidth of the image data transmitted by the CPU circuit 234 to the head end 110 can be greatly reduced. The violations include dozing off, turning the head, the person is not in the seat, or letting go of the steering wheel.

[0030] In addition, since the integrated instruction S2 includes the image processing result, the CPU circuit 234 also provides the integrated instruction S2 to the timing controller circuit 236 and the local dimming circuit 238, so that the timing controller circuit 236 and the local dimming circuit 238 can respectively perform the image driving function and the local dimming function.

[0031] In step S130, the headend 110 performs a safety warning according to the integrated instruction S2. The safety warning information includes controlling the vehicle to display a warning, automatic braking, sound warning, or display outside the vehicle. Alternatively, the safety warning includes notifying a specific mobile phone that the vehicle may be driving dangerously. Alternatively, the safety warning includes notifying the Global Positioning System (GPS) of the location of the accident.

[0032] In step S140, the third sensor component 250 can detect the intensity of the ambient light and provide an ambient light signal S3 to the central processing unit circuit 234. The central processing unit circuit 234 adjusts the brightness of the display 210 according to the ambient light signal S3, or adjusts the parameters of the first sensor components 220_1, 220_2, 220_3, 220_4, so that the first sensor components 220_1, 220_2, 220_3, 220_4 can provide good detection results.

[0033] Figure 5 A block diagram of a display system according to another embodiment of the present disclosure is shown. Figure 5, the display system 400 also includes a second sensor component 240. The second sensor component 240 is electrically connected to the system chip 230. Specifically, the second sensor component 240 is electrically connected to the image processor circuit through the first transmission interface IF1. The first sensor components 220_1, 220_2, 220_3 and the second sensor component 240 are different types of sensor components. For example, the first sensor components 220_1, 220_2, 220_3 are infrared sensors or CCDs, and the second sensor component 240 is a structured light sensor. The number and type of the first sensor components and the second sensor components are not intended to limit the present disclosure.

[0034] Figure 6 Show Figure 5 Flow chart of the operating method of the display system of the embodiment. Please refer to Figure 5 and Figure 6 In this embodiment, the image processor circuit 232 first selects the data provided by the second sensor component 240 for analysis (step S200), and then selects the data provided by the first sensor components 220_1, 220_2, and 220_3 for analysis (step S100). In step S200, the image processor circuit 232 analyzes the detection signal S1 provided by the second sensor component 240 to perform facial recognition on the driver.

[0035] In step S210, if the CPU circuit 234 determines that the driver has not passed the facial recognition, the method flow will enter step S220. In step S220, the head end 110 may notify the vehicle owner through the mobile phone that the vehicle may be stolen, or notify the vehicle owner of the current location of the vehicle through the Global Positioning System (GPS). In step S210, if the CPU circuit 234 determines that the driver has passed the facial recognition, the method flow will enter step S230. In step S230, the head end 110 may allow the driver to start the vehicle.

[0036] In step S210, if the CPU circuit 234 determines that the driver has not passed the facial recognition, the method flow will enter step S220. In step S220, the head end 110 can notify the vehicle owner through the mobile phone that the vehicle may be stolen, or notify the vehicle owner of the current location of the vehicle through the Global Positioning System (GPS). In step S210, if the CPU circuit 234 determines that the driver has passed the facial recognition, the method flow will enter step S230. In step S230, the head end 110 can allow the driver to start the vehicle.

[0037] In step S240, the central processing unit circuit 234 adjusts the brightness of the display 210 according to the ambient light signal S3, or adjusts the parameters of the first sensor components 220_1, 220_2, 220_3 and the second sensor component 240, so that the first sensor components 220_1, 220_2, 220_3 and the second sensor component 240 can provide good detection results. In step S210, if the central processing unit circuit 234 determines that the driver has not passed the face recognition, the method flow can also choose to enter step S240. In step S240, the central processing unit circuit 234 adjusts the parameters of the second sensor component 240 according to the ambient light signal S3 to perform the face recognition operation on the driver again.

[0038] In summary, in the embodiments of the present disclosure, the sensor assembly can be arranged in the display, and a system chip is arranged on the main board. The system chip integrates image processing function, display driving function and regional dimming function. The system chip can analyze the image in real time, and immediately inform the head end for processing when a violation is found, thereby reducing the data transmission bandwidth between the system chip and the head end.

[0039] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A display system, comprising: monitor; A plurality of first sensor components, for providing a plurality of detection signals; as well as A system chip, electrically connected to the display and the plurality of first sensor components, wherein the system chip comprises: an image processor circuit electrically connected to the plurality of first sensor components and configured to analyze the plurality of detection signals; A central processing unit circuit, electrically connected to the image processing circuit, and used for generating an integration instruction according to the analyzed multiple detection signals; and The timing controller circuit is electrically connected to the central processing unit circuit and is used for driving the display to display images according to the integrated instruction. 2 . The display system according to claim 1 , wherein the display system is used in a transport device, the transport device comprises a head end, and the system chip is electrically connected to the head end through a connection line. 3 . The display system according to claim 2 , wherein the integrated instruction is provided to the timing controller circuit and the head end at the same time, and the head end controls the transport device to perform a corresponding action according to the integrated instruction. 4 . The display system according to claim 2 , wherein the integration instruction is provided to the head end, the head end generates a first image signal according to the integration instruction, and the first image signal is provided to the central processing unit circuit.

5. The display system according to claim 4, wherein the system chip further comprises a local dimming circuit electrically connected to the central processing unit circuit, the display comprises a display panel and a light source module, the timing controller circuit provides a second image signal to the display panel, and the local dimming circuit provides a third image signal to the light source module. The display system according to claim 2 , wherein the connection line is a bus line. 7 . The display system according to claim 1 , wherein the display comprises a liquid crystal display, a light emitting diode display, or an organic light emitting diode display. 8 . The display system according to claim 1 , further comprising a second sensor component electrically connected to the system chip, wherein the plurality of first sensor components and the second sensor component are different types of sensor components.

9. The display system of claim 8, wherein the image processor circuit first selects the data provided by the second sensor component for analysis, and then selects the data provided by the plurality of first sensor components for analysis.

10. The display system according to claim 8 further includes a third sensor component electrically connected to the system chip and used to provide an ambient light signal, wherein the central processing unit circuit adjusts the brightness of the display or the parameters of the multiple first sensor components and the second sensor component according to the ambient light signal.