Vehicle-mounted display control method, control device, vehicle-mounted display system, and vehicle

The vehicle-mounted display control method and device address the reliability issue of single-source displays by switching to pre-stored data during failures, ensuring continuous display of critical vehicle status data and enhancing driving safety without additional hardware.

JP7695416B2Active Publication Date: 2025-06-18YINWANG INTELLIGENT TECHNOLOGIES CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023580586
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-06-28
Publication Date
2025-06-18
Estimated Expiration
2041-06-28

AI Technical Summary

Technical Problem

Vehicle-mounted displays in intelligent vehicles rely on a single display source, leading to failure in displaying critical driving safety information when the display source fails, compromising user safety.

Method used

A vehicle-mounted display control method and device that receive and display image data in multiple ways, using pre-stored image data when the primary image data reception is abnormal, ensuring continuous display of vehicle status data without the need for additional hardware like GPUs.

Benefits of technology

This solution enhances the reliability of vehicle-mounted displays, ensuring continuous display of critical vehicle status data even during primary image data reception failures, thereby improving driving safety and reducing implementation costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007695416000001
    Figure 0007695416000001
  • Figure 0007695416000002
    Figure 0007695416000002
  • Figure 0007695416000003
    Figure 0007695416000003
Patent Text Reader

Abstract

The present application relates to the field of intelligent automobile technology, and provides a vehicle-mounted display control method. The method includes: receiving first image data and sending third image data corresponding to the first image data to a display unit in a first transmission state, for example, when the reception of the first image data is normal; and obtaining second image data, for example, pre-stored image data corresponding to a vehicle status, and sending fourth image data corresponding to the second image data to the display unit in a second transmission state, for example, when the reception of the first image data is abnormal. The first image data and the second image data indicate vehicle status data. In the present application, when the reception of the first image data is abnormal, the fourth image data can be sent to the display unit to display the vehicle status data. This implements a backup display of the vehicle status data, improves the reliability of the vehicle-mounted display system, and further improves the vehicle driving safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of intelligent vehicles, and in particular, to a vehicle-mounted display control method and control device, a vehicle-mounted display system, a vehicle, a computing device, a chip, a computer-readable storage medium, and a computer program product.

Background Art

[0002] Instrument displays such as those in automobiles and ships are necessary components configured to display device status information in transportation means with engines. As intelligence becomes more advanced, digital instruments are being used more and more widely in transportation means with engines. In the case of intelligent vehicles, digital instruments can generally display information such as vehicle status, passenger status, and driving environment status related to driving safety. Therefore, intelligent vehicles impose high reliability requirements on digital instruments. In particular, in scenarios with functional safety level requirements, the reliability of vehicle-mounted displays is more emphasized.

[0003] However, vehicle-mounted displays generally use a single display source. When there is a failure in the display source, the display device for it cannot execute the display normally. Therefore, the user cannot know the information related to driving safety and cannot even continue to use the transportation means equipped with the display device.

Summary of the Invention

[0004] In consideration of the above problems, this application provides a vehicle-mounted display control method and control device, a vehicle-mounted display system, and a vehicle so that image data corresponding to vehicle status data can be displayed in multiple ways. This improves the reliability of the vehicle-mounted display system and further improves the driving safety of the vehicle.

Means for Solving the Problems

[0005] To achieve the above object, a first aspect of the present application provides a vehicle-mounted display control method. The method includes receiving first image data in a first transmission state and transmitting third image data to a display unit, and obtaining second image data and transmitting fourth image data to the display unit in a second transmission state. The second transmission state indicates that the reception of the first image data is abnormal. The first image data and the second image data indicate vehicle status. The third image data and the fourth image data respectively correspond to the first image data and the second image data.

[0006] As described above, the first transmission state may be a state in which the reception of the first image data by the in-vehicle display control device is normal, and the reception of the first image data by the in-vehicle display control device can be normal. In a possible embodiment, data monitoring may be performed on a transmission interface configured to receive the first image data in order to determine whether the reception status is normal. In a possible embodiment, the first image data may be image data generated by a GPU, and the second image data may be pre-stored image data. When the reception status is normal, that is, in the first transmission state, the first image data provided by the GPU is received, and the corresponding third image data is displayed using the display unit. When the reception status is abnormal (i.e., the second transmission state), for example, when data cannot be monitored due to a connection interruption, or when the monitored data is not refreshed within a specified time period due to data freezing, based on the vehicle status data, the pre-stored second image data is read out, and the corresponding fourth image data is displayed using the display unit. This implements a backup display of the vehicle status data, improves the reliability of the in-vehicle display system, and further improves vehicle driving safety. In addition, in a technical solution for implementing a backup display using a plurality of channels and different sources, no additional GPU is used. Therefore, the implementation cost of the technical solution is relatively low.

[0007] In a possible embodiment of the first aspect, obtaining the second image data includes receiving vehicle status data and generating the second image data based on the vehicle status data, or reading out the pre-stored second image data based on the vehicle status information.

[0008] As described above, the second image data may be generated in real time based on technical implementation requirements and vehicle status data. Alternatively, the second image data may be stored in advance, and the corresponding second image data may be read out based on the vehicle status data. When the pre-stored second image data is read out, the second image data may be pre-stored, and the rendering and generation of the second image data do not need to be executed in real time. Therefore, there is no need to add an additional GPU in the process of generating the second image data, and the implementation cost is relatively low.

[0009] In a possible implementation of the first aspect, different vehicle status data corresponds to different memory addresses, and different second image data is pre-stored at different memory addresses. Reading the pre-stored second image data specifically includes reading the second image data within the memory address corresponding to the vehicle status data.

[0010] As described above, reading the pre-stored second image data corresponding to the vehicle status data may be implemented by the cooperation between the MCU and the memory, and there is no need to add a GPU. Therefore, the implementation cost is relatively low.

[0011] In a possible implementation of the first aspect, the vehicle status includes one or more of the vehicle implementation device operation status, the vehicle occupant status, the vehicle driving status, and the driving environment status.

[0012] As described above, multiple types of vehicle status data may be acquired based on requests, and corresponding information is displayed on the display unit. The vehicle implementation device operation status includes, for example, battery level status, engine oil level status, EPS system status, and ABS system status. The vehicle occupant status may include, for example, the driver's attention status (e.g., whether the driver is sleepy and whether the line of sight is forward), the passenger status, and the physiological status of the occupant (e.g., heart rate, blood pressure, or body temperature). The vehicle driving-related status may include, for example, vehicle speed, engine rotation speed, motor rotation speed, transmission, temperature inside the vehicle, tire pressure, and autonomous driving state. The driving environment status includes, for example, traffic congestion status, weather conditions (e.g., temperature, humidity, rain, or snow), and road type (e.g., highway or urban road).

[0013] In a possible implementation of the first aspect, the vehicle status data is received using one or more of Controller Area Network CAN, Local Interconnect Network LIN, FlexRay, Media Oriented System Transport MOST, or automotive Ethernet.

[0014] As described above, the vehicle status data may be transmitted based on a request of a device using a bus as a signal channel.

[0015] A second aspect of the present application provides a vehicle-mounted display control device. The device includes a first processing module configured to receive first image data and transmit third image data to a display unit in a first transmission state, and a second processing module configured to acquire second image data and transmit fourth image data to the display unit in a second transmission state. The second transmission state indicates that the reception of the first image data is abnormal. The first image data and the second image data indicate the vehicle status. The third image data and the fourth image data correspond to the first image data and the second image data, respectively.

[0016] In a possible implementation of the second aspect, when the second processing module is configured to obtain second image data, the second processing module is configured to receive vehicle status data and generate second image data based on the vehicle status data, or is specifically configured to read out pre-stored second image data based on the vehicle status data.

[0017] In a possible implementation of the second aspect, the apparatus further includes a storage module. Different vehicle status data corresponds to different storage addresses of the storage module, and different second image data is pre-stored at different storage addresses. When the second processing module is configured to read out pre-stored second image data, the second processing module is specifically configured to read out the second image data within the storage address of the storage module corresponding to the vehicle status data.

[0018] In a possible implementation of the second aspect, the vehicle status includes one or more of a vehicle-mounted device operation status, a vehicle occupant status, a vehicle driving status, and a driving environment status.

[0019] In a possible implementation of the second aspect, the apparatus further includes one or more bus data interfaces of a controller area network CAN, a local interconnect network LIN, FlexRay, a media-oriented system transport MOST, and an automotive Ethernet bus, which are configured to receive vehicle status data.

[0020] The third aspect of this application provides a vehicle-mounted display system including a vehicle-mounted display control device according to any implementation of the second aspect and a display unit.

[0021] A fourth aspect of the present application provides a vehicle including a vehicle-mounted display system provided in the third aspect and an image generation unit. The image generation unit is configured to generate first image data.

[0022] A fifth aspect of the present application provides a computing device including a processor and a memory. The memory stores program instructions, and when the program instructions are executed by the processor, a vehicle-mounted display control method according to any of the embodiments of the first aspect is executed.

[0023] A sixth aspect of the present application provides a chip. The chip includes a processor and a data interface. The processor reads program instructions stored in the memory using the data interface to execute a vehicle-mounted display control method according to any of the embodiments of the first aspect.

[0024] In a possible embodiment of the sixth aspect, the memory is integrated into the chip.

[0025] In a possible embodiment of the sixth aspect, the data interface includes one or more bus data interfaces among a controller area network CAN, a local interconnect network LIN, FlexRay, a media-oriented system transport MOST, and an automotive Ethernet bus.

[0026] A seventh aspect of the present application provides a computer-readable storage medium. The computer-readable storage medium stores program instructions, and when the program instructions are executed by a computer, the computer is enabled to execute a vehicle-mounted display control method according to any of the embodiments of the first aspect.

[0027] An eighth aspect of the present application provides a computer program product including program instructions. When the program instructions are executed by a computer, the computer is enabled to execute a vehicle-mounted display control method according to any of the embodiments of the first aspect.

[0028] In conclusion, according to the vehicle-mounted display control method, control device, vehicle-mounted display system, vehicle, computing device, chip, computer-readable storage medium, and computer program product provided in this application, in the first transmission state (i.e., the state where the reception of the first image data by the vehicle-mounted display control device is normal), the vehicle-mounted display control device can normally receive the first image data and display the corresponding third image data using the display unit. In the second transmission state (i.e., the state where the reception of the first image data by the vehicle-mounted display control device is abnormal), the vehicle-mounted display control device can read out the pre-stored second image data based on the vehicle status data and display the corresponding fourth image data using the display unit. Based on this, the vehicle status data is displayed in two ways. This improves the redundancy and reliability of displaying the vehicle status data.

Brief Description of the Drawings

[0029]

Figure 1A

Figure 1B

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Embodiments for Carrying Out the Invention

[0030] In the above-mentioned schematic structural diagram, it should be understood that the size and form of the block diagram are for reference only and do not constitute an exclusive interpretation of the embodiments of the present application. The relative positions and inclusion relationships between the block diagrams shown in the schematic structural diagram do not limit the physical connection mode in the embodiments of the present application, but only schematically represent the structural relevance between the block diagrams.

[0031] The following further describes the technical solutions provided in the present application with reference to the accompanying drawings and embodiments. It should be understood that the system architecture and service scenarios in the embodiments of the present application are mainly intended to illustrate possible implementation manners of the technical solutions of the present application, and should not be construed as a specific limitation to the technical solutions of the present application. Those skilled in the art can know that as the system structure evolves and new service scenarios emerge, the technical solutions provided in the present application are also applicable to similar technical problems.

[0032] It should be understood that the vehicle-mounted information display solution provided in the embodiments of the present application includes a vehicle-mounted display control method and control device, a vehicle-mounted display system, a vehicle, a computing device, a chip, a computer-readable storage medium, and a computer program product. Since the problem-solving principles of the technical solutions are the same or similar, in the following description of specific embodiments, some repetitive parts may not be described again, but specific embodiments should be considered to be referenced to each other and combined with each other.

[0033] The vehicle-mounted information display solution can use mechanical instruments, digital instruments, or a combination of these for display. One embodiment may be as follows. Regarding the mechanical instrument part, a micro control unit (MCU), also called a single-chip microcomputer or microcomputer, acquires vehicle status data for determination and drives the mechanical instrument panel to display information using a general-purpose input / output port (GPIO). Regarding the digital instrument part, a graphics processing unit (GPU) generates image data based on the acquired vehicle status data. The image data is received and processed by a digital display and then displayed on the digital display. Regarding the mechanical instrument part in the technical solution, when there is a fault in the MCU, the mechanical instrument cannot function. Regarding the digital instrument part, when there is a fault in the GPU, the image data is not output. As a result, the digital display cannot display normally, and the user cannot know vehicle status data, such as information related to driving safety. In addition, the combination of mechanical instruments and digital instruments also leads to higher costs.

[0034] The vehicle-mounted information display solution can further be a pure digital display solution. In one embodiment, the GPU can generate image data based on the acquired vehicle status data, and the image data is processed by the information processing unit of the digital display and then displayed by driving the display panel. In this technical solution, when there is a fault in the GPU, the image data does not exist. As a result, the digital display cannot display normally, and the user cannot know information related to driving safety. This can pose a risk to the driving safety of the vehicle.

[0035] Embodiments of the present application provide an improved vehicle-mounted information display solution that uses technical solutions based on digital displays. In the present embodiment of the present application, when a vehicle-mounted display control device can receive first image data indicating a vehicle status, the vehicle-mounted display control device may transmit third image data corresponding to the first image data to a display unit for display. When the reception of the first image data is abnormal, the vehicle-mounted display control device may obtain second image data indicating the vehicle status and transmit fourth image data corresponding to the second image data to the display unit for display. In some embodiments, the first image data may be image data generated by a GPU, and the second image data may be pre-stored image data. Therefore, when there is a failure in the GPU, a second image corresponding to the vehicle status data is read out, and fourth image data corresponding to the second image data is displayed by the display unit, so that the user can continue to know the vehicle status data or information related to driving safety. The user here is generally a driver, or the user may be a front passenger or a rear passenger, etc. The following will describe the present application in detail.

[0036] First, the application scenarios of the embodiments of the present application will be briefly described. The application scenarios of the embodiments of the present application may be vehicles. The vehicles in the embodiments of the present application include general motor vehicles, such as cars, sport utility vehicles (SUVs), MPVs (multi-purpose vehicles), buses, trucks, and other land transportation devices including cargo or passenger vehicles, various water transportation means including ships and boats, and aircraft. Motor vehicles further include hybrid vehicles, electric vehicles, fuel vehicles, plug-in hybrid vehicles, fuel cell vehicles, and other alternative fuel vehicles. A hybrid vehicle is a vehicle having two or more power sources. Electric vehicles include pure electric vehicles and programmable electric vehicles, etc. This is not particularly limited in the present application.

[0037] When the embodiment is applied to the digital instrument of a vehicle, the content displayed by the display unit can be an image of various status data of the vehicle. In particular, FIG. 1A shows an example. The vehicle has an image processing unit, an in-vehicle display control device, and a display unit. The display unit shown in FIG. 1A is arranged behind the steering wheel. In a specific implementation process, the mounting position of the display unit may be set based on requirements. For example, the display unit may be arranged in the rear area of the steering wheel as shown in FIG. 1A, or may be arranged at a position such as the center console or in the vicinity area. FIG. 1B is an enlarged view of the display unit. In the center of FIG. 1B, images showing various vehicle statuses are displayed, for example, whether the seat belt is worn, whether the warning light is on, whether the high beam is on, whether the parking brake is activated, the battery level status, the coolant temperature status, and the open / closed state of each door of the vehicle. It is not difficult to understand that the image may further include another image showing vehicle status, for example, whether the vehicle Electronic Stability Program (ESP) is abnormal, whether the Anti-lock Braking System (ABS) is normal, and the charging interface status. In addition, a speedometer and a tachometer can also use the digital dashboard. The images displayed by the display unit in the example shown in FIG. 1B are several images showing vehicle status, and other related images may be displayed based on requirements. In addition, the images displayed by the display unit may correspond to third image data or fourth image data.

[0038] FIG. 2 is a schematic flowchart of the first embodiment of the in-vehicle display control method according to the present application. The in-vehicle display control method of this embodiment includes the following steps.

[0039] S10: In the first transmission state, the in-vehicle display control device receives first image data, transmits third image data to the display unit, the first image data indicates the vehicle status, and the third image data corresponds to the first image data.

[0040] In some embodiments, the first transmission state may be a state in which the reception of the first image data by the in-vehicle display control device is normal. In this state, the in-vehicle display control device can receive the first image data normally. In some embodiments, data monitoring may be performed on the transmission interface configured to receive the first image data in order to determine whether the reception status is normal.

[0041] In some embodiments, the vehicle status data indicated by the first image data includes one or more of the following vehicle statuses, namely, vehicle-mounted device operation status, vehicle occupant status, vehicle driving status, and driving environment status. The vehicle-mounted device operation status may include, for example, battery level status, engine oil level status, whether ESP is normal, whether the seat belt is worn, and whether ABS is normal. The vehicle occupant status may include, for example, attention status (e.g., whether the driver is sleepy and whether the line of sight is forward), physiological status (e.g., heart rate, blood pressure, or body temperature). The vehicle driving status may include, for example, vehicle speed, engine rotation speed, motor rotation speed, transmission, in-vehicle temperature, tire pressure, and autonomous driving state. The driving environment status may include, for example, traffic congestion status, weather conditions (e.g., temperature, humidity, rain, or snow), road type (e.g., highway or urban road), and map information (e.g., general navigation map and high-precision map).

[0042] Vehicle-mounted device operation status data, vehicle occupant status data, vehicle driving status data, and vehicle driving environment status data, etc., can be obtained by an electronic control unit (ECU) of the vehicle, or another vehicle-mounted sensor device and communication device, and can be provided to a vehicle-mounted display control device using a vehicle bus for corresponding display. In some embodiments, vehicle-mounted device operation status data and vehicle driving status data, etc., may be obtained by a control unit of the vehicle using corresponding sensors, or may be obtained by detection using a detection program. For example, the battery level is obtained using a battery level sensor, the engine oil level is obtained using a liquid level sensor, the ESP system status is obtained using an ESP self-diagnosis program, whether a seat belt is worn is obtained using a detection circuit of the seat belt buckle, the vehicle speed is obtained using a speed sensor, the engine rotation speed or motor rotation speed is obtained using a rotation speed sensor, the gear status is obtained using a transmission detection circuit, the temperature inside the vehicle is obtained using a temperature sensor, the tire pressure status is obtained using a pressure sensor, and the current autonomous driving state is obtained using the autonomous driving set by the driver. Vehicle occupants include the driver and passengers. For example, the driver's heart rate and body temperature may be obtained using a heart rate sensor and a body temperature sensor arranged on the steering wheel or seat belt, the seating posture of the occupant is obtained using pressure sensors distributed on the seat and seat backrest, the occupant image is obtained using a camera (such as a general RGB (Red Green Blue) camera, an infrared camera, or a binocular camera), and then the status data of the occupant, such as the attention status, seating posture, and mood of the occupant, is obtained by analysis.The driving environment status data can be obtained using vehicle-mounted sensor devices and vehicle-mounted communication devices, such as, for example, a telematics box (T-box), a GNSS module, a GPS module, a vehicle-mounted lidar, a millimeter-wave radar, and a camera. The driving environment status data includes vehicle position information, road condition information, map information (including high-precision map information), road type information (such as highway or urban road), and weather condition information.

[0043] In some embodiments, the first image data can be from data processed by an image processing unit. For example, the image processing unit can process the vehicle status data received from the vehicle bus by the image processing unit to obtain the first image data, and transmit the first image data to the in-vehicle display control device.

[0044] In some embodiments, the in-vehicle display control device can process the first image data to obtain third image data, and then transmit the third image data to the display unit. In this case, the third image data is different from the first image data. In some other embodiments, the in-vehicle display control device can transfer the received first image data to the display unit without processing the first data. In this case, the third image data is the same as the first image data.

[0045] S20: In the second transmission state, the in-vehicle display control device obtains second image data, transmits fourth image data to the display unit, the second transmission state indicates that the reception of the first image data is abnormal, the second image data also indicates the vehicle status, and the fourth image data corresponds to the second image data.

[0046] For how to determine whether the reception of the first image data is abnormal, refer to the related description in step S10. For example, if data cannot be monitored due to a connection interruption, or if the monitored data is not refreshed within a specified time period due to data freezing, it indicates that the reception status is abnormal.

[0047] In some embodiments, the second image data can be vehicle status data from the vehicle bus. The in-vehicle display control device can process the vehicle status data to generate the second image data and then transmit the second image data to the display unit. In some other embodiments, the in-vehicle display control device can read out the pre-stored second image data in the memory address corresponding to the vehicle status based on the vehicle status data.

[0048] In some embodiments, different vehicle status data corresponds to different storage addresses in the memory, and different second image data is pre-stored at different storage addresses. The memory may be integrated into the in-vehicle display control device or may be disposed outside the in-vehicle display control device.

[0049] In some embodiments, the first image data is received by the in-vehicle display control device, or the vehicle status data is received via one or more of Controller Area Network (CAN), Local Interconnect Network (LIN), FlexRay, Media Oriented System Transport (MOST), and automotive Ethernet.

[0050] In addition, before the aforementioned steps S10 and S20, the method may further include a step of determining, by the in-vehicle display control device, whether it is in the first transmission state or the second transmission state. Optionally, the first transmission state or the second transmission state may be determined by determining the reception status of the first image data. For the method of determining the reception status of the first image data, refer to the relevant description in step S10. Details will not be described again.

[0051] In addition, after the aforementioned steps S10 and S20, the method may further include the display unit executing a display based on the received third image data or fourth image data.

[0052] The following further describes this embodiment of the in-vehicle display control method of the present application with reference to specific embodiments. FIG. 3 is a schematic diagram of applying an in-vehicle display control device to a vehicle according to a specific embodiment of the present application. The vehicle includes an image generation unit 10, an in-vehicle display control device 20, and a display unit 30. The in-vehicle display control device 20 and the display unit 30 form an in-vehicle display system.

[0053] In this specific embodiment, the image generation unit 10 includes a second MCU 120 and a GPU 110, and may further include a CAN receiver and a serializer (Display Serial Interface, DSI). The CAN receiver may also be integrated into the second MCU 120 as a data interface. The serializer may also be integrated into the GPU 110 as a data interface. The second MCU 120 is configured to receive vehicle status data transmitted by the CAN bus, such as seat belt wearing status, whether a warning light is on, whether high beam is on, and parking brake status, using the CAN receiver, and transmit the information to the GPU 110. The GPU 110 is configured to generate first image data based on the vehicle status data transmitted by the second MCU 120 and output the first image data to the in-vehicle display control device 20. The GPU 110 may output the first image data using the serializer.

[0054] In this example, the in-vehicle display control device 20 includes a first MCU 210 and a memory 220, and may further include a deserialzer and a CAN receiver. The deserialzer and the CAN receiver may also be integrated into the first MCU 210 as a data interface, and the memory 220 may also be integrated into the first MCU 210.

[0055] In this example, the memory 220 is configured to store each image data of the vehicle status, such as the aforementioned second image data, store different image data indicating different vehicle statuses using different storage addresses, and the image data is stored in advance. The pre-stored image data indicating the same state as the first image data generated by the GPU 110 may be the same as the corresponding image data of the first image data. For example, the pre-stored operation image of the parking brake state is the same as the operation image of the parking brake state generated by the GPU 110.

[0056] The first MCU 210 has image processing capabilities, and the first MCU 210 receives the first image data output by the GPU 110. The first image data may be input to the data interface of the first MCU 210 using a deserialiser, for example, a Low-Voltage Differential Signaling (LVDS) interface. The first MCU 210 monitors the data transmission status of the LVDS interface, and when the data transmission status is normal, i.e., in the first transmission state, the first image data from the GPU 110 is received. In the present embodiment of the present application, the first MCU 210 may not process the first image data and directly transmit the first image data as the third image data to the display unit 30 for display. When the data transmission status is abnormal, i.e., in the second transmission state, for example, when data cannot be monitored due to a connection interruption, when the monitored data is not refreshed within a specified time period due to data freezing, and when image data transmission is abnormal due to a failure of the GPU 110, serializer, deserialiser, or the second MCU 120, the first MCU 210 uses the CAN bus to receive the vehicle status data transmitted using a CAN receiver, stores the vehicle status data in the register of the first MCU 210, and sequentially reads out each value of the register. Next, the first MCU 210 reads out the pre-stored image information, i.e., the second image data, from the corresponding address of the memory 220 based on each specified register identifier and the memory address corresponding to the stored value, synthesises the image of the second image data based on a predetermined position to form the fourth image data, and then outputs the fourth image data to the display unit 30 for display.

[0057] The transmission channel through which vehicle status data passes through the GPU 110 and the first MCU 210 and reaches the display unit 30 may be defined as an active display channel. The transmission channel through which vehicle status data passes through the first MCU 210 and the memory 220 and reaches the display unit 30 may be defined as a standby display channel. As described above, a specific embodiment is as follows. In a normal case, that is, in the first transmission state, the first image data is transmitted to the in-vehicle display control device via the active display channel, and the corresponding third image data is transmitted to the display unit 30. When the first MCU 210 detects that the transmission of image data via the active display channel is abnormal, that is, in the second transmission state, the first MCU 210 switches to the standby display channel to acquire the corresponding second image data and transmits the corresponding fourth image data to the display unit 30. Further, when the active display channel recovers from a failure, the first MCU 210 may switch back to the active display channel, that is, switch to the first transmission state. This implements a backup in-vehicle display using multiple channels and different sources, whereby vehicle status data and vehicle operation-related information can be continuously displayed. This improves the redundancy and reliability of the in-vehicle display system and further improves vehicle operation safety.

[0058] Based on an example in which an in-vehicle display control device is used in a vehicle in a specific embodiment, for a specific embodiment of the corresponding in-vehicle display control method, refer to the flowchart shown in FIG. 4. This method includes the following steps.

[0059] S410: The second MCU 120 of the image generation unit 10 analyzes the vehicle status data transmitted from the CAN bus to obtain various vehicle status information, such as seat belt wearing status, whether a warning light is on, whether high beam is on, and parking brake status, and transfers this information to the GPU 110.

[0060] S420: The GPU 110 generates first image data to be displayed based on the information transmitted by the second MCU 120, and transmits the generated first image data to the in-vehicle display control device 20.

[0061] S430: The first MCU 210 of the in-vehicle display control device 20 receives the first image data, that is, receives the first image data using the active display channel. In addition, as shown in FIG. 5, the in-vehicle display control device 20 uses the internal monitoring module 211 to monitor the image data transmission interface of the first MCU 210 to determine whether the reception of the first image data is normal. When the data reception status is normal, that is, in the first transmission state, the third image data corresponding to the first image data (the first image data is not processed in this embodiment and is directly used as the third image data) is transmitted to the display unit 30 using the internal image synthesis module 214. When the data reception status is abnormal, the internal switch module 212 is controlled to switch to the standby display channel, that is, to switch to the second transmission state, and the subsequent steps are executed.

[0062] S440: The first MCU 210 of the in-vehicle display control device 20 uses the CAN bus to acquire various vehicle status information and stores the vehicle status information in each specified register.

[0063] FIG. 5 is a schematic diagram for performing switching by the first MCU 210. In this embodiment, four registers are defined inside the first MCU 210 and are configured to store the seat belt wearing status, whether the warning light is on, whether the high beam is on, and the parking brake status, respectively. Register A1 is used as an example. Register A1 is defined to store the seat belt wearing status. The first MCU 210 acquires the value of the seat belt wearing status using the CAN bus. For example, when the currently acquired value of the seat belt wearing status is 0, the value 0 is stored in register A1 of the first MCU 210. The value 0 indicates that the seat belt wearing status is abnormal, and the value 1 indicates that the seat belt wearing status is normal. The number of registers may be set based on the requirements and computing capabilities of the first MCU 210.

[0064] S450: The first MCU 210 of the vehicle-mounted display control device 20 sequentially reads register values from each register using the internal computing module 213 based on the vehicle status data, and reads the image data stored in advance, that is, the second image data, from the address of the memory 220 based on the storage address corresponding to the specified register identifier and value.

[0065] For example, when the value of register A1 is 0, the memory address of memory 220 to be accessed is 0X0A10, and the first MCU 210 reads out the image data stored from this address of memory 220. In this embodiment, the image data is an icon indicating that the seat belt wearing status is abnormal (for example, the seat belt is not worn). When the value of register A1 is 1, the memory address of memory 220 to be accessed is 0X0A11, and the first MCU 210 reads out the image data stored from this address of memory 220. In this example, the image data is an icon indicating that the seat belt wearing status is normal. In some embodiments, when the vehicle status is normal, for example, when the seat belt wearing status is normal, the icon may not be displayed. Therefore, in this case, in order to save the memory space of memory 220, memory 220 does not need to be accessed.

[0066] Similarly, this step may be used to sequentially read out the values of register A2, register A3, and register A4, and based on these values, the corresponding image data is read out from memory 220.

[0067] S460: The first MCU 210 of the in-vehicle display control device 20 aggregates the image data, that is, the second image data, into the internal image synthesis module 214. The image synthesis module 214 synthesizes the image data to form the completed image data, that is, the fourth image data, and transmits the completed image data to the display unit 30 for display. During synthesis, the position of each image in the synthesized image can be preset so that the position of each icon in the synthesized image is the same as the position of each icon in the image generated by the image generation unit 10.

[0068] When the switching is executed in the aforementioned step S430, if the switching process executed in steps S440 to S450 requires a specific time period, the display unit 30 may maintain the display content before the switching until the switching is completed so that the user does not perceive the switching process. In some embodiments, the aforementioned steps S440 to S450 may be executed in synchronization with S410 in order to shorten the switching gap or alternatively.

[0069] FIG. 6 is a schematic diagram of the structure of a first embodiment of a vehicle-mounted display control device 600 according to the present application. The first processing module 610 included in the vehicle-mounted display control device 600 of the present embodiment is particularly configured to execute step S10 and optional examples of step S10. The second processing module 620 is particularly configured to execute step S20 and optional examples of step S20. For details, reference is made to the detailed description of the method embodiment, and only a brief description is provided here.

[0070] The first processing module 610 is configured to receive first image data and transmit third image data to the display unit in the first transmission state.

[0071] The second processing module 620 is configured to acquire second image data and transmit fourth image data to the display unit in the second transmission state. When the second processing module 620 is configured to acquire second image data, the second processing module 620 is particularly configured to receive vehicle status data and generate second image data based on the vehicle status data, or read out pre-stored second image data based on the vehicle status data.

[0072] The first processing module 610 and the second processing module 620 may be integrated into one chip, for example, integrated into the first MCU, or may be implemented by two independent chips.

[0073] In some embodiments, a memory module is further included. Different vehicle status data corresponds to different memory addresses of the memory module, and different second image data is pre-stored at different memory addresses. The memory may be integrated into the in-vehicle display control device or may be disposed outside the in-vehicle display control device. In some embodiments, the memory may be a memory chip such as a flash memory (FLASH) or an erasable programmable read only memory (EPROM).

[0074] When the second processing module 620 is configured to read the pre-stored second image data, the second processing module is particularly configured to read the second image data within the memory address of the memory module corresponding to the vehicle status data.

[0075] In some embodiments, the vehicle status includes one or more of a vehicle-mounted device operation status, a vehicle occupant status, a vehicle driving status, and a driving environment status.

[0076] In some embodiments, one or more data interfaces of CAN, LIN, FlexRay, MOST, and automotive Ethernet, configured to receive vehicle status data, are further included. These interfaces may be integrated into the in-vehicle display control device or may be independent data interfaces.

[0077] It should be understood that the vehicle-mounted display control device 600 in the embodiments of the present application may be implemented by hardware. For example, the integrated or separate first processing module 610 and second processing module 620 may be implemented by a processor of a display device (e.g., a central control screen) on the vehicle. Alternatively, the vehicle-mounted display control device 600 may be implemented by a processor and a data interface circuit configured to receive vehicle status data. Alternatively, the vehicle-mounted display control device 600 in the embodiments of the present application may be implemented by a combination of a processor and a software module.

[0078] Regarding the details of the processing of the device or module in the present embodiment of the present application, please refer to the related descriptions of the embodiments shown in FIGS. 1A to 5 and the related extended embodiments. In the present embodiment of the present application, the details will not be described again.

[0079] In addition, as shown in FIG. 7, the embodiments of the present application further provide a vehicle-mounted display system 700 having a vehicle-mounted display control device 600. In addition to the vehicle-mounted display control device 600, the vehicle-mounted display system 700 further includes a display unit 710. The vehicle-mounted display system 700 may be arranged on the dashboard side of the vehicle, or may be a central control screen of the vehicle, or may be a heads-up display (HUD) or an augmented reality heads-up display (AR-HUD) of the vehicle, etc.

[0080] In addition, as shown in FIG. 8, embodiments of the present application further provide a vehicle 800 having the vehicle-mounted display system 700 described above. FIG. 3 shows one embodiment of a vehicle. In addition to the vehicle-mounted display system 700, the vehicle further includes an image generation unit 810 configured to generate first image data. As shown in the embodiment shown in FIG. 3, the image generation unit 810 may include a second MCU and GPU. The vehicle-mounted display system 700 and the image generation unit 810 may be arranged in the vehicle system before or after installation. The modules may exchange data using the vehicle's bus or interface circuit. Alternatively, with the development of wireless technology, the modules may exchange data by a wireless communication method to eliminate the inconvenience caused by cable wiring.

[0081] In addition, as shown in FIG. 9, embodiments of the present application further provide a chip 900. The chip 900 includes a processor 910 and a data interface 920. The processor 910 reads program instructions stored in the memory using the data interface 920 to execute the vehicle-mounted display control method according to any one of the foregoing embodiments. In some embodiments, the foregoing memory is integrated into the chip 900, or a memory independent of the chip 900 is arranged. In some embodiments, the data interface 920 includes one or more data interfaces among a controller area network CAN, a local interconnect network LIN, FlexRay, a media-oriented system transport MOST, and automotive Ethernet.

[0082] FIG. 10 is a schematic diagram of the structure of a computing device 1000 according to an embodiment of the present application. The computing device can be used as an in-vehicle display control device to execute any optional embodiment of the above-described in-vehicle display control method. The computing device may be a terminal, or may be a chip or a chip system inside the terminal. As shown in FIG. 10, the computing device 1000 includes a processor 1010, a memory 1020, and a communication interface 1030.

[0083] It should be understood that the communication interface 1030 in the computing device 1000 shown in FIG. 10 may be configured to communicate with another device and may particularly include one or more transceiver circuits or interface circuits.

[0084] The processor 1010 may be connected to the memory 1020. The memory 1020 may be configured to store program code and data. Accordingly, the memory 1020 may be an internal storage module of the processor 1010, an external storage module independent of the processor 1010, or a component including an internal storage module of the processor 1010 and an external storage module independent of the processor 1010.

[0085] The computing device 1000 may further include a bus. The memory 1020 and the communication interface 1030 may be connected to the processor 1010 via the bus. The bus may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be classified into an address bus, a data bus, a control bus, etc. For ease of representation, only one line is used to represent the bus in FIG. 10, which does not indicate that there is only one bus or only one type of bus.

[0086] In an embodiment of the present application, it should be understood that the processor 1010 may be a central processing unit (CPU). Alternatively, the processor may be another general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or another programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The general-purpose processor may be a microprocessor or any conventional processor. Alternatively, the processor 1010 is configured to use one or more integrated circuits and execute related programs to implement the technical solutions provided in the embodiments of the present application.

[0087] The memory 1020 may include a read-only memory and a random access memory, and may provide instructions and data to the processor 1010. A part of the processor 1010 may further include a non-volatile random access memory. For example, the processor 1010 may further store device type information.

[0088] When the computing device 1000 operates, the processor 1010 executes computer-executable instructions in the memory 1020 to execute any operation steps of the vehicle-mounted display control method described above and optional embodiments.

[0089] The computing device 1000 according to the present embodiment of the present application may correspond to the corresponding executor of the method according to the embodiment of the present application, and it should be understood that the foregoing and other operations and / or functions of the modules in the computing device 1000 are each intended to implement the corresponding procedures of the method in the embodiment. For the sake of brevity, the details are not described again here.

[0090] Those skilled in the art can recognize that, in combination with the examples described in the embodiments disclosed herein, the units and algorithm steps can be implemented by electronic hardware, or a combination of computer software and electronic hardware. How these functions are implemented depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but the embodiments should not be considered to exceed the scope of the present application.

[0091] For the sake of simplicity, regarding the detailed operation processes of the foregoing systems, devices, and units, it can be clearly understood by those skilled in the art to refer to the corresponding processes in the foregoing method embodiments. The details are not described again here.

[0092] In some embodiments provided in the present application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the described device embodiments are merely examples. For example, the division into units is only a logical function division, and in actual embodiments, other divisions may be possible. For example, a plurality of units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0093] Embodiments of the present application further provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the program is executed by a processor, the program is used to execute any vehicle-mounted display control method in a specific embodiment of the present application. The aforementioned storage medium includes any medium capable of storing program code, such as a USB flash drive, a removable hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0094] In this specification and the claims, terms such as "first, second, and third, etc." or similar terms such as module A, module B, and module C are used only to distinguish similar objects and do not represent a specific order of the objects. It can be understood that the embodiments of the present application described herein can be implemented in an order other than the order illustrated or described herein, and that the specific order or sequence, if permitted, can be exchanged. In the foregoing description, related reference signs such as S410 and S420 indicating steps do not necessarily indicate that the steps are executed based on an order, and may further include intermediate steps, or may be replaced by another step, and consecutive steps may, if permitted, be interchanged or executed simultaneously.

[0095] As used herein, the term "one embodiment" or "embodiment" indicates that a particular feature, structure, or characteristic described with reference to the embodiment is included in at least one embodiment of the present application. Therefore, the terms "in one embodiment" or "in an embodiment" that appear in this specification do not necessarily refer to the same embodiment, but may refer to the same embodiment. In addition, in the embodiments of the present application, when there are no special descriptions and logical contradictions, the terms and / or descriptions between different embodiments are consistent and can be cross-referenced to each other. The technical features in different embodiments can be combined based on their internal logical relationships to form new embodiments.

[0096] The foregoing are only exemplary embodiments of the present application and the technical principles used. The present application is not limited to the specific embodiments described herein, and it can be understood that those skilled in the art can make various obvious changes, readjustments, and substitutions without departing from the protection scope of the present application. Therefore, without departing from the concept of the present application, more other equivalent embodiments can be included, and all are within the protection scope of the present application.

Description of Reference Numerals

[0097] 10 Image generation unit 20 Vehicle-mounted display control device 30 Display unit 110 GPU 120 Second MCU 210 First MCU 211 Internal monitoring module 212 Internal switch module 213 Internal computing module 214 Internal image synthesis module 220 Memory 600 Vehicle-mounted display control device 610 First processing module 620 Second processing module 700 Vehicle-mounted display system 710 Display unit 800 Vehicle 810 Image generation unit 900 Chip 910 Processor 920 Data interface 1000 Computing device 1010 Processor 1020 Memory 1030 Communication interface

Claims

1. A vehicle-mounted display control method, the method comprising: In a first transmission state, receiving first image data and transmitting third image data to a display unit; In a second transmission state, acquiring second image data and transmitting fourth image data to the display unit; and The step of acquiring the second image data comprises: receiving vehicle status data from a vehicle bus and generating the second image data based on the vehicle status data, or reading out pre-stored image data corresponding to the vehicle status data; The pre-stored image data is the same as the first image data generated by an image processing unit; The second transmission state indicates that reception of the first image data is abnormal; The first image data and the second image data indicate a vehicle status, and the third image data and the fourth image data respectively correspond to the first image data and the second image data; A vehicle-mounted display control method.

2. The method according to claim 1, wherein the first image data is acquired after being processed by an image processing unit.

3. The method according to claim 1 or 2, wherein the third image data is the same as or different from the first image data.

4. The vehicle status includes whether a seat belt is worn, whether a warning light is on, whether high beam is on, whether a parking brake is actuated, a battery level status, a coolant temperature status, an open / closed state of each door of the vehicle, whether a vehicle electronic stability program is abnormal, whether an antilock brake system is normal, or a charging interface status, according to the method of any one of claims 1 to 3.

5. The first image data indicates at least one of the following vehicle states, namely, a state of operation of vehicle-mounted devices, a state of vehicle occupants, a state of vehicle operation, or a state of the driving environment, according to the method of any one of claims 1 to 4.

6. The different vehicle status data corresponds to different memory addresses, and the different second image data is pre-stored at the different memory addresses. The step of reading the pre-stored second image data includes the step of reading the second image data within the memory address corresponding to the vehicle status data. The method according to claim 5.

7. The vehicle status includes one or more of a vehicle-mounted device operation status, a vehicle occupant status, a vehicle operation status, and a driving environment status, according to the method of any one of claims 1 to 6.

8. The vehicle status data is received via one or more of a controller area network CAN, a local interconnect network LIN, a media-oriented system transport MOST, FlexRay, and an automotive Ethernet bus, according to the method of claim 1 or 6.

9. A vehicle-mounted display control device comprising a unit configured to execute the steps in the method of any one of claims 1 to 8.

10. A computer-readable medium including a program, wherein when the program is executed by a processor, the method according to any one of claims 1 to 8 is executed.

Citation Information

Patent Citations

  • Electronic equipment system abnormity emergency display method and device

    CN109614068A

  • Display control system for vehicle

    JP2024057115A