Method and device for displaying icons on automobile electronic instrument screen
By inserting the VDMA module into the LVDS link of the automotive electronic instrument screen system and receiving UI overlay instructions using the SPI receiving module to read UI icon data from the Flash flash memory, the black screen problem caused by abnormal video link is solved, normal display and dynamic updates are achieved in abnormal situations, and user experience and design stability are improved.
Patent Information
- Application Number
- CN202311052751.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-18
- Publication Date
- 2025-04-29
- Estimated Expiration
- 2043-08-18
AI Technical Summary
The existing automotive electronic instrument screen system lacks fault tolerance function in abnormal video link conditions, resulting in the display background disappearing and the black screen phenomenon, affecting the user's driving experience and driving safety.
Insert the VDMA module into the LVDS link to backup and cache the current video image. When the LVDS video signal input is not detected, the backup image in the DDR cache module is cyclically read through the reading channel of the VDMA module, forming a video stream to enter the OSD module, and receiving UI overlay instructions through the SPI receiving module, reading UI icon data from the Flash flash memory, superimposing it in the video stream, and continuously updating and displaying.
In the case of abnormal video link, the electronic instrument screen can still be displayed normally, avoiding abnormal black screen phenomenon, improving the user's driving experience, reducing the use of FPGA resources, reducing costs and improving the stability of the design.
Smart Images

Figure CN117097851B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a method for displaying icons on an automobile electronic instrument screen, a device for displaying icons on an automobile electronic instrument screen, a computer device and a storage medium. Background Art
[0002] The electronic instrument screen is essentially a video display. Different from the traditional single mechanical dial, the electronic instrument can bring more digital functions and entertainment experience to users, such as Figure 1 As shown. Often, instrument signals are presented with beautifully patterned symbols, such as the continuous dynamic switching of instrument background images to form a rich visual theme, and the speed signal simulates the dial-shaped rotating indication. Instrument videos are often divided into two layers, the first layer is the instrument signal, and the second layer is the remaining background images. The background image is essentially a video stream because it has the function of continuous dynamic switching. The instrument signal is collected by many sensor signals and transmitted to the electronic instrument screen system through the CAN bus. The instrument video is essentially a video stream with the background video and the instrument signal superimposed.
[0003] The circuit schematic diagram of the existing electronic instrument screen system is as follows: Figure 2 As shown. The cockpit host sends the instrument background video through the FPD-LINK / GMSL link, and after being processed by the DES deserializer, it is input into the OSD (On Screen Display) chip via the LVDS (Low-Voltage DifferentialSignaling) interface. On another parallel link, the MCU collects the instrument signals required by the instrument screen through the CAN bus and sends icon overlay instructions to the OSD chip in SPI mode. The OSD chip reads the UI icon data preset in the Flash memory according to the SPI instruction, and outputs the real-time updated instrument video after superimposing the UI icon with the background video.
[0004] Figure 2 The OSD chip overlay solution used lacks fault tolerance in the case of abnormal video links. When the LVDS interface differential clock signal disappears, or the clock is unstable, or the video line and field synchronization signals are unstable, the video link cannot normally input the video stream. At this time, the display background of the electronic instrument screen disappears, showing a black screen phenomenon. Figure 3 This is the display format when the system is normal. Figure 4 It is a display format for video link asynchrony. Especially when the speed is displayed in dial form instead of digital form, the instrument screen will lose the safety function of speed display. The lack of fault tolerance function not only brings an unfriendly driving experience to users, but also brings driving safety hazards to users. Summary of the invention
[0005] In view of the above problems, embodiments of the present invention are proposed to provide an icon display method for an automobile electronic instrument screen, an icon display device for an automobile electronic instrument screen, a computer device and a storage medium that overcome the above problems or at least partially solve the above problems.
[0006] To achieve the above object, an embodiment of the present invention provides an icon display method for an automobile electronic instrument screen, the method comprising:
[0007] When no LVDS video signal input is detected, the read channel of the VDMA module is started to cyclically read the backup image in the DDR buffer module to form a video stream to enter the OSD module;
[0008] Controlling the SPI receiving module to receive the UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured into the Flash controller through the AXI-lite interface;
[0009] The Flash controller is started according to the first address to read the corresponding UI icon data from the Flash memory, the UI icon data is superimposed on the video stream, and the superimposed video stream is continuously updated on the automotive electronic instrument screen.
[0010] Preferably, the method further comprises:
[0011] The preset UI icon data is stored in the Flash memory.
[0012] Preferably, the UI overlay instruction includes an xy parameter and a wh parameter; the starting of the Flash controller according to the first address to read the corresponding UI icon data from the Flash memory and overlaying the UI icon data on the video stream includes:
[0013] The position of the UI icon in the video stream image is determined according to the xy parameter; and the length and width of the UI icon area in the video stream image are determined according to the wh parameter.
[0014] Preferably, the OSD module includes a calculator, a comparator and a selector; the starting of the Flash controller according to the first address to read the corresponding UI icon data from the Flash memory and superimposing the UI icon data on the video stream includes:
[0015] The control OSD module switches the output of background image pixels or UI icon pixels through the built-in selector, and calculates the pixel coordinates of the current electronic instrument screen display through the row counter and column calculator. If the current pixel point enters the target area, the control selector outputs the UI icon pixel, otherwise the control selector outputs the background image pixel.
[0016] Preferably, the method further comprises:
[0017] When LVDS video signal input is detected, it is stored in the DDR cache module through the LVDS2AXIS module, the VDMA module write channel and the MIG interface to form a backup image. The VDMA module reads the backup image cyclically through the read channel to form a video stream that enters the OSD module. The OSD module relays the video stream to the AXIS2LVDS module and then outputs it for display.
[0018] The embodiment of the present invention provides an icon display system for an automobile electronic instrument screen, the device comprising:
[0019] MCU, DES deserializer, Flash memory module, Flash controller, DDR cache module, MIG module, TFT display, OSD module and VDMA module;
[0020] The DES deserializer is connected to the VDMA module and the DDR cache module in sequence; the Flash flash memory module is connected to the Flash controller, the OSD module, and the TFT display in sequence; the VDMA module is connected to the OSD module and the DDR cache module respectively, and the MCU is connected to the OSD module, the Flash controller, and the VDMA module through the master controller;
[0021] The MCU starts the read channel of the VDMA module through the main controller to cyclically read the backup image in the DDR cache module to form a video stream to enter the OSD module; the SPI receiving module is controlled to receive the UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured to the Flash controller through the AXI-lite interface;
[0022] The Flash controller is started according to the first address to read the corresponding UI icon data from the Flash memory, the UI icon data is superimposed on the video stream, and the superimposed video stream is continuously updated on the automotive electronic instrument screen.
[0023] Preferably, the system further comprises a MIG module, a LVDS2AXIS submodule and an SPI receiving submodule; the Flash controller is respectively connected to the Flash flash memory module and the main controller, the MIG module is respectively connected to the DDR cache module and the VDMA module, the LVDS2AXIS submodule is respectively connected to the DES deserializer and the VDMA module, and the SPI receiving submodule is respectively connected to the main controller and the MCU;
[0024] The Flash controller reads the corresponding UI icon data from the Flash memory and loads it into the BRAM unit of the OSD module;
[0025] The MIG module serves as an interface conversion between the DDR cache module and the VDMA module, converting from the AXI interface protocol to the DDR interface;
[0026] The LVDS2AXIS submodule converts the serial video signal received from the differential signal into an RGB parallel signal;
[0027] The SPI receiving submodule receives and parses the SPI instruction from the MCU, configures the VMDA module through the AXI-lite protocol interface, and starts the video relay forwarding and video image backup of the VDMA module through initialization configuration.
[0028] Preferably, the system comprises an OSD module including a calculator, a comparator and a selector;
[0029] The MCU controls the OSD module to switch the output of background image pixels or UI icon pixels through the built-in selector, and calculates the pixel coordinates displayed on the current electronic instrument screen through the row counter and column calculator. If the current pixel point enters the target area, the selector is controlled to output the UI icon pixel, otherwise the selector is controlled to output the background image pixel.
[0030] An embodiment of the present invention provides an icon display device for an automobile electronic instrument screen, the device comprising:
[0031] The video stream forming module is used to start the read channel of the VDMA module to cyclically read the backup image in the DDR buffer module when no LVDS video signal input is detected, so as to form a video stream to enter the OSD module;
[0032] A UI overlay instruction receiving module, used to control the SPI receiving module to receive a UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured to the Flash controller through the AXI-lite interface;
[0033] The superposition module is used to start the Flash controller according to the first address to read the corresponding UI icon data from the Flash memory, superimpose the UI icon data on the video stream, and continuously update the superimposed video stream on the automotive electronic instrument screen.
[0034] An embodiment of the present invention discloses a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above-mentioned icon display method for an automobile electronic instrument screen when executing the computer program.
[0035] The embodiment of the present invention discloses a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the icon display method of the automobile electronic instrument screen are implemented.
[0036] In the embodiment of the present invention, a VDMA module is inserted into the LVDS link to back up and cache the current video image. When the video link is abnormal and there is no LVDS video input, the electronic instrument screen can still display normally, avoiding the abnormal black screen phenomenon. The FPGA provides the MCU with a custom instruction set for loading UI icons, and the key information of the instruction is the first address of the UI icon in the memory. The MCU generates corresponding instructions based on the collected instrument signal to drive the FPGA to obtain the corresponding UI icon. The UI icons continuously loaded into the FPGA chip become the signal source for dynamic updating of the electronic instrument screen under abnormal conditions. The OSD module switches the output of the UI icon or the background image through a two-choice selector in the abnormal state of the video link, so as to achieve a dynamic display effect of superimposing the UI icon and the background image. It can reduce the initialization time and reduce the FPGA resource usage. The process of loading the UI icon from the Flash flash memory to the DDR cache is the main reason for the initialization time, and the initialization time increases with the increase of the number of UI icons. The initialization link of UI icon loading is removed to shorten the operation time of the initialization process. In the case of video link anomalies, the FPGA obtains the UI icon from the Flash memory through the Flash controller, so the solution can omit the DMA and its supporting control module, reducing the usage of FPGA logic resources. Reducing resource usage is conducive to reducing costs and improving design stability. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0038] Figure 1 It is a schematic diagram of a car instrument screen in the prior art;
[0039] Figure 2 It is a circuit schematic diagram of an electronic instrument screen system in the prior art;
[0040] Figure 3 It is a normal system diagram of an electronic instrument screen system in the prior art;
[0041] Figure 4 It is an abnormal system diagram of an electronic instrument screen system in the prior art;
[0042] Figure 5 This is a system architecture diagram of an icon display system for an automotive electronic instrument screen according to an embodiment of the present invention;
[0043] Figure 6 is a schematic diagram of a target area of an automotive electronic instrument screen according to an embodiment of the present invention;
[0044] Figure 7 It is a flowchart of the steps of an embodiment of a method for displaying icons on an automotive electronic instrument screen according to an embodiment of the present invention;
[0045] Figure 8 It is a structural block diagram of an embodiment of an icon display device for an automobile electronic instrument screen according to an embodiment of the present invention;
[0046] Fig. 9 The diagram is a diagram of the internal structure of a computer device according to an embodiment. DETAILED DESCRIPTION
[0047] In order to make the technical problems, technical solutions and beneficial effects solved by the embodiments of the present invention more clearly understood, the embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0048] Reference Figure 5 , shows a system architecture diagram of an icon display system for an automotive electronic instrument screen according to an embodiment of the present invention, including an MCU, a DES deserializer, a Flash flash memory module, a Flash controller, a DDR cache module, a MIG module, a TFT display, an OSD module and a VDMA module;
[0049] In an embodiment of the present invention, the system can be applied to an automotive electronic instrument screen device, which can be applied to an electric vehicle or a non-electric vehicle. The embodiment of the present invention does not limit the specific type of the vehicle. The operating system of the automotive electronic instrument screen device can include Android, IOS, Windows Phone, Windows, etc., and the present invention does not impose too many restrictions on this.
[0050] Specifically, the DES deserializer is connected to the VDMA module and the DDR cache module in sequence; the Flash flash memory module is connected to the Flash controller, the OSD module, and the TFT display in sequence; the VDMA module is connected to the OSD module and the DDR cache module respectively, and the MCU is connected to the OSD module, the Flash controller, and the VDMA module through the master controller;
[0051] Furthermore, the MCU starts the read channel of the VDMA module through the main controller to cyclically read the backup image in the DDR cache module to form a video stream to enter the OSD module; the SPI receiving module is controlled to receive the UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured to the Flash controller through the AXI-lite interface;
[0052] In the embodiment of the present invention, the Flash controller is started according to the first address to read the corresponding UI icon data from the Flash memory, the UI icon data is superimposed on the video stream, and the superimposed video stream is continuously updated on the automotive electronic instrument screen;
[0053] In practical applications, the system further includes a MIG module, a LVDS2AXIS submodule and an SPI receiving submodule; the Flash controller is connected to the Flash flash module and the DMA module respectively, the MIG module is connected to the DDR cache module and the VDMA module respectively, the LVDS2AXIS submodule is connected to the DES deserializer and the VDMA module respectively, and the SPI receiving submodule is connected to the main controller and the MCU respectively;
[0054] Specifically, the Flash controller reads the corresponding UI icon data from the Flash memory and loads it into the BRAM unit of the OSD module; the MIG module serves as an interface conversion between the DDR cache module and the VDMA module, converting from the AXI interface protocol to the DDR interface; the LVDS2AXIS submodule converts the serial video signal received from the differential signal into an RGB parallel signal; the SPI receiving submodule receives and parses the SPI instructions from the MCU, configures the VMDA module through the AXI-lite protocol interface, and starts the video relay forwarding and video image backup of the VDMA module through the initialization configuration.
[0055] Specifically applied to the embodiment of the present invention, the FPGA corresponding to the icon display system of the automobile electronic instrument screen can be divided into multiple modules, which mainly work in three states: initialization, normal and abnormal.
[0056] (1) The LVDS2AXIS submodule and its corresponding AXIS2LVDS submodule mainly implement the video data format conversion function. The LVDS2AXIS submodule converts the video stream input via the LVDS protocol into an AXIS protocol output that complies with the ARM on-chip bus specification. The AXIS2LVDS submodule implements the reverse conversion operation. The purpose of the video interface conversion is to enable the FPGA chip to achieve communication compatibility with the DES deserializer and TFT liquid crystal display.
[0057] There are many LVDS physical interfaces. The present invention adopts a dual 8-bit interface to transmit odd and even pixels at the same time. The video formats transmitted by LVDS include VESA standard and JEIDA standard. One pixel can be expressed as 24 bits or 18 bits. The present invention adopts VESA standard to transmit a video format with 24 bits for one pixel. LVDS can adopt two transmission modes, SDR (Single Data Rate) and DDR (Double Data Rate). SDR means that one data is transmitted in one clock cycle, and DDR means that two data are transmitted in one clock cycle. The transmission speed of SDR is half of that of DDR mode. The present invention adopts SDR for transmission.
[0058] The LVDS2AXIS submodule mainly converts the serial video signal received from the differential signal into a 24-bit RGB parallel signal, as well as the horizontal synchronization signal and field synchronization signal that meet the video timing requirements, and outputs them through the AXIS interface protocol. The AXIS2LVDS submodule mainly converts the received AXIS video signal into a serial signal that complies with the LVDS protocol for output display.
[0059] (2) VDMA is an IP core provided by Xilinx, including a write channel for transmitting video streams from the FPGA chip to the DDR cache and a read channel for transmitting video streams from the DDR cache to the FPGA chip. After configuring the VDMA row field size register and the DDR cache first address, VDMA can realize the storage backup of the video stream in the DDR cache. The VDMA write channel cyclically overwrites the video image to the specified area of the DDR cache, while the read channel cyclically reads the video image from the specified area of the cache. VDMA is an important component of the fault tolerance function. When the video link is abnormal, although the VDMA write channel no longer updates the video image in the specified area of the DDR cache, the VDMA read channel still cyclically reads the backup video image in the specified area for output display. VDMA has a read-write anti-collision mechanism, so the write channel and the read channel can realize orderly reading and writing in the DDR shared memory area.
[0060] (3)MIG is an IP core provided by Xilinx, which serves as the interface conversion between DDR cache and VDMA, realizing the conversion from AXI interface protocol to DDR interface.
[0061] (4) Flash controller module, which stores the bin programming file used to start the FPGA and stores the UI icon user data. When the FPGA enters the video link abnormal state, according to the UI icon overlay instruction of the MCU, the Flash controller reads the corresponding UI icon data from the Flash memory and loads it into the BRAM unit of the OSD module.
[0062] (5) The SPI receiving submodule receives and parses SPI instructions from the MCU as a slave. In the initialization state, the SPI receiving module configures the VMDA register through the AXI-lite protocol interface, and starts the video relay forwarding and video image backup functions of the VDMA through the initialization configuration. In the abnormal state of the video link, the SPI receiving module receives the UI icon overlay instruction for parsing and processing, and triggers the Flash controller to read the corresponding UI icon through the AXI-lite interface. The AXI-lite configuration data output by the SPI receiving submodule to the VDMA and Flash controller are all derived from the parsing and conversion of SPI instructions.
[0063] The SPI communication protocol is agreed upon by both the FPGA chip and the MCU. The present invention adopts a 56-bit instruction protocol. The definition of the protocol is shown in Table 1, including two instructions: read and write. The instruction segment [7:0] indicates that the checksum generated by the MCU is sent with the instruction; [15:8] indicates that it is used for addressing the internal register of the FPGA chip; [47:16] indicates that it is used to configure the internal register of the FPGA, and can store the first address of the UI icon in the memory; [54:48] indicates reserved; [55:55] indicates that the instruction operation mode is a register write operation or a register read operation.
[0064]
[0065] Table 1: SPI instruction definition
[0066] (6) The OSD module mainly works when the video link is abnormal, and mainly completes the function of superimposing the UI icon with the background image. In the present invention, the OSD module is mainly composed of a BRAM storage unit, a calculator, a comparator and a selector. The capacity of each BRAM is 36Kb, and three BRAMs can jointly store a frame of 4096 pixels of UI icons. The storage resources of the FPGA Spartan-7 model chip used can support the storage of 15 UI icons at the same time, which means that 15 target areas in the electronic instrument screen can be covered. Figure 7 Each red box is a target area with a size of 4096 pixels, which is used to represent the instrument signal. All pixel values in each target area constitute a UI icon, and all UI icons are preset in the Flash memory before leaving the factory.
[0067] Every three BRAM storage units correspond to a target area in the electronic instrument screen. The position and size of the target area are determined by the parameters in the OSD module. The xy parameter, i.e., the parameter register (x, y), indicates the position of the upper left corner pixel of the target area in the image coordinates. The wh parameter, i.e., the parameter register (w, h), indicates the length and width of the target area. When the video link is in an abnormal state, the OSD module starts the function of superimposing the background image on the UI icon, specifically, by switching the output of the background image pixel or the UI icon pixel through the built-in two-to-one selector. The OSD module calculates the pixel coordinates of the current electronic instrument screen display through the row counter and the column calculator. If the current pixel point enters the target area, the selector is controlled to output the UI icon pixel, otherwise, the selector is controlled to output the background image pixel.
[0068] Figure 6 Some instrument signals only need one UI icon to represent them, while some instrument signals, such as pointers, need to be represented by multiple UI icons combined. The same instrument signal has two or more states, such as the left turn light needs to be on and off, and the gear position has six states: P, R, N, D, S, and L. If the pointer indicates one per kilometer, 240 states are required. Each target area needs to cut the UI icons in different states and preset them all in the Flash memory. In the present invention, it is necessary to use the superposition of background icons to cover the original pointer, and at the same time, the UI icons of different pointers are superimposed according to the MCU instructions to achieve dynamic display.
[0069] When the pointer size exceeds a target area, a multi-area stitching method is used for superposition. When cutting the pointer UI icon, the pointer is divided into several segments by a segmented cutting method. In the present invention, the pointer is spliced by two UI icons. Therefore, it is necessary to send two consecutive UI icon superposition instructions when updating the pointer position once. Since a pointer originally appears in the backup background image, before dynamically updating the pointer UI icon, two background UI icons are used to permanently cover the original pointer to avoid the erroneous phenomenon of two pointers appearing on the dial at the same time.
[0070] (7) The master controller module is mainly designed by a state machine, including initialization, normal video link and abnormal video link. Different control signals are sent in different states. In the initialization state, the master control prohibits the OSD module overlay function and switches to the video relay forwarding function; in the normal video link state, the master control module prohibits the SPI receiving module from receiving any SPI instructions related to UI icon overlay, and sends a pin level signal to the MCU when a link video abnormality is detected; in the abnormal video link state, the master control starts the UI icon overlay function of the OSD module and enables the SPI receiving module to receive SPI instructions for UI icon overlay.
[0071] Reference Figure 7, shows a flowchart of a method for displaying icons on an automotive electronic instrument screen according to an embodiment of the present invention, which may specifically include the following steps:
[0072] Step 101, when no LVDS video signal input is detected, the read channel of the VDMA module is started to cyclically read the backup image in the DDR buffer module to form a video stream to enter the OSD module;
[0073] Step 102, controlling the SPI receiving module to receive a UI overlay instruction from the MCU, wherein the UI overlay instruction includes a first address of a UI icon in the Flash memory; the first address is configured to the Flash controller through an AXI-lite interface;
[0074] Step 103, starting the Flash controller according to the first address to read the corresponding UI icon data from the Flash memory, superimposing the UI icon data on the video stream, and continuously updating the superimposed video stream on the automotive electronic instrument screen.
[0075] Embodiments of the present invention, combined with Figure 5 As shown, the working process of FPGA in actual working process is as follows:
[0076] Power on and enter the initialization state. ①. The SPI receiving module receives the initialization command from the MCU, mainly configuring the VDMA registers and starting the video link to work normally.
[0077] After initialization, it enters the normal working state. In this state, the video link works normally. ①. Video stream press Figure 6 ① The flow of path first passes through the LVDS2AXIS module, and is stored in the DDR cache by the VDMA write channel and the MIG interface to form a backup image. The VDMA read channel cyclically reads the backup image to form a video stream that enters the OSD module. The OSD module relays the video stream to the AXIS2LVDS module and then outputs it for display; ②. The Flash controller does not work in this state; ③. The OSD module does not start the UI icon overlay function in this state; ④. The SPI receiving module can receive the read register instruction, and when it receives the instruction for the relevant UI icon overlay, it discards it and does not process it; ④. LVDS2AXIS monitors the external differential signal clock and the line field synchronization signal status. When the clock disappears or the line field synchronization signal is unstable, the abnormal signal is fed back to the master control module, and the master control module triggers the MCU external interrupt and switches the FPGA system into the abnormal working mode at the same time.
[0078] From the normal working state to the abnormal working state, in this state the video link works abnormally, which is manifested as no LVDS video signal input. ①. Video stream press Figure 6② Path flow in the MCU, first the VDMA read channel cyclically reads the backup image in the DDR cache, forming a video stream to enter the OSD module; ②. The OSD module starts the UI overlay function, and according to the parameters (x, y) and (w, h) corresponding to the UI icon, that is, the xy parameters and wh parameters, as well as the row counter, column counter, comparator and two-choice selector, the UI icon data is superimposed on the background image and then displayed through the AXIS2LVDS output. ③. The SPI receiving module continuously receives the UI overlay instruction from the MCU, which includes (x, y) and (w, h) and the first address of the UI icon in the Flash flash memory. The first address is configured to the Flash controller through the AXI-lite interface, and the controller can be started to read the corresponding UI icon data and load the UI icon data into the BRAM storage unit of the OSD module. According to the MCU overlay instruction, the OSD module continuously updates the UI icon in the BRAM, and the target area at the corresponding position in the electronic instrument screen continuously updates the instrument signal.
[0079] In the embodiment of the present invention, a VDMA module is inserted into the LVDS link to back up and cache the current video image. When the video link is abnormal and there is no LVDS video input, the electronic instrument screen can still display normally, avoiding the abnormal black screen phenomenon. FPGA provides the MCU with a custom instruction set for loading UI icons, and the key information of the instruction is the first address of the UI icon in the memory. According to the collected instrument signal, the MCU generates corresponding instructions to drive the FPGA to obtain the corresponding UI icon. The UI icon continuously loaded into the FPGA chip becomes the signal source for dynamic update of the electronic instrument screen under abnormal conditions. When the video link is abnormal, the OSD module switches to output the UI icon or the background image through a two-choice selector, so as to achieve a dynamic display effect of superimposing the UI icon and the background image. Each UI icon data is stored in three BRAM storage units and is associated with the parameter registers (x, y) and (w, h). The row counter and column counter are compared with the parameter register to form a switching control signal of the selector. If the current display pixel of the electronic instrument screen is within the target area, the UI icon is output, and if it is not within the target area, the background image is output.
[0080] The design architecture within the PFGA chip in the embodiment of the present invention can display normal instrument video by allowing the video stream to flow along the LVDS2AXIS, VDMA, MIG, OSD, and AXIS2LVDS paths when the video link is normal; and by allowing the video stream to flow along the MIG, VDMA, OSD paths when the video link is abnormal, and the UI icon to flow along the Flash and OSD paths, and the operation of superimposing the UI icon and the background image can be completed through the switching control of the OSD.
[0081] In addition, the FPGA and MCU complete the operation of loading the UI icon into the FPGA through SPI instructions. The SPI instruction set mainly provides the first address of the UI icon in the Flash memory.
[0082] Furthermore, the OSD module is mainly composed of BRAM storage units, and every three BRAM storage units store a UI icon of 4096 pixels. Multiple UI icons can be stored simultaneously according to the number of FPGA storage resources. The superposition process mainly compares the results of the row counter and column counter with the position parameters (x, y) of each UI icon and the length and width parameters (w, h) of the target area. If the row and column counting results of the current pixel are within the target area, the two-choice selector is switched to output the UI icon. If the current pixel is outside the target area, the two-choice selector is switched to output the background image. The position and aspect ratio of the target area can be changed by modifying the (x, y) and (w, h) parameter values.
[0083] In the embodiment of the present invention, the backup image can still be output normally when the video source is paused, avoiding the black screen phenomenon. The pre-stored UI icon is loaded into the FPGA chip in real time through the custom SPI instruction set, and the UI icon is superimposed on the background image to realize the display effect of real-time dynamic update of the instrument signal.
[0084] Compared with the limitation that OSD IC chip can only use standard text and standard icons to express instrument signals, FPGA chip can display instrument signals with any irregular icons. UI icons pre-stored in FPGA can be collected by manually cutting pictures, and there is no problem of signal expression limitation. For UI icons beyond the target area, multi-area splicing method can be used to solve it.
[0085] It can reduce the initialization time and reduce the usage of FPGA resources. The process of loading UI icons from Flash memory to DDR cache is the main reason for the initialization time, and the initialization time increases with the increase of the number of UI icons. Remove the initialization link of UI icon loading and shorten the operation time of the initialization process. In the case of abnormal video link, FPGA obtains UI icons from Flash memory through Flash controller, so DMA and its supporting control module can be omitted in the solution, reducing the usage of FPGA logic resources. Reducing resource usage is conducive to reducing costs and improving the stability of the design.
[0086] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.
[0087] Reference Figure 8 , shows a structural block diagram of an embodiment of an icon display device for an automotive electronic instrument screen according to an embodiment of the present invention, which may specifically include the following modules:
[0088] The video stream forming module 301 is used to start the read channel of the VDMA module to cyclically read the backup image in the DDR buffer module when no LVDS video signal input is detected, so as to form a video stream to enter the OSD module;
[0089] The UI overlay instruction receiving module 302 is used to control the SPI receiving module to receive the UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured to the Flash controller through the AXI-lite interface;
[0090] The superimposition module 303 is used to start the Flash controller according to the first address to read the corresponding UI icon data from the Flash memory, superimpose the UI icon data on the video stream, and continuously update the superimposed video stream on the automotive electronic instrument screen.
[0091] Preferably, the device further comprises:
[0092] The UI icon data loading module is used to store the preset UI icon data in the Flash memory. Preferably, the UI overlay instruction includes an xy parameter and a wh parameter; the overlay module includes:
[0093] The UI icon determination submodule is used to determine the position of the UI icon in the video stream image according to the xy parameters; and to determine the length and width of the UI icon area in the video stream image according to the wh parameters.
[0094] Preferably, the OSD module includes a calculator, a comparator and a selector; the superposition module includes:
[0095] The control submodule is used to control the OSD module to switch the output of background image pixels or UI icon pixels through the built-in selector, calculate the pixel coordinates displayed on the current electronic instrument screen through the row counter and column calculator, and control the selector to output UI icon pixels if the current pixel point enters the target area, otherwise control the selector to output background image pixels.
[0096] Preferably, the device further comprises:
[0097] The output display module is used to detect the input of LVDS video signal, and then store it in the DDR cache module through the LVDS2AXIS module, the VDMA module write channel and the MIG interface to form a backup image. The VDMA module reads the backup image through the read channel in a loop to form a video stream that enters the OSD module. The OSD module relays the video stream to the AXIS2LVDS module and then outputs it for display.
[0098] Each module in the above-mentioned icon display device for the automobile electronic instrument screen can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each module.
[0099] The icon display device for an automobile electronic instrument screen provided above can be used to execute the icon display method for an automobile electronic instrument screen provided in any of the above embodiments, and has corresponding functions and beneficial effects.
[0100] In one embodiment, a computer device is provided. The computer device may be an automotive electronic instrument panel device. The internal structure diagram thereof may be as follows: Fig. 9 As shown. The automotive electronic instrument screen device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for displaying icons on an automotive electronic instrument screen is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a key, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.
[0101] Those skilled in the art will understand that Fig. 9The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0102] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, Figures 5 to 7 The steps described.
[0103] In one embodiment, a computer readable storage medium is provided on which a computer program is stored. When the computer program is executed by a processor, Figures 5 to 7 The steps described
[0104] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0105] It will be appreciated by those skilled in the art that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0106] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0107] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0108] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0109] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.
[0110] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.
[0111] The above is a detailed introduction to an icon display method for an automobile electronic instrument screen, an icon display device for an automobile electronic instrument screen, a computer device and a storage medium provided by the present invention. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technicians in this field, according to the ideas of the present invention, there will be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. A method for displaying icons on an automobile electronic instrument screen, characterized in that: The method comprises: When no LVDS video signal input is detected, the read channel of the VDMA module is started to cyclically read the backup image in the DDR cache module to form a video stream entering the OSD module; wherein the backup image includes inserting a backup cache of the current video image of the VDMA module in the LVDS link; The SPI receiving module is controlled to receive the UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured to the Flash controller through the AXI-lite interface; each target area needs to cut the UI icons in different states and preset them all in the Flash memory; The Flash controller is started according to the first address to read the corresponding UI icon data from the Flash memory, the UI icon data is superimposed on the video stream, and the superimposed video stream is continuously updated on the automotive electronic instrument screen.
2. The method for displaying icons on an automotive electronic instrument panel according to claim 1, characterized in that: The method further comprises: The preset UI icon data is stored in the Flash memory.
3. The method for displaying icons on an automotive electronic instrument panel according to claim 1, characterized in that: The UI overlay instruction includes an xy parameter and a wh parameter; the starting of the Flash controller according to the first address to read the corresponding UI icon data from the Flash flash memory, and overlaying the UI icon data on the video stream. The starting of the Flash controller according to the first address to read the corresponding UI icon data from the Flash flash memory, and overlaying the UI icon data on the video stream, includes: The position of the UI icon in the video stream image is determined according to the xy parameter; and the length and width of the UI icon area in the video stream image are determined according to the wh parameter.
4. The method for displaying icons on an automotive electronic instrument panel according to claim 3, characterized in that: The OSD module includes a calculator, a comparator and a selector; the starting of the Flash controller according to the first address to read the corresponding UI icon data from the Flash flash memory, and superimposing the UI icon data on the video stream. The starting of the Flash controller according to the first address to read the corresponding UI icon data from the Flash flash memory, and superimposing the UI icon data on the video stream, includes: The control OSD module switches the output of background image pixels or UI icon pixels through the built-in selector, and calculates the pixel coordinates of the current electronic instrument screen display through the row counter and column calculator. If the current pixel point enters the target area, the control selector outputs the UI icon pixel, otherwise the control selector outputs the background image pixel.
5. The method for displaying icons on an automotive electronic instrument panel according to claim 1, characterized in that: The method further comprises: When LVDS video signal input is detected, it is stored in the DDR cache module through the LVDS2AXIS module, the VDMA module write channel and the MIG interface to form a backup image. The VDMA module reads the backup image cyclically through the read channel to form a video stream that enters the OSD module. The OSD module relays the video stream to the AXIS2LVDS module and then outputs it for display.
6. An icon display system for an automotive electronic instrument panel, characterized in that: The system comprises: MCU, DES deserializer, Flash memory module, Flash controller, DDR cache module, MIG module, TFT display, OSD module and VDMA module; The DES deserializer is connected to the VDMA module and the DDR cache module in sequence; the Flash flash memory module is connected to the Flash controller, the OSD module, and the TFT display in sequence; the VDMA module is connected to the OSD module and the DDR cache module respectively, and the MCU is connected to the OSD module, the Flash controller, and the VDMA module through the master controller; The MCU starts the read channel of the VDMA module through the main controller to cyclically read the backup image in the DDR cache module, forming a video stream to enter the OSD module; the SPI receiving module is controlled to receive the UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash flash memory; the first address is configured to the Flash controller through the AXI-lite interface. The UI overlay instruction includes the first address of the UI icon in the Flash flash memory; the first address is configured to the Flash controller through the AXI-lite interface; wherein the backup image includes inserting the VDMA module in the LVDS link to the backup cache of the current video image; each target area needs to cut the UI icons in different states and preset them all in the Flash flash memory; The Flash controller is started according to the first address to read the corresponding UI icon data from the Flash memory, the UI icon data is superimposed on the video stream, and the superimposed video stream is continuously updated on the automotive electronic instrument screen.
7. The icon display system for an automotive electronic instrument panel according to claim 6, characterized in that: The system also includes a MIG module, a LVDS2AXIS submodule and an SPI receiving submodule; the Flash controller is respectively connected to the Flash flash module and the main controller, the MIG module is respectively connected to the DDR cache module and the VDMA module, the LVDS2AXIS submodule is respectively connected to the DES deserializer and the VDMA module, and the SPI receiving submodule is respectively connected to the main controller and the MCU; The Flash controller reads the corresponding UI icon data from the Flash memory and loads it into the BRAM unit of the OSD module; The MIG module serves as an interface conversion module between the DDR cache module and the VDMA module to realize the conversion from the AXI interface to the DDR interface; The LVDS2AXIS submodule is used to convert the serial video signal received from the differential signal into an RGB parallel signal; The SPI receiving submodule is used to receive and parse the SPI instructions from the MCU, configure the VMDA module through the AXI-lite protocol interface, and start the video relay forwarding function and the video image backup function of the VDMA module through initialization configuration.
8. The icon display system for an automotive electronic instrument panel according to claim 6, characterized in that: The system includes an OSD module including a calculator, a comparator and a selector; The MCU controls the OSD module to switch the output of background image pixels or UI icon pixels through the built-in selector, and calculates the pixel coordinates displayed on the current electronic instrument screen through the row counter and column calculator. If the current pixel point enters the target area, the selector is controlled to output the UI icon pixel, otherwise the selector is controlled to output the background image pixel.
9. An icon display device for an automobile electronic instrument screen, characterized in that: The device comprises: The video stream forming module is used to start the read channel of the VDMA module to cyclically read the backup image in the DDR cache module when no LVDS video signal input is detected, so as to form a video stream to enter the OSD module; wherein the backup image includes a backup cache of the current video image inserted into the LVDS link by the VDMA module; A UI overlay instruction receiving module is used to control the SPI receiving module to receive a UI overlay instruction from the MCU, wherein the UI overlay instruction includes the first address of the UI icon in the Flash memory; the first address is configured to the Flash controller through the AXI-lite interface; each target area needs to cut the UI icons in different states and all are preset in the Flash memory; The superposition module is used to start the Flash controller according to the first address to read the corresponding UI icon data from the Flash memory, superimpose the UI icon data on the video stream, and continuously update the superimposed video stream on the automotive electronic instrument screen.
10. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method for displaying icons on an automotive electronic instrument screen according to any one of claims 1 to 5 are implemented.
11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method for displaying icons on an automotive electronic instrument screen according to any one of claims 1 to 5 are implemented.
Citation Information
Patent Citations
OSD image display processing device
CN106357998A