Cross-platform real-time central control screen projection instrument display method

Abstract

The invention discloses a cross-platform real-time central control screen projection instrument display method, which relates to the technical field of vehicle-mounted systems, and is characterized in that real-time transmission of high-definition video data between a central control system and an instrument system is realized through an intelligent transmission technology and a special hardware component, the system integrates a serializer and a deserializer, and the real-time transmission of the high-definition video data is realized. The method supports automatic identification and conversion of various video formats, combines an AI enhancement algorithm, dynamically adjusts a compression mode, resolution and refresh rate according to factors such as content complexity and bandwidth, and ensures an efficient and clear display effect. According to the method, the high-performance shielding twisted pair is adopted, the good anti-interference capability is achieved, and the stability of data transmission is guaranteed. According to the invention, the limitation of inter-core communication which depends on the same SOC traditionally is overcome, the separated deployment of the central control system and the instrument system is supported, the synchronous management of data resources is simplified, the adaptability is high, the real-time performance is high, and the flexibility and the user experience of the central control projection screen in vehicle-mounted and industrial applications are remarkably improved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle-mounted systems, and more specifically, to a cross-platform real-time central control screen projection instrument display method. Background Art

[0002] In current vehicle-mounted systems, there is an increasing demand for instrument screens to display navigation, music playback and other functions, and it is usually necessary to project the content of the central control system to a specific area of ​​the instrument screen in real time. However, existing technical solutions have many limitations. Most solutions rely on the central control system and instrument system integrated on the same SOC (system-on-chip), and transmit projection data through inter-core communication within the SOC (such as MailBox communication). Although this solution realizes data transmission, it requires that the central control system and the instrument system must be integrated on the same SOC. The technical selection is single, and it is difficult to be compatible with independent central control systems and instrument systems, which limits the flexibility of system design.

[0003] In addition, there is another solution that the central control system and the instrument system load the same data resources respectively. When projecting the screen, the central control system only sends command signals to the instrument system, and the instrument system automatically calls local data for display. However, the data resources of this method need to be strictly synchronized between the central control and the instrument, which increases the complexity of data management; and because only control signals are transmitted, the data real-time performance is poor and cannot respond to the driver's operating needs in a timely manner, especially in high-real-time applications such as dynamic navigation.

[0004] When the central control system and the instrument system use different main control chips, the existing communication method is difficult to support sufficient data bandwidth and difficult to meet the needs of large data projection. In this scenario, the data transmission efficiency and real-time performance are insufficient, and the seamless interaction between the central control system and the instrument system cannot be guaranteed, which affects the user experience.

[0005] Therefore, in order to solve the above technical problems, this application proposes a cross-platform real-time central control screen projection instrument display method. Summary of the invention

[0006] In view of the deficiencies in the prior art, the object of the present invention is to provide a cross-platform real-time central control screen projection instrument display method.

[0007] To achieve the above object, the present invention provides the following technical solution: a cross-platform real-time central control screen projection instrument display method, comprising the following steps:

[0008] S1: The serializer in the vehicle's central control platform identifies and converts video formats;

[0009] S2: The serializer selects compression and enhancement video coding standards based on the input video in S1, and adjusts the video resolution;

[0010] S3: The deserializer in the vehicle instrument platform parses the data stream and adjusts the video content refresh rate;

[0011] S4: compress, encode and subpacketize the data adjusted in S3;

[0012] S5: The meter chip receives the data content of the deserializer and presents the data content in the meter area.

[0013] Preferably, the step of identifying and converting the video format comprises:

[0014] S11: The serializer receives the original video signal of the central control system, and the original video signal includes but is not limited to different formats, resolutions, and frame rates;

[0015] S12: analyzing the pixel arrangement and data width of the original video signal;

[0016] S13: Determine the format of the input signal, select a conversion method based on the supported format set and perform real-time conversion, which is represented by the following function:

[0017] F out =C(F in )

[0018] Among them, F in is the input video signal format, F out is the output format after conversion, and C(·) is the conversion function.

[0019] Preferably, the specific steps of adjusting the video resolution are:

[0020] S21: Content analysis, the system uses AI models to analyze the complexity of video content, and AI models extract video features:

[0021] Measures the details and texture of an image and the complexity of the motion in the picture; describes the richness of the colors in the picture; through these features, the AI ​​model assigns a complexity score to the video content and dynamically selects compression and enhancement video coding standards based on the score:

[0022] VCS=w1·ED+w2·MC+w3·CC

[0023] Among them, w1, w2 and w3 are the weight coefficients of the features, VCS is the complexity score, ED is the edge density, MC is the motion complexity, and CC is the color complexity;

[0024] S22: Based on the complexity score, the string adder dynamically selects compression and enhancement video coding standards;

[0025] S23: selecting a video coding standard with a high compression ratio for a low-complexity picture, selecting a video coding standard with a moderate compression ratio for a medium-complexity picture, and selecting a video coding standard with a low compression ratio for a high-complexity picture;

[0026] S24: According to the transmission distance, network bandwidth, and display device capability, the output resolution is adjusted in real time through the following formula, dynamic resolution:

[0027] If VCS ≥ T high , then Output resolution = R high ;

[0028] If VCS <T high and VCS≥T low , then Output resolution = R medium ;

[0029] If VCS<T low ,then Output resolution=R low ;

[0030] Among them, R high , R medium , R low Represent high resolution, medium resolution and low resolution respectively, T high 、T low A threshold for pre-set complexity scores;

[0031] S25: Automatically selecting the output format and resolution of the video stream through the dynamic resolution adjustment and according to the requirements of the output display device.

[0032] Preferably, the specific steps of parsing the data stream are:

[0033] S31: The deserializer checks the header information of each data packet to make the data sequence and timestamp consistent;

[0034] S32: If data packets are found to be lost or out of sequence, the deserializer corrects them by resynchronizing the clock and data stream;

[0035] S33: rearrange the data stream according to the timing information so that the video frames are restored in a correct order;

[0036] S34: The data packet is accompanied by a checksum cyclic redundancy check value. When the deserializer receives the data packet, it calculates its checksum and compares it with the expected checksum in the transmission, which is a set standard checksum.

[0037] S35: If data packet loss or damage is detected, the deserializer will recover the data through forward error correction technology or automatic retransmission mechanism.

[0038] Preferably, the method for adjusting the refresh rate of video content includes:

[0039] The refresh rate is adjusted dynamically based on the complexity of the content, the capabilities of the display device, and changes in network bandwidth. The following formula is used to express this:

[0040] FR adjusted =f(CCS,R max ,R min ,B available );

[0041] Among them, FR adjusted is the adjusted refresh rate, CCS is the content complexity score, which reflects the dynamic characteristics and detail density of the video, R max is the maximum supported refresh rate, R min is the minimum refresh rate, R available The currently available bandwidth affects the upper limit of the refresh rate;

[0042] The specific refresh rate adjustment rules are as follows: When CCS is high, the refresh rate approaches R max , when CCS is low, the refresh rate will be reduced to R min or between R max With R min between;

[0043] The refresh rate adjustment is also expressed by the following formula:

[0044]

[0045] Among them, T high and T low It is the threshold that defines the complexity of the content.

[0046] Preferably, the central control platform and the instrument platform are connected via an SPI bus and a CAN bus, and the SPI bus and the CAN bus are used for command interaction between the central control platform and the instrument platform.

[0047] Preferably, the data compression includes: lossless compression and lossy compression, the lossless compression completely compresses text data and key control instructions, and the compressed data is recoverable, and the lossy compression removes redundant information, and the compressed data is irrecoverable.

[0048] Preferably, the serializer transmits data to the deserializer via a twisted pair.

[0049] Preferably, the data compression includes compressing text and key control instructions using lossless compression, and compressing video and image data using lossy compression;

[0050] The data encoding includes adding error correction information through channel coding;

[0051] The data subpacketization includes: dividing the data into a plurality of small data packets for transmission, and adding verification information into each data packet.

[0052] Compared with the prior art, the present invention has the following beneficial effects:

[0053] 1. In the present invention, through intelligent transmission technology and high-performance shielded twisted pair transmission media, the system realizes real-time transmission of high-definition video data between the central control system and the instrument system, reduces the impact of electromagnetic interference, and ensures the stability and integrity of the data. Compared with traditional solutions that rely on inter-core communication such as MailBox, this method has higher transmission bandwidth and anti-interference ability, meeting the requirements of the vehicle system for high-definition and real-time display.

[0054] 2. The present invention breaks through the limitation of the prior art that the central control system and the instrument system must be integrated on the same SOC, and uses independent serializer and deserializer hardware components to achieve cross-platform data transmission. Therefore, regardless of whether the central control system and the instrument system are on the same SOC, real-time data transmission and display can be achieved, which meets the design requirements of the separation of the central control and instrument systems and increases the flexibility of system design. At the same time, the system supports automatic adjustment of the refresh rate, provides smooth display for highly dynamic content, saves bandwidth for static content, and further improves the efficiency of transmission and display.

[0055] 3. Compared with the method of only transmitting control signals, the method of the present invention ensures the consistency and timeliness of data and display, and avoids display delays and operational inconveniences caused by inconsistent data. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0057] Figure 1 It is a schematic diagram of the device connection of the present invention;

[0058] Figure 2 This is a flow chart of Example 1 of the present invention. DETAILED DESCRIPTION

[0059] like Figure 1 and Figure 2As shown, the present invention provides a cross-platform real-time central control screen projection instrument display method, which can realize real-time transmission and display of high-definition (720p) video data between the central control system and the instrument system, and is suitable for vehicle-mounted system application scenarios. The following is a specific implementation of the present invention.

[0060] Embodiment 1: Based on the vehicle-mounted central control screen projection display system, comprising:

[0061] Hardware configuration:

[0062] Central control system: integrated with DS90UB927Q-Q1 serializer. The serializer has the functions of automatic video format recognition, conversion and enhancement, and can adapt to the requirements of different video input formats.

[0063] Instrument system: Integrates DS90UB926Q-Q1 deserializer. The deserializer has intelligent data parsing and real-time data integrity detection functions to ensure data integrity during long-distance transmission.

[0064] Data transmission medium: In the vehicle system, high-performance shielded twisted pair cables are selected as data transmission media to ensure anti-interference and transmission stability. The projection data is transmitted between the central control system and the instrument system through AC-coupled shielded twisted pair cables, without relying on the SOC data sharing mechanism.

[0065] Control bus: Intelligent command interaction between the central control system and the instrument system is realized through the SPI bus or CAN bus to meet real-time control requirements.

[0066] The cross-platform real-time central control screen projection instrument display method includes the following steps:

[0067] Step S1: Identification and conversion of video format by the serializer

[0068] 1. Signal reception and analysis: The DS90UB927Q-Q1 serializer receives video signals from the central control system. The video signal formats include RGB, YCbCr and other formats. The resolution may be at different levels and the frame rate is not fixed.

[0069] 2. Video format recognition: The serializer uses built-in hardware registers or custom firmware to automatically identify the input signal format through the signal's pixel arrangement and data width.

[0070] 3. Real-time conversion: After identifying the input format, the serializer selects the appropriate conversion method and converts the video format in real time to meet the intelligent transmission standard. This conversion process ensures compatibility with multiple display devices.

[0071] Function representation:

[0072] F out =C(F in )

[0073] Among them, F in is the input video signal format, F out is the output format after conversion, and C(·) is the conversion function.

[0074] Step S2: Select compression and enhancement video coding standards according to complexity and convert video allocation rate

[0075] 1. Content complexity analysis: The system uses an AI model to analyze the complexity of video content. This AI model is an AI algorithm model used in the existing technology for dynamic adjustment strategies of video coding standards such as H.264 and H.265. The extracted features include edge density (ED), motion complexity (MC), color complexity (CC), and computational complexity score (VCS). The compression and enhancement algorithms are dynamically selected based on the score:

[0076] VCS=w1·ED+w2·MC+w3·CC

[0077] Among them, w1, w2 and w3 are the weight coefficients of the features, reflecting the analysis of different complexity features on the overall complexity of the video content.

[0078] 2. Dynamic compression algorithm selection: Based on VCS, the system automatically selects the appropriate compression video coding standard. For example, low-complexity content uses H.264 compression, and high-complexity content uses H.265 high-quality compression mode.

[0079] 3. Real-time resolution adjustment: Dynamically adjust the output resolution based on factors such as transmission distance, network bandwidth, and display device capabilities to ensure smooth display even when bandwidth is limited.

[0080] The principle of dynamic resolution adjustment is based on the following logic:

[0081] If VCS ≥ T high , then Output resolution = R high

[0082] If VCS <T high and VCS≥T low , then Output resolution = R medium

[0083] If VCS <T low , then Output resolution = R low

[0084] Among them, R high, R medium , R low They are high, medium and low resolution, respectively. high 、T low The video data stream with the resolution adjusted for a preset complexity score threshold is transmitted in real time.

[0085] The projection data is transmitted between the central control system and the instrument system through AC-coupled shielded twisted pair cables, which does not rely on the SOC data sharing mechanism. The vehicle-mounted system uses high-performance shielded twisted pair cables to ensure anti-interference in mobile environments and reduce the impact of electromagnetic interference on data transmission. For higher bandwidth and transmission stability requirements, optical fiber can be selected in specific scenarios. The serializer transmits the collected, analyzed, and coordinated data to the deserializer through twisted pair cables.

[0086] Through the SPI bus or CAN bus, intelligent command interaction between the central control system and the instrument system is realized.

[0087] 1. Priority setting: Set initial priorities for different instructions, with key instructions (such as control commands) having higher priorities.

[0088] 2. Dynamically adjust priority: Combined with the real-time network status, automatically adjust the transmission priority of instructions to ensure that important instructions are delivered in time.

[0089] Step S3: The deserializer parses the data stream and adjusts the refresh rate of the content

[0090] 1. Packet parsing: The deserializer checks the packet header information to ensure that the sequence and timestamp are consistent.

[0091] 2. Synchronization and error correction: If data packets are found to be lost or out of sequence, the deserializer resynchronizes the clock and data stream.

[0092] 3. Integrity check: Verify the integrity of the data and detect whether there is data corruption through checksum or CRC.

[0093] 4. Data recovery: If damage is detected, the deserializer recovers the data through forward error correction (FEC) or automatic retransmission (ARQ) mechanism, which is an algorithm model for recovering data in the prior art.

[0094] Dynamic refresh rate adjustment

[0095] The system dynamically adjusts the refresh rate based on content complexity, display device capabilities, and network bandwidth. For example, complex video content requires a high refresh rate to avoid lag, while static images can have a lower refresh rate to save bandwidth.

[0096] The formula means:

[0097] FR adjusted=f(CCS,R max ,R min ,B available );

[0098] Among them, FR adjusted is the adjusted refresh rate (unit: Hz), CCS is the content complexity score, which reflects the dynamic characteristics and detail density of the video, R max is the maximum supported refresh rate (such as 60Hz, 120Hz), R min is the lowest refresh rate (e.g. 30Hz), B available The currently available bandwidth affects the upper limit of the refresh rate.

[0099] The specific dynamic adjustment rules are as follows: When CCS is high, the refresh rate approaches R max , when CCS is low, the refresh rate will be reduced to R min Or somewhere in between. If the network bandwidth is insufficient, the system will automatically adjust the refresh rate to prevent image delays or freezes due to bandwidth bottlenecks.

[0100] The specific logic of dynamic adjustment of refresh rate can be expressed by the following formula:

[0101]

[0102] Among them, T high and T low It is the threshold that defines the complexity of the content.

[0103] Step S4: data preprocessing, which includes compression, encoding and packetization;

[0104] 1. Data compression: Use lossless compression (such as Huffman) to compress text and key control instructions, and use lossy compression (such as JPEG, H.264) to compress video and image data.

[0105] 2. Data coding: Error correction information is added through channel coding (such as forward error correction FEC) to enhance the data's anti-interference ability.

[0106] 3. Data segmentation: Divide the data into multiple small data packets for transmission, and add verification information to each data packet so that the receiving end can reassemble and verify the data.

[0107] Step S5: Instrument screen projection

[0108] The instrument chip controls the DS90UB926Q-Q1 deserializer and obtains the content to be displayed from the deserializer. After receiving the data, the instrument chip uses the built-in dynamic partitioning and priority mechanism to accurately present the data in the appropriate display area of ​​the instrument according to the type, importance and display requirements of the content.

[0109] The above description is only a preferred embodiment of the present invention and does not limit the present invention in any form. Any ordinary technician in the industry can smoothly implement the present invention as shown in the drawings and described above. However, any equivalent changes, modifications and evolutions made by technicians familiar with the profession without departing from the scope of the technical solution of the present invention using the technical content disclosed above are all equivalent embodiments of the present invention. At the same time, any equivalent changes, modifications and evolutions made to the above embodiments based on the essential technology of the present invention are still within the protection scope of the technical solution of the present invention.

Claims

1. A cross-platform real-time central control screen projection instrument display method, characterized by: The following steps are involved: S1: The serializer in the vehicle's central control platform identifies and converts video formats; S2: The serializer selects compression and enhancement video coding standards based on the input video in S1, and adjusts the video resolution; S3: The deserializer in the vehicle instrument platform parses the data stream and adjusts the video content refresh rate; S4: compress, encode and subpacketize the data adjusted in S3; S5: The meter chip receives the data content of the deserializer and presents the data content in the meter area.

2. A cross-platform real-time central control screen projection instrument display method according to claim 1, characterized in that: The steps of identifying and converting video formats include: S11: The serializer receives the original video signal from the central control system, where the original video signal includes format, resolution, and frame rate; S12: analyzing the pixel arrangement and data width of the original video signal; S13: Determine the format of the input signal, select a conversion method based on the supported format set and perform real-time conversion, which is represented by the following function: F out =C(F in ) Among them, F in is the input video signal format, F out is the output format after conversion, and C(·) is the conversion function.

3. A cross-platform real-time central control screen projection instrument display method according to claim 1 or 2, characterized in that: The specific steps of adjusting the video resolution are: S21: Content analysis, the system uses AI models to analyze the complexity of video content, and AI models extract video features: Measures the details and texture of an image and the complexity of the motion in the picture; describes the richness of the colors in the picture; through these features, the AI ​​model assigns a complexity score to the video content and dynamically selects compression and enhancement video coding standards based on the score: VCS=w1·ED+w2·MC+w3·CC Among them, w1, w3 and w3 are the weight coefficients of the features, VCS is the complexity score, ED is the edge density, MC is the motion complexity, and CC is the color complexity; S22: Based on the complexity score, the string adder dynamically selects compression and enhancement video coding standards; S23: selecting a video coding standard with a high compression ratio for a low-complexity picture, selecting a video coding standard with a moderate compression ratio for a medium-complexity picture, and selecting a video coding standard with a low compression ratio for a high-complexity picture; S24: According to the transmission distance, network bandwidth, and display device capability, the output resolution is adjusted in real time through the following formula, dynamic resolution: If VCS>T high ,then Output resolution=R high ; If VCS<T high and VCS≥T low ,the Output resolution=R medium ; IF VCS<T low ,then Output resolution=R low ; Among them, R high , R medium , R low Represent high resolution, medium resolution and low resolution respectively, T high 、T low A threshold for pre-set complexity scores; S25: Automatically selecting the output format and resolution of the video stream through the dynamic resolution adjustment and according to the requirements of the output display device.

4. A cross-platform real-time central control screen projection instrument display method according to claim 1, characterized in that: The specific steps of parsing the data stream are: S31: The deserializer checks the header information of each data packet to make the data sequence and timestamp consistent; S32: If data packets are found to be lost or out of sequence, the deserializer corrects them by resynchronizing the clock and data stream; S33: rearrange the data stream according to the timing information so that the video frames are restored in a correct order; S34: The data packet is accompanied by a checksum cyclic redundancy check value. When the deserializer receives the data packet, it calculates its checksum and compares it with the expected checksum in the transmission, which is a set standard checksum. S35: If data packet loss or damage is detected, the deserializer will recover the data through forward error correction technology or automatic retransmission mechanism.

5. A cross-platform real-time central control screen projection instrument display method according to claim 1 or 4, characterized in that: The method for adjusting the video content refresh rate comprises: The refresh rate is adjusted dynamically based on the complexity of the content, the capabilities of the display device, and changes in network bandwidth. The following formula is used to express this: FR adjusted =f(CCS,R max ,R min ,R available ); Among them, FR adjusted is the adjusted refresh rate, CCS is the content complexity score, which reflects the dynamic characteristics and detail density of the video, R max is the maximum supported refresh rate, R min is the minimum refresh rate, B available The currently available bandwidth affects the upper limit of the refresh rate; The specific refresh rate adjustment rules are as follows: When CCS is high, the refresh rate approaches R max , when CCS is low, the refresh rate will be reduced to R min or between R max With R min between; The refresh rate adjustment is also expressed by the following formula: Among them, T high and T low It is the threshold that defines the complexity of the content.

6. A cross-platform real-time central control screen projection instrument display method according to claim 1, characterized in that: The central control platform and the instrument platform are connected via an SPI bus and a CAN bus, and the SPI bus and the CAN bus are used for command interaction between the central control platform and the instrument platform.

7. A cross-platform real-time central control screen projection instrument display method according to claim 1, characterized in that: The data compression includes: lossless compression and lossy compression. The lossless compression completely compresses text data and key control instructions, and the compressed data is recoverable. The lossy compression removes redundant information, and the compressed data is irrecoverable. The lossless compression compresses text and key control instructions, and the lossy compression compresses video and image data.

8. A cross-platform real-time central control screen projection instrument display method according to claim 1, characterized in that: The serializer transmits the data to the deserializer through the twisted pair.

9. A cross-platform real-time central control screen projection instrument display method according to claim 1, characterized in that: The data encoding includes adding error correction information through channel coding; The data subpacketization includes: dividing the data into a plurality of small data packets for transmission, and adding verification information into each small data packet.

Images