Projection screen anomaly detection method and device, equipment, medium and product

Abstract

The invention provides a screen projection picture anomaly detection method and device, equipment, a medium and a product. The method comprises the following steps: transmitting first current screen projection information to a screen projected node through at least one intermediate node; determining a first verification result corresponding to the first current frame data according to the position information; receiving a second verification result and a third verification result which are sent by the intermediate node and correspond to the first current screen projection information; and if it is determined based on the first verification result, the second verification result and the third verification result that data exception exists in the process of transmitting the first current frame data to the screen-projected node, and data exception also exists in the transmission process of frame data of a preset number of frames after the first current frame data, determining that the screen-projected picture is exceptional. According to the projection screen image abnormity detection method, real-time detection of projection screen image abnormity is realized.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method, device, equipment, medium and product for detecting abnormalities in projection images. Background Art

[0002] As the number of in-car screens increases, multi-screen interactive functions are becoming more and more abundant. Screen projection applications, such as map projection and video projection, have greatly enriched the user experience scenarios.

[0003] In cross-system screen projection, due to the long link, the projection data undergoes at least one copy operation, and generally there are more than two projection nodes, various problems may occur in the projection screen.

[0004] However, there is currently a lack of methods for real-time detection of projection image anomalies. Summary of the invention

[0005] The present application provides a method, device, equipment, medium and product for detecting abnormalities in projected images, so as to solve the problem of the current lack of a method for real-time detection of abnormalities in projected images.

[0006] In a first aspect, the present application provides a method for detecting abnormalities in a projection screen. The vehicle system includes a plurality of system-on-chips (SOCs), and the SOCs are installed with a plurality of operating systems, each of which serves as a node for data processing and data transmission in the SOCs. The method is applied to the SOCs, and the method includes:

[0007] Transmitting first current projection information to the projected node through at least one intermediate node; the first current projection information includes first current frame data and first verification related information corresponding to the first current frame data; the first verification related information includes position information corresponding to a preset number of pixel points;

[0008] Determine a first verification result corresponding to the first current frame data according to the position information;

[0009] Receive a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information;

[0010] If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projected screen.

[0011] Furthermore, in the method as described above, the position information is a position array formed by the position data of each pixel point in a preset arrangement order;

[0012] The determining, according to the position information, a first verification result corresponding to the first current frame data includes:

[0013] Determine corresponding first verification data from the first current frame data according to the position array; the first verification data is part or all of the first current frame data;

[0014] The first verification data is verified by using a cyclic redundancy check method to generate a first verification result.

[0015] Further, in the method described above, if the number of intermediate nodes is one;

[0016] The second verification result is generated by the intermediate node receiving the first current screen projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method;

[0017] The third verification result is generated by the projected node determining the corresponding third verification data from the received second current frame data based on the position information after receiving the second current projection information sent by the intermediate node, and verifying the third verification data using a cyclic redundancy check method; the second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and position information.

[0018] Further, in the above method, if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the screen-projected node, it includes:

[0019] Compare the first verification result with the second verification result to generate a first comparison result;

[0020] Compare the first verification result and the third verification result to generate a second comparison result;

[0021] If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0022] Furthermore, in the above method, if the first comparison result and / or the second comparison result are different, the method further includes:

[0023] If the first comparison result is different, it is determined that a data transmission abnormality occurs in the intermediate node, and information of the intermediate node where the abnormality occurs is stored;

[0024] If the second comparison result is different, it is determined that a data transmission anomaly occurs in the projected screen node, and the information of the projected screen node is stored.

[0025] Furthermore, in the above method, after determining that there is an abnormality in the screen projection, the method further includes:

[0026] All the screen projection information is retransmitted to the projected node through at least one intermediate node; the screen projection information includes multiple frame data corresponding to the projection and verification related information corresponding to each frame data.

[0027] A second aspect of the present application provides a projection screen abnormality detection device, wherein the vehicle system includes a plurality of system-on-chips SOCs, the SOCs are installed with a plurality of operating systems, each operating system serves as a node for data processing and data transmission in the SOC, the device is located in the SOC, and the device includes:

[0028] A transmission module, used to transmit first current projection information to a projected node through at least one intermediate node; the first current projection information includes first current frame data and first verification related information corresponding to the first current frame data; the first verification related information includes position information corresponding to a preset number of pixel points;

[0029] A first determination module, configured to determine a first verification result corresponding to the first current frame data according to the position information;

[0030] A receiving module, used for receiving a second verification result and a third verification result corresponding to the first current projection screen information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected screen node verifying the corresponding data to be verified according to the position information;

[0031] The second determination module is used to determine that there is an abnormality in the projection screen if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data.

[0032] Furthermore, in the above-mentioned device, the position information is a position array formed by the position data of each pixel point in a preset arrangement order;

[0033] The first determining module is specifically used for:

[0034] Determine corresponding first verification data from the first current frame data according to the position array; the first verification data is part or all of the first current frame data; and use a cyclic redundancy check method to verify the first verification data to generate a first verification result.

[0035] Further, in the above device, if the number of intermediate nodes is one;

[0036] The second verification result is generated by the intermediate node receiving the first current screen projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method;

[0037] The third verification result is generated by the projected node determining the corresponding third verification data from the received second current frame data based on the position information after receiving the second current projection information sent by the intermediate node, and verifying the third verification data using a cyclic redundancy check method; the second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and position information.

[0038] Further, in the above-described device, if the second determination module determines that there is a data anomaly in the process of transmitting the first current frame data to the projected node based on the first verification result, the second verification result, and the third verification result, the second determination module is specifically used to:

[0039] The first verification result and the second verification result are compared to generate a first comparison result; the first verification result and the third verification result are compared to generate a second comparison result; if the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0040] Furthermore, in the above device, if the first comparison result and / or the second comparison result are different, the device further includes:

[0041] The storage module is used to determine that a data transmission anomaly occurs in the intermediate node if the first comparison result is different, and store the information of the intermediate node with the anomaly; if the second comparison result is different, it is used to determine that a data transmission anomaly occurs in the projected node, and store the information of the projected node.

[0042] Furthermore, the device as described above further comprises:

[0043] The re-projection module is used to re-transmit all the projection information to the projected node through at least one intermediate node; the projection information includes multiple frame data corresponding to the projection and verification related information corresponding to each frame data.

[0044] A third aspect of the present application provides an electronic device, including: a memory and a processor;

[0045] The memory stores computer-executable instructions;

[0046] The processor executes the computer-executable instructions stored in the memory to implement the projection image abnormality detection method as described in any one of the first aspects.

[0047] The fourth aspect of the present application provides a computer-readable storage medium, in which computer execution instructions are stored. When the computer execution instructions are executed by a processor, they are used to implement the projection screen abnormality detection method described in any one of the first aspects.

[0048] The fifth aspect of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the method for detecting abnormalities in projected images as described in any one of the first aspects.

[0049] The present application provides a method, device, equipment, medium and product for detecting abnormalities in a projection screen, the method comprising: transmitting the first current projection screen information to the projection screen node through at least one intermediate node; the first current projection screen information comprises the first current frame data and the first verification related information corresponding to the first current frame data; the first verification related information comprises the position information corresponding to a preset number of pixels; determining the first verification result corresponding to the first current frame data according to the position information; receiving the second verification result and the third verification result corresponding to the first current projection screen information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projection screen node verifying the corresponding data to be verified according to the position information; if it is determined based on the first verification result, the second verification result and the third verification result that there is a data abnormality in the process of transmitting the first current frame data to the projection screen node, and there is also a data abnormality in the transmission process of the frame data of the preset number of frames after the first current frame data, then it is determined that there is an abnormality in the projection screen. The projection screen abnormality detection method of the present application transmits the first verification related information and the first current frame data to the projection screen node through at least one intermediate node when transmitting each frame of data. At the same time, a first verification result is generated based on the position information corresponding to the pixel point, and a second verification result and a third verification result sent by the intermediate node are received. Therefore, based on the first verification result, the second verification result and the third verification result, it is determined whether there is a data anomaly in the process of transmitting the first current frame data to the projected node. If it is determined that there is a data anomaly and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, it is determined that there is an anomaly in the projected screen, thereby realizing real-time detection of the anomaly of the projected screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0051] Figure 1 A scene diagram that can implement the projection screen abnormality detection method of the embodiment of the present application;

[0052] Figure 2 Schematic diagram of the process of the projection screen abnormality detection method provided in this application Figure 1 ;

[0053] Figure 3 Schematic diagram of the process of the projection screen abnormality detection method provided in this application Figure 2 ;

[0054] Figure 4 A schematic diagram of the architecture of the projection screen abnormality detection method provided in this application;

[0055] Figure 5 An interactive schematic diagram of the projection screen abnormality detection method provided in this application;

[0056] Figure 6 A schematic diagram of the structure of the projection screen abnormality detection device provided in this application;

[0057] Figure 7 A schematic diagram of the structure of the electronic device provided in this application.

[0058] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0059] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0060] It should be noted that the method, device, equipment, medium and product disclosed herein for detecting abnormalities in projection screens can be used in the field of vehicle technology. It can also be used in any field other than the field of vehicle technology. The application field of the method, device, equipment, medium and product disclosed herein for detecting abnormalities in projection screens is not limited.

[0061] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0062] In order to clearly understand the technical solution of this application, the concept of this solution is first introduced in detail. At present, with the continuous development of vehicle technology, smart cockpit has become an important direction of vehicle technology research. There may be multiple on-board screens in the smart cockpit for multi-screen interaction. Among them, screen projection interaction is a commonly used interaction method in multi-screen interaction. Users can project maps from one screen to another, making it easier for users to view maps.

[0063] In cross-system screen projection, due to the long link, the projection data undergoes at least one copy operation, and generally there are more than two projection nodes, various problems may occur in the projection screen.

[0064] However, there is currently a lack of methods for real-time detection of projection image anomalies.

[0065] Therefore, in view of the problem that the prior art lacks a method for real-time detection of abnormalities in the projection screen, the inventors found in their research that in order to solve this problem, the first verification-related information and the first current frame data can be transmitted to the projection screen node through at least one intermediate node when each frame of data is transmitted. At the same time, the intermediate node and the projection screen node are both verified based on the first verification-related information. In this way, the transmission status of each frame of data can be verified to determine whether there is an abnormality in the projection screen.

[0066] Specifically, the first current projection information is transmitted to the projected node through at least one intermediate node. The first current projection information includes the first current frame data and the first verification related information corresponding to the first current frame data. The first verification related information includes the position information corresponding to a preset number of pixels. Determine the first verification result corresponding to the first current frame data according to the position information. Receive the second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node. The second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information. The third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information. If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of the preset number of frames after the first current frame data, then it is determined that there is an abnormality in the projection picture.

[0067] The projection screen abnormality detection method of the present application transmits the first verification related information and the first current frame data to the projection screen node through at least one intermediate node when transmitting each frame of data. At the same time, a first verification result is generated based on the position information corresponding to the pixel point, and the second verification result and the third verification result sent by the intermediate node are received. Therefore, based on the first verification result, the second verification result and the third verification result, it is determined whether there is a data abnormality in the process of transmitting the first current frame data to the projection screen node. If it is determined that there is a data abnormality and there is also a data abnormality in the transmission process of the frame data of a preset number of frames after the first current frame data, it is determined that there is an abnormality in the projection screen, thereby realizing real-time detection of the projection screen abnormality.

[0068] Based on the above creative findings, the inventor proposed the technical solution of the present application.

[0069] The following is an introduction to the application scenarios of the projection screen abnormality detection method provided in the embodiment of the present application. Figure 1 As shown, 1 is SOC (System-on-a-Chip) A, and 2 is SOCB. SOCA is installed with two operating systems, each operating system as a node, namely, node A1 and node A2 in the figure. SOCB is installed with two operating systems, each operating system as a node, namely, node B1 and node B2 in the figure. Node B1 and node B2 communicate through shared memory, node B1 and node A2 communicate through a bus, and node A2 and node A1 communicate through shared memory.

[0070] In other application scenarios, the number of SOCs may be three or more, and the number of operating systems in each SOC may also be greater than two, which is not limited in this embodiment.

[0071] Exemplarily, when the user initiates screen projection to the corresponding screen of SOCA by operating the corresponding screen of SOCB, SOCB processes as follows:

[0072] ① Node B1 transmits the projection information to the projection node, i.e., node A1, in real time through node A2. For each current projection information, such as the first current projection information, the following processing is performed:

[0073] The first current projection screen information includes the first current frame data and the first verification related information corresponding to the first current frame data. The first verification related information includes the position information corresponding to a preset number of pixel points. The first verification result corresponding to the first current frame data is determined according to the position information.

[0074] ② After receiving the first current projection information, node A2 generates a second verification result based on the location information and forwards the second current projection information to node A1. The second current projection information is based on the first current projection information, and the second current projection information may be the same as or different from the first current projection information.

[0075] At the same time, node A2 transmits the second verification result to node B1.

[0076] ③ After receiving the second current screen projection information, node A1 generates a third verification result based on the position information, and displays corresponding data on the corresponding screen based on the second current screen projection information.

[0077] At the same time, node A1 transmits the third verification result to node B1 through node A2.

[0078] ④ Node B1 determines whether there is data anomaly in the process of transmitting the first current frame data to the projected node based on the first verification result, the second verification result and the third verification result.

[0079] ⑤ If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames transmitted by node B1 after the first current frame data, then it is determined that there is an abnormality in the projected screen.

[0080] After determining that there is an abnormality in the projection screen, node B1 can restart the projection screen to solve the problem of the abnormal projection screen.

[0081] The embodiments of the present application are introduced below in conjunction with the drawings in the specification.

[0082] Figure 2 Schematic diagram of the process of the projection screen abnormality detection method provided in this application Figure 1 ,like Figure 2 As shown, in this embodiment, the execution subject of the embodiment of the present application is a projection screen abnormality detection device, which can be integrated in an electronic device, such as a vehicle terminal, or concentrated in a system-on-chip SOC. The projection screen abnormality detection method provided in this embodiment includes the following steps:

[0083] Step S101, transmitting the first current projection information to the projection node through at least one intermediate node. The first current projection information includes the first current frame data and the first verification related information corresponding to the first current frame data. The first verification related information includes the position information corresponding to a preset number of pixel points.

[0084] In this embodiment, the screen projection node transmits the screen projection information to the screen projection node through the intermediate node in real time. For each frame of data, the transmission process of step S101 and the verification process after step S101 are performed.

[0085] In this embodiment, the first current frame data may be frame data currently being transmitted, such as the first frame data, the second frame data, the last frame data, and the like.

[0086] The intermediate node refers to a node that transmits data between the projection node and the projection node, and the projection node refers to a node that ultimately receives the projection information and displays it on the corresponding screen based on the projection information.

[0087] In this embodiment, the nodes are divided according to the operating system (OS) installed in the SOC.

[0088] Optionally, the first verification-related information also includes frame sequence number, identification to be verified and other information.

[0089] Optionally, the preset number may be set to 512, or may be set according to actual applications. Meanwhile, the position information corresponding to the pixel point is based on the color channel, and the position information of different color channels may be different.

[0090] Step S102: determining a first verification result corresponding to the first current frame data according to the position information.

[0091] In this embodiment, the data to be verified in the first current frame data can be determined based on the position information, thereby generating a first verification result corresponding to the first current frame data. The first verification result represents the verification result of the initially transmitted data.

[0092] Step S103, receiving the second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node. The second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information. The third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information.

[0093] In some embodiments, the second verification result is generated by the intermediate node verifying the first current frame data according to the location information.

[0094] In some embodiments, the third verification result is generated by the projected node verifying the second current frame data sent from the intermediate node according to the position information. The second current frame data is based on the first current frame data, and the second current frame data may be the same as or different from the first current frame data.

[0095] Optionally, when receiving the second verification result and the third verification result, the frame number corresponding to the second verification result and the frame number corresponding to the third verification result may be received simultaneously.

[0096] Step S104, if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projected picture.

[0097] In this embodiment, whether there is data anomaly in the process of transmitting the first current frame data to the projected node can be determined by comparing the first verification result with the second verification result, and comparing the first verification result with the third verification result.

[0098] In this embodiment, after the first current frame data, it may be necessary to continue to transmit a number of frames of frame data, and the process from step S101 to step S104 is performed for each frame data to be transmitted thereafter.

[0099] Optionally, the preset number of frames can be set to 2 frames, that is, if data abnormalities appear in three consecutive frames including the first current frame data, it can be determined that there is an abnormality in the projection screen. At the same time, the preset number of frames can also be set according to actual needs, such as 3 frames, 4 frames, etc., which is not limited in this embodiment.

[0100] A method for detecting abnormalities in a projection screen provided in an embodiment of the present application includes: transmitting the first current projection screen information to the projection screen node through at least one intermediate node. The first current projection screen information includes the first current frame data and the first verification related information corresponding to the first current frame data. The first verification related information includes the position information corresponding to a preset number of pixel points. Determine the first verification result corresponding to the first current frame data according to the position information. Receive the second verification result and the third verification result corresponding to the first current projection screen information sent by the intermediate node. The second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information. The third verification result is generated by the projection screen node verifying the corresponding data to be verified according to the position information. If it is determined based on the first verification result, the second verification result and the third verification result that there is a data abnormality in the process of transmitting the first current frame data to the projection screen node, and there is also a data abnormality in the transmission process of the frame data of the preset number of frames after the first current frame data, it is determined that there is an abnormality in the projection screen.

[0101] The projection screen abnormality detection method of the present application transmits the first verification related information and the first current frame data to the projection screen node through at least one intermediate node when transmitting each frame of data. At the same time, a first verification result is generated based on the position information corresponding to the pixel point, and the second verification result and the third verification result sent by the intermediate node are received. Therefore, based on the first verification result, the second verification result and the third verification result, it is determined whether there is a data abnormality in the process of transmitting the first current frame data to the projection screen node. If it is determined that there is a data abnormality and there is also a data abnormality in the transmission process of the frame data of a preset number of frames after the first current frame data, it is determined that there is an abnormality in the projection screen, thereby realizing real-time detection of the projection screen abnormality.

[0102] Figure 3 Schematic diagram of the process of the projection screen abnormality detection method provided in this application Figure 2 ,like Figure 3 As shown, the projection screen abnormality detection method provided in this embodiment is further refined on the basis of the projection screen abnormality detection method provided in the previous embodiment of the present application, and the projection screen abnormality detection method provided in this embodiment includes the following steps.

[0103] Step S201: transmit the first current projection screen information to the projection screen node through at least one intermediate node.

[0104] In this embodiment, the implementation of step S201 is the same as or similar to the implementation of step S101 in the above embodiment, and will not be described in detail here.

[0105] It should be noted that the position information is a position array formed by the position data of each pixel in a preset arrangement order, wherein the preset arrangement order can be an arrangement position order of the pixels or a random position arrangement order of the pixels, which is not limited in this embodiment.

[0106] Step S202, determining corresponding first verification data from the first current frame data according to the position array, wherein the first verification data is part or all of the first current frame data.

[0107] In this embodiment, since the position data corresponding to the pixel points are recorded in the position array, data corresponding to the position data can be obtained from the first current frame data based on the position data, and the corresponding data can be used as the first verification data.

[0108] Optionally, in this embodiment, if the number of intermediate nodes is one.

[0109] The second verification result is generated by the intermediate node receiving the first current projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method.

[0110] The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check method. The second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and the position information.

[0111] In this embodiment, since errors may occur in data transmission, the information sent by the intermediate node is called the second current screen projection information. The second current screen projection information may be the same as the first current screen projection information or may be different.

[0112] Optionally, in this embodiment, if there are multiple intermediate nodes, the second verification result is divided into two types:

[0113] The first one is the same as the second verification result mentioned above, that is, after the intermediate node receives the first current projection information, it determines the corresponding second verification data from the received first current frame data based on the position information, and uses a cyclic redundancy check method to verify and generate the second verification data.

[0114] The second type is generated by verifying the received data when transmitting information between the intermediate nodes. For example, after the first intermediate node receives the first current projection information, it forwards the first current projection information and transmits the second current projection information to the second intermediate node. The second intermediate node receives the second current projection information and forwards the third current projection information to the third intermediate node. Among them, the first current projection information, the second current projection information, and the third current projection information may be the same or different.

[0115] Step S203: Use a cyclic redundancy check method to check the first check data to generate a first check result.

[0116] In this embodiment, a cyclic redundancy check (CRC) is a verification method for detecting errors in data transmission or storage. In this embodiment, the first verification data is verified by using a cyclic redundancy check method, so that data integrity can be better verified.

[0117] Step S204, receiving the second verification result and the third verification result corresponding to the first current screen projection information sent by the intermediate node.

[0118] In this embodiment, the implementation of step S204 is the same as or similar to the implementation of step S103 in the above embodiment, and will not be described in detail here.

[0119] Step S205: Compare the first verification result and the second verification result to generate a first comparison result.

[0120] In this embodiment, if the first verification result is the same as the second verification result, the first comparison result is the same. If the first verification result is different from the second verification result, the first comparison result is different.

[0121] Step S206: compare the first verification result and the third verification result to generate a second comparison result.

[0122] In this embodiment, if the first verification result is the same as the third verification result, the second comparison result is the same. If the first verification result is different from the third verification result, the second comparison result is different.

[0123] Step S207: If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0124] In this embodiment, when the first comparison result is different, the second comparison result is different, or the first comparison result and the second comparison result are different, it can be determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node. For example, there may be data corruption, data loss, and other problems.

[0125] Optionally, in this embodiment, if the first comparison result and / or the second comparison result are different, the abnormal problem may also be stored, as follows:

[0126] If the first comparison result is different, it is determined that a data transmission anomaly occurs in the intermediate node, and information of the intermediate node where the anomaly occurs is stored.

[0127] If the second comparison result is different, it is determined that a data transmission anomaly occurs in the projected screen node, and the information of the projected screen node is stored.

[0128] In this embodiment, the information of the intermediate node or the screen-projected node where the abnormality occurs is stored, which can facilitate the subsequent abnormality repair process. The stored information can store, for example, the identifier of the intermediate node, the identifier of the screen-projected node, the time when the abnormality occurs, the content of the transmitted data, and other information.

[0129] Optionally, in this embodiment, after S207, a re-screen projection process may be performed to solve the problem of abnormal screen projection, as follows:

[0130] All the screen projection information is retransmitted to the screen projection node through at least one intermediate node. The screen projection information includes multiple frame data corresponding to the screen projection and verification related information corresponding to each frame data.

[0131] In this embodiment, all the projection information that needs to be transmitted for re-projection can be the first current projection information with an abnormality and the projection information after the first current projection information, or can be the projection information after a preset number of frames of the first current projection information and the projection information after the projection information. This embodiment does not limit this.

[0132] The screen projection information includes each frame data corresponding to the screen projection and the verification related information corresponding to each frame data.

[0133] In order to further describe the projection screen abnormality detection method of the present application, the following will be further described in conjunction with the accompanying drawings. Figure 4 As shown, the entire vehicle system of this embodiment is composed of two SOCs, namely SOCA and SOCB in the figure, and two operating systems OS are running on one SOC. The two SOCs are connected through the PCIe (peripheral component interconnect express, high-speed serial computer expansion bus standard) bus for cross-SOC communication, and the two OSs communicate through shared memory. Due to the limitations of the system architecture, as shown in the figure, OS A1 and OS B1 need OS A2 to forward data in the middle to achieve communication.

[0134] In this embodiment, the projection data is projected from the car screen of the vehicle computer, such as the in-vehicle infotainment host, to the instrument screen of the DIM (Dashboard Integration Module), and the projection link involves three nodes. Node 1 is the application that initiates the projection on OS B1 or OS B1 on SOC B. Node 2 is the application service responsible for relocating the projection data on OS A2 or OS A2 on SOC A. Node 3 is the application that receives and displays the projection data on OS A1 or OS A1 on SOC A.

[0135] The data flow of screen projection is from node 1 to node 2, and then node 2 to node 3.

[0136] like Figure 5 As shown in the figure, the screen projection process is as follows:

[0137] Node 1 sends screen projection information to Node 2. When Node 1 sends the first frame of data, it generates 512 random non-repeating pixel position data and fills them into the array to generate the corresponding position array. Node 1 sends this position array to Node 2 as additional information along with the first frame of data.

[0138] Node 1 sends each frame of data to node 2 in real time when projecting the screen. At the same time, it obtains the frame data that needs to be verified according to the position array of the pixel points, performs CRC verification on it to generate the first verification result, and saves the frame number and the first verification result.

[0139] After receiving the first frame data and additional information, node 2 saves the pixel position array, and then sends the projection information such as the first frame data and additional information to node 3.

[0140] After receiving the frame data, node 2 transmits the frame data to node 3, obtains the frame data to be verified according to the pixel position array, performs CRC verification on it to generate a second verification result, and packages the frame sequence number and the second verification result and sends them to node 1.

[0141] After receiving the first frame data and additional information, node 3 saves the pixel position array.

[0142] After receiving the projection information such as frame data and additional information, node 3 obtains the frame data to be verified according to the pixel position array, performs CRC verification on it, and generates the third verification result. The frame sequence number and the third verification result are packaged and sent to node 2, which then forwards it to node 1.

[0143] After node 1 receives the second verification result from node 2, it compares it with the first verification result saved by node 1 and records the comparison result. After node 1 receives the third verification result from node 3, it compares it with the first verification result saved by node 1 and records the comparison result. If the comparison result is different, it means that the frame data of the projection screen has an abnormality during the transmission process. If the verification results of three consecutive frames of data are all abnormal, close the projection screen and re-initiate the projection screen.

[0144] In this embodiment, the additional information corresponds to the first verification related information and the second verification related information in the above embodiment, and the additional information may be the same as the first verification related information or the second verification related information.

[0145] Figure 6 The schematic diagram of the structure of the projection screen abnormality detection device provided in this application is as follows: Figure 6 As shown, in this embodiment, the projection screen abnormality detection device 300 can be set in an electronic device, such as a vehicle-mounted terminal, a system-on-chip SOC, and the projection screen abnormality detection device 300 includes:

[0146] The transmission module 301 is used to transmit the first current projection information to the projection node through at least one intermediate node. The first current projection information includes the first current frame data and the first verification related information corresponding to the first current frame data. The first verification related information includes the position information corresponding to a preset number of pixel points.

[0147] The first determination module 302 is used to determine a first verification result corresponding to the first current frame data according to the position information.

[0148] The receiving module 303 is used to receive the second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node. The second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information. The third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information.

[0149] The second determination module 304 is used to determine that there is an abnormality in the projection screen if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data.

[0150] The projection screen abnormality detection device provided in this embodiment can be executed Figure 2 The technical solution of the method embodiment shown in the figure has the same implementation principle and technical effect as Figure 2 The method embodiments shown are similar and will not be described in detail here.

[0151] The projection screen abnormality detection device provided in the present application is further refined on the basis of the projection screen abnormality detection device provided in the previous embodiment, and the projection screen abnormality detection device 300 includes:

[0152] Optionally, in this embodiment, the position information is a position array formed by the position data of each pixel in a preset arrangement order.

[0153] The first determining module 302 is specifically used for:

[0154] The first verification data corresponding to the first current frame data is determined according to the position array. The first verification data is part or all of the first current frame data. The first verification data is verified by a cyclic redundancy check method to generate a first verification result.

[0155] Optionally, in this embodiment, if the number of intermediate nodes is one.

[0156] The second verification result is generated by the intermediate node receiving the first current projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method.

[0157] The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check method. The second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and the position information.

[0158] Optionally, in this embodiment, if the second determination module 304 determines that there is a data anomaly in the process of transmitting the first current frame data to the projected node based on the first verification result, the second verification result, and the third verification result, it is specifically used to:

[0159] The first verification result and the second verification result are compared and processed to generate a first comparison result. The first verification result and the third verification result are compared and processed to generate a second comparison result. If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0160] Optionally, in this embodiment, if the first comparison result and / or the second comparison result are different, the projection image abnormality detection device 300 further includes:

[0161] The storage module is used to determine that the data transmission of the intermediate node is abnormal if the first comparison result is different, and store the information of the abnormal intermediate node. If the second comparison result is different, it is determined that the data transmission of the projected node is abnormal, and store the information of the projected node.

[0162] Optionally, in this embodiment, the projection image abnormality detection device 300 further includes:

[0163] The reprojection module is used to retransmit all the projection information to the projected node through at least one intermediate node. The projection information includes multiple frame data corresponding to the projection and verification related information corresponding to each frame data.

[0164] The projection screen abnormality detection device provided in this embodiment can be executed Figure 2-Figure 5 The technical solution of the method embodiment shown in the figure has the same implementation principle and technical effect as Figure 2-Figure 5 The method embodiments shown are similar and will not be described in detail here.

[0165] According to an embodiment of the present application, the present application also provides an electronic device, a computer-readable storage medium and a computer program product.

[0166] like Figure 7 As shown, Figure 7 Components, their connections and relationships, and their functions shown herein are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0167] like Figure 7As shown, the electronic device includes: a processor 401 and a memory 402. The various components are connected to each other using different buses and can be installed on a common mainboard or in other ways as required. The processor can process instructions executed in the electronic device.

[0168] The memory 402 is a non-transitory computer-readable storage medium provided in the present application. The memory stores instructions executable by at least one processor to enable at least one processor to execute the projection screen abnormality detection method provided in the present application. The non-transitory computer-readable storage medium of the present application stores computer instructions, which are used to enable a computer to execute the projection screen abnormality detection method provided in the present application.

[0169] The memory 402 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the projection screen abnormality detection method in the embodiment of the present application (for example, the attached Figure 6 The processor 401 executes various functional applications and data processing of the electronic device by running the non-transient software programs, instructions and modules stored in the memory 402, that is, the projection screen abnormality detection method in the above method embodiment is implemented.

[0170] In the above-mentioned embodiment, it should be understood that the processor 401 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the invention can be directly embodied as being executed by a hardware processor, or can be executed by a combination of hardware and software modules in the processor.

[0171] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-volatile Memory, NVM), such as at least one disk storage.

[0172] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0173] At the same time, an embodiment of the present application also provides a computer product. When the instructions in the computer product are executed by a processor of an electronic device, the electronic device can execute the projection screen abnormality detection method of the above embodiment.

[0174] An embodiment of the present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.

[0175] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0176] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0177] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0178] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0179] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0180] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0181] Those skilled in the art will appreciate that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed. The aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk, etc., various media that can store program codes.

[0182] Finally, it should be noted that those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed by the present invention, are not limited to the precise structure described above and shown in the drawings, and may be modified and changed in various ways without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for detecting abnormal projection images, wherein the vehicle system includes multiple system-on-chips (SOCs), the SOCs are equipped with multiple operating systems, each operating system serving as a node for data processing and data transmission in the SOC, characterized in that: The method is applied to the SOC, and the method comprises: Transmitting first current projection information to the projected node through at least one intermediate node; the first current projection information includes first current frame data and first verification related information corresponding to the first current frame data; the first verification related information includes position information corresponding to a preset number of pixel points; Determine a first verification result corresponding to the first current frame data according to the position information; Receive a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information; If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projected screen.

2. The method according to claim 1, characterized in that The position information is a position array formed by the position data of each pixel in a preset arrangement order; The determining, according to the position information, a first verification result corresponding to the first current frame data includes: Determine corresponding first verification data from the first current frame data according to the position array; the first verification data is part or all of the first current frame data; The first verification data is verified by using a cyclic redundancy check method to generate a first verification result.

3. The method according to claim 2, characterized in that If the number of intermediate nodes is one; The second verification result is generated by the intermediate node receiving the first current screen projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method; The third verification result is generated by the projected node determining the corresponding third verification data from the received second current frame data based on the position information after receiving the second current projection information sent by the intermediate node, and verifying the third verification data using a cyclic redundancy check method; the second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and position information.

4. The method according to claim 1, characterized in that If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the screen-projected node, the process includes: Compare the first verification result with the second verification result to generate a first comparison result; Compare the first verification result and the third verification result to generate a second comparison result; If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

5. The method according to claim 4, characterized in that If the first comparison result and / or the second comparison result are not the same, the method further includes: If the first comparison result is different, it is determined that a data transmission abnormality occurs in the intermediate node, and information of the intermediate node where the abnormality occurs is stored; If the second comparison result is different, it is determined that a data transmission anomaly occurs in the projected screen node, and the information of the projected screen node is stored.

6. The method according to any one of claims 1 to 5, characterized in that: After determining that there is an abnormality in the screen projection, the method further includes: All the screen projection information is retransmitted to the screen-projected node through at least one intermediate node; the screen projection information includes multiple frame data corresponding to the screen projection and verification-related information corresponding to each frame data.

7. A projection screen abnormality detection device, wherein the vehicle system includes multiple system-on-chips (SOCs), the SOCs are installed with multiple operating systems, each operating system serves as a node for data processing and data transmission in the SOC, characterized in that: The device is located in the SOC, and the device includes: A transmission module, used to transmit first current projection information to a projected node through at least one intermediate node; the first current projection information includes first current frame data and first verification related information corresponding to the first current frame data; the first verification related information includes position information corresponding to a preset number of pixel points; A first determination module, configured to determine a first verification result corresponding to the first current frame data according to the position information; A receiving module, used for receiving a second verification result and a third verification result corresponding to the first current projection screen information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected screen node verifying the corresponding data to be verified according to the position information; The second determination module is used to determine that there is an abnormality in the projection screen if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data.

8. An electronic device, characterized in that: include: Memory and processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the projection image abnormality detection method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer execution instructions, which, when executed by a processor, are used to implement the projection image abnormality detection method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that It includes a computer program, which, when executed by a processor, implements the projection image abnormality detection method described in any one of claims 1 to 6.

Images