Method, device, equipment, medium and product for detecting abnormalities in projection images

Abstract

The present application provides a method, device, equipment, medium and product for detecting abnormalities in a projection screen, the method comprising: transmitting the first current projection screen information to the projection screen node through at least one intermediate node; determining the first verification result corresponding to the first current frame data according to the position information; receiving the second verification result and the third verification result corresponding to the first current projection screen information sent by the intermediate node; if it is determined based on the first verification result, the second verification result and the third verification result that there is a data abnormality in the process of transmitting the first current frame data to the projection screen node, and there is also a data abnormality in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an abnormality in the projection screen. The projection screen abnormality detection method of the present application realizes real-time detection of projection screen abnormalities.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method, device, equipment, medium and product for detecting abnormalities in projection images. Background Art

[0002] As the number of in-car screens increases, multi-screen interactive functions are becoming increasingly rich. Screen projection applications, such as map projection and video projection, have greatly enriched the user experience scenarios.

[0003] In cross-system screen projection, due to the long link, the projection data undergoes at least one copy operation, and generally there are more than two projection nodes, various problems may occur in the projection screen.

[0004] However, there is currently a lack of methods for real-time detection of abnormalities in projection images. Summary of the Invention

[0005] The present application provides a method, device, equipment, medium and product for detecting abnormalities in projected screens, which are used to solve the current problem of lack of a real-time detection method for abnormalities in projected screens.

[0006] In a first aspect, the present application provides a method for detecting abnormalities in a projection screen. A vehicle system includes multiple system-on-chips (SOCs), each of which is installed with multiple operating systems. Each operating system serves as a node for data processing and data transmission in the SOC. The method is applied to the SOC, and the method includes:

[0007] Transmitting first current projection information to the projected node through at least one intermediate node; the first current projection information includes first current frame data and first verification related information corresponding to the first current frame data; the first verification related information includes position information corresponding to a preset number of pixel points;

[0008] Determine a first verification result corresponding to the first current frame data according to the position information;

[0009] Receive a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information;

[0010] If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projected screen.

[0011] Furthermore, in the above method, the position information is a position array formed by the position data of each pixel in a preset arrangement order;

[0012] The determining, according to the position information, a first verification result corresponding to the first current frame data includes:

[0013] Determining corresponding first verification data from the first current frame data according to the position array; the first verification data is part or all of the first current frame data;

[0014] The first verification data is verified using a cyclic redundancy check method to generate a first verification result.

[0015] Furthermore, according to the above method, if the number of intermediate nodes is one;

[0016] The second verification result is generated by the intermediate node determining corresponding second verification data from the received first current frame data based on the position information after receiving the first current projection information, and verifying the second verification data using a cyclic redundancy check method;

[0017] The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check method; the second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and position information.

[0018] Furthermore, in the above method, if it is determined based on the first verification result, the second verification result, and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, the method includes:

[0019] Comparing the first verification result with the second verification result to generate a first comparison result;

[0020] Comparing the first verification result and the third verification result to generate a second comparison result;

[0021] If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0022] Furthermore, in the above method, if the first comparison result and / or the second comparison result are different, the method further includes:

[0023] If the first comparison result is different, it is determined that a data transmission anomaly occurs at the intermediate node, and information of the intermediate node where the anomaly occurs is stored;

[0024] If the second comparison result is different, it is determined that a data transmission anomaly occurs in the projected node, and the information of the projected node is stored.

[0025] Furthermore, the method as described above, after determining that there is an abnormality in screen projection, further includes:

[0026] All screen projection information is retransmitted to the screen-projected node through at least one intermediate node; the screen projection information includes multiple frame data corresponding to the screen projection and verification-related information corresponding to each frame data.

[0027] A second aspect of the present application provides a projection screen abnormality detection device, wherein the vehicle system includes multiple system-on-chips (SOCs), the SOCs are installed with multiple operating systems, each operating system serves as a node for data processing and data transmission in the SOC, and the device is located in the SOC, and the device includes:

[0028] A transmission module, configured to transmit first current projection information to a projected node via at least one intermediate node; the first current projection information comprising first current frame data and first verification related information corresponding to the first current frame data; the first verification related information comprising position information corresponding to a preset number of pixel points;

[0029] a first determining module, configured to determine a first verification result corresponding to the first current frame data according to the position information;

[0030] A receiving module is used to receive a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information;

[0031] The second determination module is used to determine that there is an abnormality in the projection screen if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data.

[0032] Furthermore, in the above-mentioned device, the position information is a position array formed by the position data of each pixel in a preset arrangement order;

[0033] The first determining module is specifically configured to:

[0034] The corresponding first verification data is determined from the first current frame data according to the position array; the first verification data is part or all of the first current frame data; and the first verification data is verified using a cyclic redundancy check method to generate a first verification result.

[0035] Furthermore, in the above-mentioned device, if the number of intermediate nodes is one;

[0036] The second verification result is generated by the intermediate node determining corresponding second verification data from the received first current frame data based on the position information after receiving the first current projection information, and verifying the second verification data using a cyclic redundancy check method;

[0037] The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check method; the second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and position information.

[0038] Further, in the above-described device, if the second determination module determines that there is a data anomaly in the process of transmitting the first current frame data to the projected node based on the first verification result, the second verification result, and the third verification result, the second determination module is specifically configured to:

[0039] The first verification result and the second verification result are compared to generate a first comparison result; the first verification result and the third verification result are compared to generate a second comparison result; if the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0040] Furthermore, in the above device, if the first comparison result and / or the second comparison result are different, the device further includes:

[0041] The storage module is used to determine that a data transmission anomaly occurs in the intermediate node if the first comparison result is different, and store the information of the intermediate node with the anomaly; if the second comparison result is different, determine that a data transmission anomaly occurs in the projected node, and store the information of the projected node.

[0042] Furthermore, the device as described above further comprises:

[0043] The re-projection module is used to re-transmit all projection information to the projected node through at least one intermediate node; the projection information includes multiple frame data corresponding to the projection and verification related information corresponding to each frame data.

[0044] A third aspect of the present application provides an electronic device, comprising: a memory and a processor;

[0045] The memory stores computer-executable instructions;

[0046] The processor executes the computer-executable instructions stored in the memory to implement the projection screen abnormality detection method as described in any one of the first aspects.

[0047] The fourth aspect of the present application provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a processor, they are used to implement the projection screen abnormality detection method described in any one of the first aspects.

[0048] The fifth aspect of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the projection screen abnormality detection method described in any one of the first aspects.

[0049] The present application provides a method, device, equipment, medium and product for detecting abnormalities in a projection screen, the method comprising: transmitting first current projection information to a projection node through at least one intermediate node; the first current projection information comprises first current frame data and first verification related information corresponding to the first current frame data; the first verification related information comprises position information corresponding to a preset number of pixels; determining a first verification result corresponding to the first current frame data according to the position information; receiving a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projection node verifying the corresponding data to be verified according to the position information; if it is determined based on the first verification result, the second verification result and the third verification result that there is a data abnormality in the process of transmitting the first current frame data to the projection node, and there is also a data abnormality in the transmission process of the frame data of the preset number of frames after the first current frame data, then it is determined that there is an abnormality in the projection screen. The projection screen abnormality detection method of the present application transmits the first verification related information and the first current frame data to the projection node through at least one intermediate node when transmitting each frame of data. At the same time, a first verification result is generated based on the position information corresponding to the pixel point, and a second verification result and a third verification result sent by the intermediate node are received. Based on the first verification result, the second verification result, and the third verification result, it is determined whether there is a data anomaly during the transmission of the first current frame data to the projected node. If it is determined that there is a data anomaly and that there is also a data anomaly during the transmission of the frame data of the preset number of frames after the first current frame data, it is determined that there is an anomaly in the projected image, thereby achieving real-time detection of anomalies in the projected image. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0051] Figure 1 A scene diagram that can implement the projection screen abnormality detection method of the embodiment of the present application;

[0052] Figure 2 Schematic diagram of the process of the screen projection abnormality detection method provided in this application Figure 1 ;

[0053] Figure 3 Schematic diagram of the process of the screen projection abnormality detection method provided in this application Figure 2 ;

[0054] Figure 4 This is a schematic diagram of the architecture of the projection screen anomaly detection method provided by this application;

[0055] Figure 5 This is an interactive diagram of the projection screen anomaly detection method provided by this application;

[0056] Figure 6 This is a schematic diagram of the structure of the projection screen abnormality detection device provided by this application;

[0057] Figure 7 This is a schematic diagram of the structure of the electronic device provided in this application.

[0058] The above drawings illustrate specific embodiments of the present application, which will be described in more detail below. These drawings and the textual description are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0059] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0060] It should be noted that the disclosed method, device, equipment, medium, and product for detecting anomalies in projected screens can be used in the field of automotive technology. They can also be used in any field other than automotive technology. The disclosed method, device, equipment, medium, and product for detecting anomalies in projected screens are not limited to any specific application area.

[0061] The technical solution of the present application is described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0062] In order to clearly understand the technical solution of this application, the concept of this solution is first introduced in detail. At present, with the continuous development of vehicle technology, smart cockpits have become an important direction of vehicle technology research. There may be multiple on-board screens in the smart cockpit for multi-screen interaction. Among them, screen projection interaction is a commonly used interaction method in multi-screen interaction. Users can project maps from one screen to another, making it easier for users to view maps.

[0063] In cross-system screen projection, due to the long link, the projection data undergoes at least one copy operation, and generally there are more than two projection nodes, various problems may occur in the projection screen.

[0064] However, there is currently a lack of methods for real-time detection of abnormalities in projection images.

[0065] Therefore, in order to address the problem of the existing technology lacking a method for real-time detection of projection screen anomalies, the inventors discovered that, in order to solve this problem, the first verification-related information and the first current frame data can be transmitted to the projection screen node through at least one intermediate node when each frame of data is transmitted. At the same time, both the intermediate node and the projection screen node perform verification based on the first verification-related information. In this way, the transmission status of each frame of data can be verified to determine whether there is any anomaly in the projection screen.

[0066] Specifically, the first current projection information is transmitted to the projected node through at least one intermediate node. The first current projection information includes the first current frame data and the first verification-related information corresponding to the first current frame data. The first verification-related information includes the position information corresponding to a preset number of pixel points. The first verification result corresponding to the first current frame data is determined according to the position information. The second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node are received. The second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information. The third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information. If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of the preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projection picture.

[0067] The projection screen anomaly detection method of the present application transmits the first verification related information and the first current frame data to the projection screen node through at least one intermediate node when transmitting each frame of data. At the same time, a first verification result is generated based on the position information corresponding to the pixel point, and the second verification result and the third verification result sent by the intermediate node are received. Therefore, based on the first verification result, the second verification result and the third verification result, it is determined whether there is a data anomaly in the process of transmitting the first current frame data to the projection screen node. If it is determined that there is a data anomaly and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, it is determined that there is an anomaly in the projection screen, thereby realizing real-time detection of the projection screen anomaly.

[0068] Based on the above creative findings, the inventor proposed the technical solution of this application.

[0069] The following describes the application scenarios of the projection screen abnormality detection method provided by the embodiment of the present application. Figure 1 As shown in the figure, 1 is SOC (System-on-a-Chip) A, and 2 is SOCB. SOCA has two operating systems installed, each operating system serving as a node, namely, nodes A1 and A2 in the figure. SOCB has two operating systems installed, each operating system serving as a node, namely, nodes B1 and B2 in the figure. Nodes B1 and B2 communicate via shared memory, nodes B1 and A2 communicate via a bus, and nodes A2 and A1 communicate via shared memory.

[0070] In other application scenarios, the number of SOCs may be three or more, and the number of operating systems in each SOC may also be greater than two, which is not limited in this embodiment.

[0071] For example, when a user operates the screen corresponding to SOCB to initiate screen projection to the screen corresponding to SOCA, SOCB processes the screen as follows:

[0072] ① Node B1 transmits the projection information to the projected node, i.e., node A1, in real time through node A2. For each current projection information, such as the first current projection information, the following processing is performed:

[0073] The first current projection information includes the first current frame data and first verification related information corresponding to the first current frame data. The first verification related information includes position information corresponding to a preset number of pixels. A first verification result corresponding to the first current frame data is determined based on the position information.

[0074] ② After receiving the first current projection information, node A2 generates a second verification result based on the location information and forwards the second current projection information to node A1. The second current projection information is based on the first current projection information, and the second current projection information may be the same as or different from the first current projection information.

[0075] At the same time, node A2 transmits the second verification result to node B1.

[0076] ③ After receiving the second current projection screen information, node A1 generates a third verification result based on the position information, and displays corresponding data on the corresponding screen based on the second current projection screen information.

[0077] At the same time, node A1 transmits the third verification result to node B1 through node A2.

[0078] ④ Node B1 determines whether there is data anomaly during the transmission of the first current frame data to the projected node based on the first verification result, the second verification result and the third verification result.

[0079] ⑤ If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of the preset number of frames transmitted by node B1 after the first current frame data, then it is determined that there is an anomaly in the projected screen.

[0080] After determining that there is an abnormality in the projection screen, node B1 can restart the projection screen to solve the problem of the abnormal projection screen.

[0081] The embodiments of the present application are introduced below with reference to the accompanying drawings.

[0082] Figure 2 Schematic diagram of the process of the screen projection abnormality detection method provided in this application Figure 1 ,like Figure 2 As shown, in this embodiment, the execution subject of the embodiment of the present application is a projection screen abnormality detection device, which can be integrated into an electronic device, such as a vehicle terminal, or concentrated in a system-on-chip (SOC). The projection screen abnormality detection method provided in this embodiment includes the following steps:

[0083] Step S101: Transmitting first current projection information to the projected node via at least one intermediate node. The first current projection information includes first current frame data and first verification-related information corresponding to the first current frame data. The first verification-related information includes position information corresponding to a preset number of pixels.

[0084] In this embodiment, the projection node transmits the projection information to the projection node via the intermediate node in real time. For each frame of data, the transmission process of step S101 and the verification process after step S101 are performed.

[0085] In this embodiment, the first current frame data may be frame data currently being transmitted, such as the first frame data, the second frame data, the last frame data, and the like.

[0086] The intermediate node refers to the node that transmits data between the projection node and the projection node, and the projection node refers to the node that ultimately receives the projection information and displays it on the corresponding screen based on the projection information.

[0087] In this embodiment, the nodes are divided according to the operating system (OS) installed in the SOC.

[0088] Optionally, the first verification related information also includes frame sequence number, identification to be verified and other information.

[0089] Optionally, the preset number may be set to 512, or may be set according to actual application. Meanwhile, the position information corresponding to the pixel point is based on the color channel, and the position information of different color channels may be different.

[0090] Step S102: Determine a first verification result corresponding to the first current frame data according to the position information.

[0091] In this embodiment, the data to be verified in the first current frame data can be determined based on the position information, thereby generating a first verification result corresponding to the first current frame data. The first verification result represents the verification result of the initially transmitted data.

[0092] Step S103: Receive the second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node. The second verification result is generated by the intermediate node by verifying the corresponding data to be verified based on the position information. The third verification result is generated by the projected node by verifying the corresponding data to be verified based on the position information.

[0093] In some embodiments, the second verification result is generated by the intermediate node verifying the first current frame data according to the location information.

[0094] In some embodiments, the third verification result is generated by the projected node verifying the second current frame data sent from the intermediate node based on the location information. The second current frame data is based on the first current frame data, and the second current frame data may be the same as or different from the first current frame data.

[0095] Optionally, when receiving the second verification result and the third verification result, the frame sequence number corresponding to the second verification result and the frame sequence number corresponding to the third verification result may be received simultaneously.

[0096] In step S104, if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projected screen.

[0097] In this embodiment, the first verification result can be compared with the second verification result, and the first verification result can be compared with the third verification result to determine whether there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0098] In this embodiment, after the first current frame data, several frames of frame data may need to be transmitted continuously, and the process from step S101 to step S104 is performed for each frame data to be transmitted thereafter.

[0099] Optionally, the preset number of frames can be set to 2 frames. That is, if data anomalies appear in three consecutive frames, including the first current frame data, it can be determined that there is an anomaly in the projection image. At the same time, the preset number of frames can also be set according to actual needs, such as 3 frames, 4 frames, etc., which is not limited in this embodiment.

[0100] An embodiment of the present application provides a method for detecting abnormalities in a projection screen, including: transmitting the first current projection information to the projection node through at least one intermediate node. The first current projection information includes the first current frame data and the first verification-related information corresponding to the first current frame data. The first verification-related information includes the position information corresponding to a preset number of pixel points. The first verification result corresponding to the first current frame data is determined according to the position information. The second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node are received. The second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information. The third verification result is generated by the projection node verifying the corresponding data to be verified according to the position information. If it is determined based on the first verification result, the second verification result and the third verification result that there is a data abnormality in the process of transmitting the first current frame data to the projection node, and there is also a data abnormality in the transmission process of the frame data of the preset number of frames after the first current frame data, then it is determined that there is an abnormality in the projection screen.

[0101] The projection screen anomaly detection method of the present application transmits the first verification related information and the first current frame data to the projection screen node through at least one intermediate node when transmitting each frame of data. At the same time, a first verification result is generated based on the position information corresponding to the pixel point, and the second verification result and the third verification result sent by the intermediate node are received. Therefore, based on the first verification result, the second verification result and the third verification result, it is determined whether there is a data anomaly in the process of transmitting the first current frame data to the projection screen node. If it is determined that there is a data anomaly and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, it is determined that there is an anomaly in the projection screen, thereby realizing real-time detection of the projection screen anomaly.

[0102] Figure 3 Schematic diagram of the process of the screen projection abnormality detection method provided in this application Figure 2 ,like Figure 3 As shown, the projection screen abnormality detection method provided in this embodiment is further refined on the basis of the projection screen abnormality detection method provided in the previous embodiment of this application, and the projection screen abnormality detection method provided in this embodiment includes the following steps.

[0103] Step S201: transmit the first current projection information to the projection node through at least one intermediate node.

[0104] In this embodiment, the implementation of step S201 is the same as or similar to the implementation of step S101 in the above embodiment, and will not be repeated here.

[0105] It should be noted that the position information is a position array formed by the position data of each pixel in a preset arrangement order, wherein the preset arrangement order can be the arrangement position order of the pixels or the random position arrangement order of the pixels, which is not limited in this embodiment.

[0106] Step S202: determining corresponding first verification data from the first current frame data according to the position array, wherein the first verification data is part or all of the first current frame data.

[0107] In this embodiment, since the position data corresponding to the pixel points are recorded in the position array, data corresponding to the position data can be obtained from the first current frame data based on the position data, and the corresponding data can be used as the first verification data.

[0108] Optionally, in this embodiment, if the number of intermediate nodes is one.

[0109] The second verification result is generated by the intermediate node receiving the first current projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method.

[0110] The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check. The second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and the position information.

[0111] In this embodiment, since errors may occur in data transmission, the information sent by the intermediate node is called the second current projection information. The second current projection information may be the same as the first current projection information or may be different.

[0112] Optionally, in this embodiment, if there are multiple intermediate nodes, the second verification results are divided into two types:

[0113] The first one is the same as the second verification result mentioned above, that is, after the intermediate node receives the first current projection information, it determines the corresponding second verification data from the received first current frame data based on the position information, and uses a cyclic redundancy check method to verify and generate the second verification data.

[0114] The second type is generated by verifying the received data when transmitting information between the intermediate nodes. For example, after the first intermediate node receives the first current projection information, it forwards the first current projection information and transmits the second current projection information to the second intermediate node. The second intermediate node receives the second current projection information and forwards the third current projection information to the third intermediate node. Among them, the first current projection information, the second current projection information, and the third current projection information may be the same or different.

[0115] Step S203: Using a cyclic redundancy check method to check the first check data to generate a first check result.

[0116] In this embodiment, a cyclic redundancy check (CRC) is a verification method for detecting errors in data transmission or storage. In this embodiment, the first verification data is verified by using a cyclic redundancy check method, which can better verify data integrity.

[0117] Step S204, receiving the second verification result and the third verification result corresponding to the first current screen projection information sent by the intermediate node.

[0118] In this embodiment, the implementation of step S204 is the same as or similar to the implementation of step S103 in the above embodiment, and will not be repeated here.

[0119] Step S205 : Compare the first verification result and the second verification result to generate a first comparison result.

[0120] In this embodiment, if the first verification result is the same as the second verification result, the first comparison result is the same. If the first verification result is different from the second verification result, the first comparison result is different.

[0121] Step S206: Compare the first verification result and the third verification result to generate a second comparison result.

[0122] In this embodiment, if the first verification result is the same as the third verification result, the second comparison result is the same. If the first verification result is different from the third verification result, the second comparison result is different.

[0123] Step S207: If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0124] In this embodiment, if the first comparison result is different, the second comparison result is different, or the first comparison result and the second comparison result are different, it can be determined that there is a data anomaly during the transmission of the first current frame data to the projected node. For example, there may be data corruption, data loss, etc.

[0125] Optionally, in this embodiment, if the first comparison result and / or the second comparison result are different, the abnormal problem may be stored, as follows:

[0126] If the first comparison result is different, it is determined that a data transmission anomaly occurs in the intermediate node, and information of the intermediate node where the anomaly occurs is stored.

[0127] If the second comparison result is different, it is determined that a data transmission anomaly occurs in the projected node, and the information of the projected node is stored.

[0128] In this embodiment, the information of the intermediate node or the projected node where the anomaly occurs is stored to facilitate subsequent anomaly repair processing. The stored information can include, for example, the identifier of the intermediate node, the identifier of the projected node, the time when the anomaly occurred, the content of the transmitted data, and other information.

[0129] Optionally, in this embodiment, after S207, a re-screen projection process may be performed to resolve the screen projection abnormality problem, as follows:

[0130] All the projection information is retransmitted to the projection node through at least one intermediate node. The projection information includes multiple frame data corresponding to the projection and verification related information corresponding to each frame data.

[0131] In this embodiment, all the projection information that needs to be transmitted for re-projection can be the first current projection information where the anomaly occurs and the projection information after the first current projection information, or can be the projection information after a preset number of frames of the first current projection information and the projection information after the first current projection information. This embodiment does not limit this.

[0132] The screen projection information includes each frame data corresponding to the screen projection and the verification related information corresponding to each frame data.

[0133] In order to further describe the projection screen abnormality detection method of the present application, the following will be further described with reference to the accompanying drawings. Figure 4 As shown, the entire vehicle-mounted system in this embodiment consists of two SOCs, SOCA and SOCB, one of which runs two operating systems (OSs). The two SOCs are connected via a PCIe (Peripheral Component Interconnect Express) bus for inter-SOC communication, and the two OSs communicate via shared memory. Due to system architecture limitations, as shown in the figure, communication between OS A1 and OS B1 requires OS A2 to forward data in the middle.

[0134] In this embodiment, the projection data is projected from the car computer, such as the car infotainment host's car screen, to the instrument screen of the DIM (Dashboard Integration Module). The projection link involves three nodes. Node 1 is OS B1 on SOC B or the application that initiates the projection. Node 2 is OS A2 on SOC A or the application service responsible for relocating the projection data. Node 3 is OS A1 on SOC A or the application that receives and displays the projection data.

[0135] The data flow of screen projection is from node 1 to node 2, and then node 2 to node 3.

[0136] like Figure 5 As shown in the figure, the screen projection process is as follows:

[0137] Node 1 sends screen projection information to Node 2. When Node 1 sends the first frame of data, it generates 512 random, non-repeating pixel position data and fills them into an array to generate the corresponding position array. Node 1 sends this position array as additional information along with the first frame of data to Node 2.

[0138] Node 1 sends each frame of data to node 2 in real time when projecting the screen. At the same time, it obtains the frame data that needs to be verified according to the position array of the pixel points, performs CRC verification on it to generate the first verification result, and saves the frame number and the first verification result.

[0139] After receiving the first frame data and additional information, node 2 saves the pixel position array and then sends the projection information such as the first frame data and additional information to node 3.

[0140] After receiving the frame data, node 2 transmits the frame data to node 3, obtains the frame data to be verified according to the pixel position array, performs CRC verification on it to generate the second verification result, and packages the frame sequence number and the second verification result to node 1.

[0141] After receiving the first frame data and additional information, node 3 saves the pixel position array.

[0142] After receiving the projection information, such as frame data and additional information, Node 3 obtains the frame data to be verified based on the pixel position array, performs a CRC check on it, and generates a third verification result. It then packages the frame sequence number and the third verification result and sends it to Node 2, which then forwards it to Node 1.

[0143] After receiving the second verification result from Node 2, Node 1 compares it with the first verification result saved by Node 1 and records the comparison result. After receiving the third verification result from Node 3, Node 1 compares it with the first verification result saved by Node 1 and records the comparison result. If the comparison results are different, it means that an anomaly occurred during the transmission of the projected frame data. If the verification results for three consecutive frames of data are all anomalies, the screen projection is closed and re-initiated.

[0144] In this embodiment, the additional information corresponds to the first verification related information and the second verification related information in the above embodiment, and the additional information may be the same as the first verification related information or the second verification related information.

[0145] Figure 6 This is a schematic diagram of the structure of the projection screen abnormality detection device provided by this application, as shown in Figure 6 As shown, in this embodiment, the projection screen abnormality detection device 300 can be set in an electronic device, such as a vehicle-mounted terminal, a system-on-chip (SOC), and the projection screen abnormality detection device 300 includes:

[0146] Transmission module 301 is used to transmit the first current projection information to the projected node through at least one intermediate node. The first current projection information includes the first current frame data and the first verification-related information corresponding to the first current frame data. The first verification-related information includes the position information corresponding to a preset number of pixels.

[0147] The first determining module 302 is configured to determine a first verification result corresponding to the first current frame data according to the position information.

[0148] Receiving module 303 is used to receive the second verification result and the third verification result corresponding to the first current projection information sent by the intermediate node. The second verification result is generated by the intermediate node verifying the corresponding data to be verified based on the position information. The third verification result is generated by the projected node verifying the corresponding data to be verified based on the position information.

[0149] The second determination module 304 is used to determine that there is an abnormality in the projection screen if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data.

[0150] The projection screen abnormality detection device provided in this embodiment can perform Figure 2 The technical solution of the method embodiment shown in the figure has the same implementation principle and technical effect as Figure 2 The method embodiments shown are similar and will not be described in detail here.

[0151] The projection screen abnormality detection device provided in this application is based on the projection screen abnormality detection device provided in the previous embodiment, and the projection screen abnormality detection device is further refined. The projection screen abnormality detection device 300 includes:

[0152] Optionally, in this embodiment, the position information is a position array formed by the position data of each pixel in a preset arrangement order.

[0153] The first determining module 302 is specifically configured to:

[0154] Determine corresponding first verification data from the first current frame data according to the position array. The first verification data is part or all of the first current frame data. Use a cyclic redundancy check method to verify the first verification data and generate a first verification result.

[0155] Optionally, in this embodiment, if the number of intermediate nodes is one.

[0156] The second verification result is generated by the intermediate node receiving the first current projection information, determining the corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method.

[0157] The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check. The second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and the position information.

[0158] Optionally, in this embodiment, if the second determination module 304 determines that there is a data anomaly in the process of transmitting the first current frame data to the projected node based on the first verification result, the second verification result, and the third verification result, it is specifically configured to:

[0159] The first verification result and the second verification result are compared to generate a first comparison result. The first verification result and the third verification result are compared to generate a second comparison result. If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

[0160] Optionally, in this embodiment, if the first comparison result and / or the second comparison result are different, the projection image abnormality detection device 300 further includes:

[0161] The storage module is configured to determine that a data transmission anomaly occurs at the intermediate node if the first comparison result is different, and store the information of the intermediate node with the anomaly. If the second comparison result is different, it is configured to determine that a data transmission anomaly occurs at the projected node, and store the information of the projected node.

[0162] Optionally, in this embodiment, the projection image abnormality detection device 300 further includes:

[0163] The reprojection module is used to retransmit all projection information to the projected node through at least one intermediate node. The projection information includes multiple frames of data corresponding to the projection and verification related information corresponding to each frame of data.

[0164] The projection image abnormality detection device provided in this embodiment can perform Figure 2-Figure 5 The technical solution of the method embodiment shown in the figure has the same implementation principle and technical effect as Figure 2-Figure 5 The method embodiments shown are similar and will not be described in detail here.

[0165] According to an embodiment of the present application, the present application also provides an electronic device, a computer-readable storage medium, and a computer program product.

[0166] like Figure 7 As shown, Figure 7 1 is a schematic diagram of the structure of the electronic device provided by the present application. The components, their connections and relationships, and their functions shown herein are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0167] like Figure 7As shown, the electronic device includes: a processor 401 and a memory 402. The various components are connected to each other using different buses and can be installed on a common motherboard or installed in other ways as needed. The processor can process instructions executed in the electronic device.

[0168] Memory 402 is the non-transitory computer-readable storage medium provided in this application. The memory stores instructions executable by at least one processor to cause at least one processor to execute the projection screen anomaly detection method provided in this application. The non-transitory computer-readable storage medium of this application stores computer instructions that cause a computer to execute the projection screen anomaly detection method provided in this application.

[0169] The memory 402 is a non-transient computer-readable storage medium that can be used to store non-transient software programs, non-transient computer executable programs and modules, such as the program instructions / modules corresponding to the projection screen abnormality detection method in the embodiment of the present application (for example, the attached Figure 6 The processor 401 executes the non-transient software programs, instructions, and modules stored in the memory 402 to execute various functional applications and data processing of the electronic device, thereby implementing the projection screen abnormality detection method in the above method embodiment.

[0170] In the above embodiment, it should be understood that the processor 401 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention can be directly implemented by a hardware processor or performed by a combination of hardware and software modules in the processor.

[0171] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (NVM), such as at least one disk memory.

[0172] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Buses can be classified into address buses, data buses, and control buses. For ease of illustration, the buses in the drawings of this application are not limited to just one bus or just one type of bus.

[0173] At the same time, an embodiment of the present application also provides a computer product. When the instructions in the computer product are executed by the processor of an electronic device, the electronic device can execute the projection screen abnormality detection method of the above embodiment.

[0174] An embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above-mentioned method is implemented.

[0175] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile memory device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer.

[0176] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be an integral part of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0177] The division of units is merely a logical functional division; actual implementations may employ alternative divisions, such as combining or integrating multiple units or components into another system, or omitting or disabling certain features. Furthermore, any direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units, either through an interface, electrical, mechanical, or other means.

[0178] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0179] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0180] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program code.

[0181] Those skilled in the art will appreciate that all or part of the steps in the above-described method embodiments can be implemented using hardware associated with program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0182] Finally, it should be noted that those skilled in the art will readily identify other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses, or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art not disclosed herein. The present invention is not limited to the precise structure described above and illustrated in the accompanying drawings, and various modifications and variations may be made without departing from the scope thereof. The scope of the present invention is limited solely by the appended claims.

Claims

1. A method for detecting abnormalities in projection images, wherein the vehicle system includes multiple system-on-chips (SOCs), the SOCs are equipped with multiple operating systems, and each operating system serves as a node for data processing and data transmission in the SOCs, characterized in that: The method is applied to the SOC, and the method includes: Transmitting first current projection information to the projected node through at least one intermediate node; the first current projection information includes first current frame data and first verification related information corresponding to the first current frame data; the first verification related information includes position information corresponding to a preset number of pixel points; Determine a first verification result corresponding to the first current frame data according to the position information; Receive a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information; If it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data, then it is determined that there is an anomaly in the projected screen.

2. The method according to claim 1, characterized in that The position information is a position array formed by the position data of each pixel in a preset arrangement order; The determining, according to the position information, a first verification result corresponding to the first current frame data includes: Determining corresponding first verification data from the first current frame data according to the position array; the first verification data is part or all of the first current frame data; The first verification data is verified using a cyclic redundancy check method to generate a first verification result.

3. The method according to claim 2, characterized in that If the number of intermediate nodes is one; The second verification result is generated by the intermediate node, after receiving the first current projection information, determining corresponding second verification data from the received first current frame data based on the position information, and verifying the second verification data using a cyclic redundancy check method; The third verification result is generated by the projected node receiving the second current projection information sent by the intermediate node, determining the corresponding third verification data from the received second current frame data based on the position information, and verifying the third verification data using a cyclic redundancy check method; the second current projection information is based on the first current projection information, and the second current projection information includes the second current frame data and position information.

4. The method according to claim 1, wherein If it is determined based on the first verification result, the second verification result, and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, the method includes: Comparing the first verification result with the second verification result to generate a first comparison result; Comparing the first verification result and the third verification result to generate a second comparison result; If the first comparison result and / or the second comparison result are different, it is determined that there is a data anomaly in the process of transmitting the first current frame data to the projected node.

5. The method according to claim 4, characterized in that If the first comparison result and / or the second comparison result are different, the method further includes: If the first comparison result is different, it is determined that a data transmission anomaly occurs at the intermediate node, and information of the intermediate node where the anomaly occurs is stored; If the second comparison result is different, it is determined that a data transmission anomaly occurs in the projected node, and the information of the projected node is stored.

6. The method according to any one of claims 1 to 5, characterized in that After determining that there is an abnormality in the screen projection, the method further includes: All screen projection information is retransmitted to the screen-projected node through at least one intermediate node; the screen projection information includes multiple frame data corresponding to the screen projection and verification-related information corresponding to each frame data.

7. A device for detecting abnormalities in projection images, wherein the vehicle system includes multiple system-on-chips (SOCs), the SOCs are equipped with multiple operating systems, and each operating system serves as a node for data processing and data transmission in the SOCs, characterized in that: The device is located in the SOC, and the device includes: A transmission module, configured to transmit first current projection information to a projected node via at least one intermediate node; the first current projection information comprising first current frame data and first verification related information corresponding to the first current frame data; the first verification related information comprising position information corresponding to a preset number of pixel points; a first determining module, configured to determine a first verification result corresponding to the first current frame data according to the position information; A receiving module is used to receive a second verification result and a third verification result corresponding to the first current projection information sent by the intermediate node; the second verification result is generated by the intermediate node verifying the corresponding data to be verified according to the position information; the third verification result is generated by the projected node verifying the corresponding data to be verified according to the position information; The second determination module is used to determine that there is an abnormality in the projection screen if it is determined based on the first verification result, the second verification result and the third verification result that there is a data anomaly in the process of transmitting the first current frame data to the projected node, and there is also a data anomaly in the transmission process of the frame data of a preset number of frames after the first current frame data.

8. An electronic device, characterized in that: include: memory and processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory to implement the projection screen abnormality detection method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer execution instructions, which, when executed by a processor, are used to implement the projection screen abnormality detection method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that It includes a computer program, which, when executed by a processor, implements the projection screen abnormality detection method described in any one of claims 1 to 6.

Images