Panoramic image system transmission anomaly simulation method, system and device and storage medium

Abstract

According to the panoramic image system transmission abnormity simulation method, system and device and the storage medium, fault injection operation is executed on an original video stream output by a video source by means of a fault injection hardware circuit, and it is ensured that the fault injection operation can be accurately matched with a to-be-simulated video transmission abnormity scene; the video stream after the fault injection operation is transmitted and injected into the panoramic image system through a multi-format interface in the hardware circuit, the multi-format interface can adapt to different connection requirements of a video source and the panoramic image system, and it is guaranteed that the fault video stream is stably and accurately input into the panoramic image system; meanwhile, the operation state data, the image display effect data and the video stream parameter change after the panoramic image system receives the fault video stream are captured and recorded in real time, so that the operation performance and the response condition of the panoramic image system in a video transmission abnormal scene can be comprehensively mastered; and targeted simulation of video transmission abnormity of the panoramic image system is realized in an HIL test environment.

Description

Technical Field

[0001] This application relates to the field of hardware-in-the-loop testing, specifically to a method, system, device, and storage medium for simulating transmission anomalies in a panoramic imaging system. Background Technology

[0002] As a key component of intelligent driving assistance systems, the reliability and stability of panoramic imaging systems directly impact driving safety and user experience. In the development of intelligent driving, hardware-in-the-loop (HIL) testing technology is crucial for vehicle development and testing. Video injection in HIL testing is an important means of simulating real-world scenarios, testing the controller's response to different environmental and road conditions by injecting various video streams into the panoramic imaging system.

[0003] Among related technologies, there is already a HIL testing technology for panoramic imaging systems, which can achieve basic normal video stream injection.

[0004] However, the simulation of video transmission anomalies in panoramic imaging systems under the HIL test environment still has insufficient simulation capabilities for real and complex transmission environments. It cannot meet the growing testing needs of intelligent driving systems and cannot ensure that the reliability of panoramic imaging systems in near-real and complex transmission environments is fully tested, thus affecting the overall verification effect of intelligent driving assistance systems. Summary of the Invention

[0005] This application provides a method, system, device, and storage medium for simulating transmission anomalies in a panoramic imaging system. It can solve the technical problems in related technologies where it is difficult to ensure the simulation capability of panoramic imaging systems under real and complex transmission environments, and it is difficult to ensure that the reliability of panoramic imaging systems under near-real and complex transmission environments is fully tested, thereby affecting the overall verification effect of intelligent driving assistance systems.

[0006] In a first aspect, embodiments of this application provide a method for simulating transmission anomalies in a panoramic imaging system, the method comprising: Based on the acquisition of preset video transmission anomaly simulation parameters, a fault injection operation is performed on the original video stream output by the video source through the fault injection circuit in the hardware circuit. Based on the video stream after the fault injection operation is performed, it is injected into the panoramic imaging system through a multi-format interface in the hardware circuit. The real-time monitoring panoramic imaging system receives video stream data after a fault injection operation, including operational status data, image display effect data, and changes in video stream parameters.

[0007] In conjunction with the first aspect, in one embodiment, performing a fault injection operation on the original video stream output from the video source via a fault injection circuit in the hardware circuit includes: By selectively blocking part of the data packet transmission path of the original video stream through a switching circuit, packet loss or data interruption can be simulated.

[0008] In conjunction with the first aspect, in one embodiment, performing a fault injection operation on the original video stream output from the video source via a fault injection circuit in the hardware circuit includes: The timestamps of data packets in the original video stream are modified by the signal delay module to simulate transmission delay or jitter.

[0009] In conjunction with the first aspect, in one embodiment, performing a fault injection operation on the original video stream output from the video source via a fault injection circuit in the hardware circuit includes: The data tampering unit modifies the content of data packets in the original video stream or adjusts the transmission order of data packets to simulate packet errors or data corruption.

[0010] In conjunction with the first aspect, in one implementation, the operating status data includes the CPU utilization rate, memory usage rate, and video stream data processing time of the panoramic imaging system. The image display effect data includes whether the panoramic imaging system output images have missing, blurry, flickering, or display asynchrony phenomena, as well as whether abnormal error messages appear. The changes in video stream parameters include fluctuations in frame rate, resolution, number of data packets, and data packet integrity of the video stream after fault injection.

[0011] In conjunction with the first aspect, in one embodiment, before performing a fault injection operation on the original video stream output by the video source through a fault injection circuit in the hardware circuit based on obtaining preset video transmission anomaly simulation parameters, the method further includes: Based on the parameterized results of common video transmission anomalies, the preset video transmission anomaly simulation parameters for subsequent fault injection operations are determined. If you choose to configure a single type of video transmission anomaly, select one anomaly type from signal anomaly, transmission anomaly, and processing anomaly, and match the parameters corresponding to that anomaly type. If you choose to configure multiple types of video composite anomalies, select at least two anomaly types from signal anomalies, transmission anomalies, and processing anomalies, and match the corresponding parameters for each selected anomaly type.

[0012] In conjunction with the first aspect, in one implementation, the parameterization corresponding to the signal anomaly includes the duration of signal loss, the intensity of signal distortion, and the duration of signal delay.

[0013] In conjunction with the first aspect, in one implementation, the parameterization corresponding to the transmission anomaly includes packet loss rate, jitter amplitude, packet error type, and data corruption degree.

[0014] In conjunction with the first aspect, in one implementation, the parameterization corresponding to the processing anomaly includes data interruption frequency, data packet out-of-order ratio, and data processing failure triggering conditions.

[0015] In conjunction with the first aspect, in one embodiment, after the real-time monitoring panoramic imaging system receives the operating status data, image display effect data, and video stream parameter changes of the video stream after the fault injection operation, it further includes: Based on real-time monitored operating status data, image display effect data, and video stream parameter changes, the error handling mechanism of the panoramic imaging system for video transmission anomalies is analyzed, and the system's ability to identify, correct errors, and maintain image display quality in abnormal scenarios is evaluated.

[0016] Secondly, embodiments of this application provide a panoramic image system transmission anomaly simulation system, the panoramic image system transmission anomaly simulation system comprising: The parameter acquisition module is used to acquire preset video transmission anomaly simulation parameters; A fault injection module is connected to the parameter acquisition module. The fault injection module includes a hardware circuit and a fault injection circuit disposed in the hardware circuit. The fault injection circuit is used to perform a fault injection operation on the original video stream output by the video source based on the analog parameters output by the parameter acquisition module. A video injection module is connected to the fault injection module. The video injection module is used to transmit the video stream after the fault injection operation is performed by the fault injection module to the panoramic imaging system. The monitoring module connects to an external panoramic imaging system and monitors in real time the system's operational status data, image display effect data, and changes in video stream parameters after receiving a faulty video stream. In conjunction with the second aspect, in one embodiment, the fault injection circuit includes a switching circuit for selectively blocking the data packet transmission path of a portion of the original video stream to simulate packet loss or data interruption.

[0017] In conjunction with the second aspect, in one embodiment, the fault injection circuit includes a signal delay module for modifying the timestamps of data packets in the original video stream to simulate transmission delay or jitter.

[0018] Thirdly, embodiments of this application provide a panoramic imaging system transmission anomaly simulation device. The panoramic imaging system transmission anomaly simulation device includes a processor, a memory, and a panoramic imaging system transmission anomaly simulation program stored in the memory and executable by the processor. When the panoramic imaging system transmission anomaly simulation program is executed by the processor, it implements the steps of the panoramic imaging system transmission anomaly simulation method as described in the above embodiments.

[0019] Fourthly, embodiments of this application provide a computer-readable storage medium storing a panoramic imaging system transmission anomaly simulation program, wherein when the panoramic imaging system transmission anomaly simulation program is executed by a processor, it implements the steps of the panoramic imaging system transmission anomaly simulation method as described in the above embodiments.

[0020] The beneficial effects of the technical solutions provided in this application include: By acquiring preset video transmission anomaly simulation parameters, and using these parameters as a basis, a fault injection operation is performed on the original video stream output by the video source using a fault injection circuit in the hardware circuit. This ensures that the fault injection operation can accurately match the video transmission anomaly scenario to be simulated. The video stream after the fault injection operation is transmitted and injected into the panoramic imaging system through a multi-format interface in the hardware circuit. The multi-format interface can adapt to different connection requirements between the video source and the panoramic imaging system, ensuring that the fault video stream is stably and accurately input into the panoramic imaging system. At the same time, the operating status data, image display effect data, and video stream parameter changes of the panoramic imaging system after receiving the fault video stream are captured and recorded in real time. This allows for a comprehensive understanding of the panoramic imaging system's operating performance and response under video transmission anomaly scenarios, thereby enabling targeted simulation of video transmission anomalies in the panoramic imaging system under the HIL test environment. Attached Figure Description

[0021] Figure 1 This is a flowchart illustrating an embodiment of the panoramic image system transmission anomaly simulation method of this application; Figure 2 This is a schematic diagram of the architecture of an embodiment of the panoramic image system transmission anomaly simulation system of this application; Figure 3 This is a schematic diagram of the hardware structure of the panoramic imaging system transmission anomaly simulation device involved in the embodiments of this application. Detailed Implementation

[0022] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0023] It's important to understand that the panoramic imaging system, as a key component of intelligent driving assistance systems, directly impacts driving safety and user experience in terms of reliability and stability. In the development of intelligent driving, hardware-in-the-loop (HIL) testing technology is crucial for vehicle development and testing. Video injection in HIL testing is an important means of simulating real-world scenarios, testing the controller's response to different environmental and road conditions by injecting various video streams into the panoramic imaging system.

[0024] Among them, HIL testing technology for panoramic imaging systems already exists, which can achieve basic normal video stream injection.

[0025] However, the simulation of video transmission anomalies in panoramic imaging systems under the HIL test environment still has insufficient simulation capabilities for real and complex transmission environments. It cannot meet the growing testing needs of intelligent driving systems and cannot ensure that the reliability of panoramic imaging systems in near-real and complex transmission environments is fully tested, thus affecting the overall verification effect of intelligent driving assistance systems.

[0026] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0027] In a first aspect, embodiments of this application provide a method for simulating transmission anomalies in a panoramic imaging system.

[0028] In one embodiment, reference is made to Figure 1 , Figure 1 This is a flowchart illustrating the first embodiment of the panoramic image system transmission anomaly simulation method of this application. Figure 1 As shown, the method for simulating transmission anomalies in a panoramic image system includes: S100: Based on the acquisition of preset video transmission anomaly simulation parameters, the fault injection operation is performed on the original video stream output by the video source through the fault injection circuit in the hardware circuit. S200: Based on the video stream after the fault injection operation is performed, it is injected into the panoramic imaging system through a multi-format interface in the hardware circuit. S300: Real-time monitoring panoramic imaging system receives video stream data, image display effect data, and changes in video stream parameters after a fault injection operation.

[0029] In this embodiment, preset video transmission anomaly simulation parameters are obtained. Based on these parameters, a fault injection operation is performed on the original video stream output by the video source using a fault injection circuit in the hardware circuit. This ensures that the fault injection operation can accurately match the simulated video transmission anomaly scenario. The video stream after the fault injection operation is transmitted and injected into the panoramic imaging system through a multi-format interface in the hardware circuit. The multi-format interface can adapt to different connection requirements between the video source and the panoramic imaging system, ensuring that the fault video stream is stably and accurately input into the panoramic imaging system. Simultaneously, the panoramic imaging system receives the fault video stream, and its operating status data, image display effect data, and video stream parameters. Real-time capture and recording of data changes allows for a comprehensive understanding of the panoramic imaging system's performance and response under abnormal video transmission scenarios. This enables targeted simulation of video transmission anomalies in the panoramic imaging system within the HIL testing environment, effectively addressing the shortcomings of existing HIL testing technologies in simulating such anomalies. This allows the panoramic imaging system to be tested under near-realistic and complex transmission environments, meeting the growing testing demands of intelligent driving systems. It provides effective support for verifying the reliability and stability of the panoramic imaging system's performance, further ensuring the overall reliability verification of the intelligent driving assistance system and safeguarding driving safety and user experience.

[0030] Furthermore, in one embodiment, S100 includes the following steps: S101: Selectively blocks part of the data packet transmission path of the original video stream through a switching circuit to simulate packet loss or data interruption.

[0031] In this embodiment, when performing fault injection operations on the original video stream output from the video source, the switching circuit's on / off control function is used to selectively block the data packet transmission path of part of the original video stream. This simulates packet loss or data interruption scenarios caused by network congestion, transmission line failures, etc., during real vehicle video transmission. This constructs an accurate abnormal transmission environment for the performance testing of the panoramic imaging system under abnormal transmission scenarios such as packet loss or data interruption. This makes the hardware-in-the-loop testing of the panoramic imaging system's ability to cope with such transmission anomalies more closely aligned with actual application conditions, so as to comprehensively evaluate the reliability and stability of the panoramic imaging system under such transmission anomalies, thereby providing assurance for the driving safety and user experience of the intelligent driving assistance system.

[0032] Furthermore, in one embodiment, S100 includes the following steps: S102: Modify the timestamps of data packets in the original video stream using the signal delay module to simulate transmission delay or jitter.

[0033] In this embodiment, when performing a fault injection operation on the original video stream output by the video source, the timestamp of the data packets in the original video stream is modified by the signal delay module. This simulates the transmission delay caused by excessively long transmission lines and network congestion during real vehicle video transmission, as well as the transmission jitter caused by signal interference and other factors. This constructs an abnormal transmission environment that closely matches actual working conditions for hardware-in-the-loop testing of the panoramic imaging system under abnormal scenarios such as transmission delay or jitter. This makes the testing of the panoramic imaging system's performance such as image display synchronization and stability under such abnormal conditions more accurate, thereby providing support for comprehensively verifying the performance reliability of the panoramic imaging system and ensuring the driving safety and user experience of the intelligent driving assistance system.

[0034] Furthermore, in one embodiment, S100 includes the following steps: S103: Modify the content of data packets in the original video stream or adjust the transmission order of data packets through the data tampering unit to simulate packet errors or data corruption.

[0035] In this embodiment, when performing a fault injection operation on the original video stream output from the video source, the data tampering unit is used to modify the content of data packets in the original video stream or adjust the transmission order of data packets. This simulates packet errors caused by signal interference, transmission line failures, etc., and data corruption caused by abnormal data transmission links during real vehicle video transmission. This constructs an abnormal transmission environment that closely resembles actual application conditions for hardware-in-the-loop testing of the panoramic imaging system under transmission anomaly scenarios such as packet errors or data corruption. This makes the testing of the panoramic imaging system's performance under such anomalies, such as image display errors and quality degradation, more accurate. In turn, it provides support for comprehensively verifying the panoramic imaging system's ability to cope with such transmission anomalies and ensuring the driving safety and user experience of the intelligent driving assistance system.

[0036] Furthermore, in one embodiment, in S300, The operational status data includes the CPU utilization rate, memory usage rate, and video stream data processing time of the panoramic imaging system. The image display effect data includes whether the panoramic imaging system output images have missing, blurry, flickering, or display asynchrony phenomena, as well as whether abnormal error messages appear. The changes in video stream parameters include fluctuations in frame rate, resolution, number of data packets, and data packet integrity of the video stream after fault injection.

[0037] In this embodiment, when monitoring the video stream after the fault injection operation of the panoramic imaging system in real time, the collected operational status data specifically includes the CPU utilization rate, memory usage rate, and video stream data processing time of the panoramic imaging system. These data can intuitively reflect the system's computational load and data processing efficiency under abnormal video transmission scenarios, providing a basis for evaluating the system's hardware resource adaptability. The collected image display effect data specifically includes whether the panoramic imaging system's output image has missing, blurred, flickering, or display asynchrony phenomena, as well as whether abnormal error messages appear. This type of data can directly reflect the impact of abnormal video transmission on the visualization of the panoramic image and is the core basis for judging the system's visual response to abnormalities. The collected video stream parameter changes specifically include the fluctuations in frame rate, resolution, number of data packets, and data packet integrity of the video stream after fault injection. By capturing these parameter changes, the degree of impact of the fault injection operation on the video stream itself can be accurately analyzed, and then correlated with the processing performance of the panoramic imaging system. This provides comprehensive data support for subsequent system performance evaluation and abnormal handling mechanism analysis, ensuring the accuracy and completeness of hardware-in-the-loop testing in verifying the panoramic imaging system's ability to respond to transmission abnormalities.

[0038] Furthermore, in one embodiment, before S100, there is S000, which includes the following steps: S001: Based on the parameterized results of common video transmission anomalies, determine the preset video transmission anomaly simulation parameters for subsequent fault injection operations; S002: If you choose to configure a single type of video transmission anomaly, select one anomaly type from signal anomaly, transmission anomaly, and processing anomaly, and match the parameters corresponding to that anomaly type. S003: If multiple types of video composite anomalies are selected, at least two anomaly types are selected from signal anomalies, transmission anomalies, and processing anomalies, and corresponding parameters are matched for each selected anomaly type.

[0039] In this embodiment, before performing the fault injection operation on the original video stream output by the video source, the preset video transmission anomaly simulation parameters are determined and configured. By classifying and parameterizing common video transmission anomalies, the preset video transmission anomaly simulation parameters required for subsequent fault injection operations are determined based on the parameterization results, providing a parameter basis for the accurate execution of the fault injection operation. If the test requirement is to simulate a single type of video transmission anomaly, one anomaly type is selected from signal anomalies, transmission anomalies, and processing anomalies, and corresponding parameters are matched for the selected anomaly type to ensure the pertinence of the simulation of a single anomaly scenario. If the test requirement is to simulate multiple types of composite video anomalies, at least two anomaly types are selected from signal anomalies, transmission anomalies, and processing anomalies, and corresponding parameters are matched for each selected anomaly type to adapt to the simulation requirements of composite anomaly scenarios, thereby achieving flexible coverage of different video transmission anomaly scenarios and ensuring that subsequent fault injection operations can fit various real vehicle transmission anomaly conditions.

[0040] Furthermore, in one embodiment, the parameterization corresponding to the signal anomaly includes the duration of signal loss, the intensity of signal distortion, and the duration of signal delay.

[0041] In this embodiment, the parameterization corresponding to signal anomalies includes signal loss duration, signal distortion intensity, and signal delay duration. The signal loss duration characterizes the specific duration of signal interruption, the signal distortion intensity quantifies the degree of signal distortion, and the signal delay duration defines the time interval of signal transmission lag. By clarifying and refining these three types of parameters, the core characteristics of signal anomalies in different scenarios can be accurately captured. This provides reliable parameter support for subsequent fault injection operations based on preset parameters and for reproducing video transmission problems caused by signal anomalies in real vehicles. It ensures the accuracy and effectiveness of simulating signal anomaly-type transmission faults in hardware-in-the-loop testing.

[0042] Furthermore, in one embodiment, the parameterization corresponding to the transmission anomaly includes packet loss rate, jitter amplitude, packet error type, and data corruption degree.

[0043] In this embodiment, the parameterization corresponding to transmission anomalies includes packet loss rate, jitter amplitude, error packet type, and data corruption degree. Packet loss rate characterizes the proportion of data packets lost during video transmission, adapting to the data packet loss simulation needs in scenarios such as network congestion. Jitter amplitude reflects the fluctuation range of video signal transmission delay, providing a quantitative basis for simulating jitter phenomena in signal interference scenarios. Error packet type covers specific error forms such as data content errors and data packet sequence errors, accurately reproducing the error state of data packets in the transmission link. Data corruption degree describes the extent of video data corruption, such as the number of lost bytes and the proportion of corrupted areas, meticulously simulating video data corruption caused by data transmission link anomalies. By clearly defining and parameterizing these four types of parameters, the core characteristics of transmission anomalies can be comprehensively covered, providing support for subsequent precise fault injection operations based on preset parameters, ensuring the comprehensiveness and realism of the transmission anomaly scenario simulation in hardware-in-the-loop testing.

[0044] Furthermore, in one embodiment, the parameterization corresponding to the processing anomaly includes data interruption frequency, data packet out-of-order ratio, and data processing failure triggering conditions.

[0045] In this embodiment, the parameterization corresponding to the handling anomaly includes data interruption frequency, data packet out-of-order ratio, and data processing failure triggering conditions. Data interruption frequency quantifies the number of data transmission interruptions per unit time, adapting to data interruption simulation requirements under scenarios such as transmission line failures. Data packet out-of-order ratio characterizes the proportion of out-of-order data packets to the total data packets, accurately reproducing the abnormal state of disordered data packet order in the transmission link. Data processing failure triggering conditions define specific scenarios that trigger the failure of the panoramic imaging system's data processing function, such as a sustained high data interruption frequency or a high out-of-order ratio, providing a clear basis for simulating system-level processing failure scenarios. By parameterizing these three types of parameters, the core characteristics of handling anomalies can be comprehensively covered, providing support for subsequent precise fault injection operations based on preset parameters, ensuring the comprehensiveness and realism of the simulation of handling anomaly scenarios in hardware-in-the-loop testing.

[0046] Furthermore, in one embodiment, after S300, the following steps are included: S400: Based on real-time monitored operating status data, image display effect data, and changes in video stream parameters, analyze the error handling mechanism of the panoramic imaging system for abnormal video transmission, and evaluate the panoramic imaging system's ability to identify, correct errors, and maintain image display quality in abnormal scenarios.

[0047] In this embodiment, after real-time monitoring of the panoramic imaging system's operating status data, image display effect data, and video stream parameter changes following the receipt of the video stream after the fault injection operation, the error handling mechanism of the panoramic imaging system in response to video transmission anomalies is analyzed based on the aforementioned real-time monitored operating status data (such as CPU utilization, memory usage, and video stream data processing time), image display effect data (such as whether the output image is missing, blurry, flickering, out of sync, or whether abnormal error messages appear), and video stream parameter changes (such as fluctuations in frame rate, resolution, number of data packets, and data packet integrity). Simultaneously, the anomaly recognition capability, error repair capability, and image display quality maintenance capability of the panoramic imaging system under this abnormal scenario are evaluated, providing a basis for comprehensively judging the performance of the panoramic imaging system under video transmission anomalies.

[0048] The following is a complete description of the panoramic imaging system transmission anomaly simulation method provided in the embodiments of this application: Under the HIL test environment, various complex fault scenarios in the video transmission process of the panoramic imaging system are simulated to ensure the comprehensiveness and authenticity of the test, improve the accuracy and effectiveness of the test, and fully verify the performance of the panoramic imaging system under different video transmission anomaly conditions.

[0049] I. Definition and Scenario Correlation of Video Transmission Anomalies Anomaly types and specific manifestations: Packet loss: Some data packets are lost during video data transmission, resulting in missing or incomplete images in panoramic video; the packet loss rate increases significantly in network congestion scenarios, which can easily cause frequent video stuttering and missing frames; Delay: The transmission time of the video signal from the sending end to the receiving end exceeds the normal range, causing the image display to be out of sync with the actual scene, affecting the driver's judgment of the surrounding environment; scenarios such as excessively long transmission lines and network congestion are prone to causing delays, and transmission line failures may lead to long delays. Jitter: The video signal transmission delay time fluctuates unstablely, causing image flickering and instability; jitter is easily triggered in signal interference scenarios, often accompanied by packet errors, resulting in image distortion. Packet errors: Errors in data content or packet order during data packet transmission can cause incorrect image display; signal interference and transmission link abnormalities can also cause packet errors. Data corruption: Some video data is corrupted during transmission, directly affecting image quality; transmission line failures, signal interference, and other scenarios may cause data corruption, which may lead to data interruption in severe cases.

[0050] II. Classification and Definition of Test Data Test data based on the fault injection model includes three main categories, and the definitions and uses of each type of data are as follows: 1. Simulated fault parameter data: covering five core parameters, including packet loss rate, latency, jitter amplitude, packet error type, and data corruption degree, which is the key to accurately simulating video transmission anomalies; Parameter definitions: Packet loss rate: The proportion of data packets lost during video transmission, used to simulate data packet loss in scenarios such as network congestion; Delay time: The transmission delay of the video signal from the injection point to the receiving end of the panoramic imaging system, used to simulate the delay in scenarios such as excessively long transmission lines and busy networks; Jitter amplitude: The range of fluctuation in video signal transmission delay time, used to simulate jitter in scenarios such as signal interference; Error types: These include specific error formats such as data content errors and data packet sequence errors, used to accurately reproduce different types of error scenarios; Data corruption level: describes the extent to which video data is corrupted (such as the number of bytes lost or the range of corrupted areas), used to simulate data corruption scenarios of different severity. 2. Video stream data It includes two categories: normal video data and video data with overlaid fault simulation. Normal video data: used as basic reference data to compare changes in the video stream before and after fault injection; Video data superimposed during fault simulation: Based on the normal video stream, the data obtained after performing fault injection processing according to preset fault parameters (such as packet loss rate, delay time, etc.) is used to test the panoramic imaging system's ability to process video streams under different fault scenarios. 3. Panoramic imaging system feedback data This includes system operating status data and image display effect data, used to evaluate the system's performance and response effectiveness in fault scenarios; System operating status data, such as CPU utilization, memory usage, and video stream data processing time, are used to quantitatively evaluate the system's computational load and data processing efficiency under fault conditions. Image display effect data: such as whether the output image is missing, blurry, flickering, or out of sync, and whether there are any abnormal error messages, etc., to intuitively judge the system's handling effect on video transmission anomalies.

[0051] III. Complete Testing Process The testing process consists of four core steps, each closely linked to ensure the integrity of fault simulation, data acquisition, and performance evaluation: Step 1: Fault Injection Model Setup Phase Testers use the user interface software to set fault parameters such as packet loss rate, latency, and jitter amplitude according to test requirements, and select simulation strategies for single faults or combinations of multiple faults (such as setting a high packet loss rate + a certain latency when testing network congestion, and setting jitter amplitude + error packet type when simulating signal interference). The fault injection control algorithm generates control signals for driving the hardware circuit in real time based on the set parameters. The hardware circuit design uses FPGA as the core processing unit, and is equipped with multi-format video interfaces (to adapt to the connection between video sources and panoramic imaging systems) and fault injection circuits (to perform fault injection operations) to ensure that video stream transmission and fault injection functions are realized at the hardware level. Step 2: Video Stream Injection The fault injection circuit in the hardware circuit performs fault injection operation on the original video stream output by the video source under the action of the control signal: it selectively blocks the transmission path of some video data packets through the switching circuit to realize packet loss or data interruption simulation; it modifies the timestamp of the data packets through the signal processing module to realize delay or jitter simulation; the video stream after fault injection is accurately transmitted to the panoramic imaging system through a multi-format video interface (adapted to different transmission protocols); Step 3: Data Monitoring Phase The video stream monitoring algorithm records parameters such as frame rate, resolution, and number of data packets of the input / output video stream in real time, and analyzes the changes in the video stream before and after fault injection; Simultaneously monitor the operation status of the panoramic imaging system, record data such as CPU usage and memory consumption; closely observe the image display effect, check for problems such as missing images, blurring, flickering, and desynchronization, and record in detail the occurrence time, duration, and specific manifestations of abnormal phenomena; Step 4: Data Analysis and Report Generation Stage The data analysis algorithm performs in-depth processing on the monitored video stream parameters, system operating status data, and image display effect data; combined with preset evaluation indicators (such as system resource usage thresholds, image display normal judgment criteria, etc.), it evaluates the performance of the panoramic imaging system under abnormal video transmission conditions. The report generation algorithm generates detailed test reports, covering fault simulation parameters, video stream status changes, and panoramic imaging system response (such as whether image anomalies occur or whether the system reports errors), providing a comprehensive and accurate basis for system performance evaluation.

[0052] In summary, this method can comprehensively and accurately simulate various video transmission anomalies during the HIL video injection process, providing a complex transmission environment close to that of a real vehicle for panoramic imaging system testing, avoiding test deviations caused by a single simulation scenario. The fault simulation and testing process designed specifically for the functional characteristics of the panoramic imaging system can effectively test the system's performance stability under abnormal video transmission conditions, accurately expose potential system problems, and enhance the reference value of test results. By testing the system's fault handling capabilities, potential hardware and software defects can be detected in advance (such as processing delays caused by insufficient hardware resources and vulnerabilities in the software algorithm's packet loss repair capabilities), providing data support for optimizing system design and improving the reliability and stability of the panoramic imaging system, thereby ensuring driving safety and user experience of the intelligent driving assistance system.

[0053] Secondly, embodiments of this application also provide a panoramic image system transmission anomaly simulation system.

[0054] In one embodiment, reference is made to Figure 2 , Figure 2 This is a functional module diagram of an embodiment of the panoramic image system transmission anomaly simulation system of this application. Figure 2 As shown, the panoramic imaging system transmission anomaly simulation system includes: a parameter acquisition module, which is used to acquire preset video transmission anomaly simulation parameters; a fault injection module, which is connected to the parameter acquisition module, the fault injection module including hardware circuitry and a fault injection circuit disposed in the hardware circuitry, the fault injection circuit being used to perform fault injection operation on the original video stream output by the video source according to the simulation parameters output by the parameter acquisition module; a video injection module, which is connected to the fault injection module, the video injection module being used to transmit the video stream after the fault injection operation is performed by the fault injection module to the panoramic imaging system; and a monitoring module, which is used to connect to an external panoramic imaging system and to monitor in real time the operating status data, image display effect data, and video stream parameter changes of the panoramic imaging system after receiving the fault video stream.

[0055] In this embodiment, the fault injection module is connected to the parameter acquisition module. The fault injection module includes hardware circuitry and a fault injection circuit within the hardware circuitry. The fault injection circuitry is used to perform a fault injection operation on the original video stream output by the video source based on the video transmission anomaly simulation parameters output by the parameter acquisition module. The video injection module is connected to the fault injection module and is used to transmit the video stream after the fault injection operation to the panoramic imaging system, thereby achieving stable input of the faulty video stream to the panoramic imaging system. The monitoring module is used to connect to an external panoramic imaging system and is used to monitor in real time the operating status data, image display effect data, and changes in video stream parameters of the panoramic imaging system after receiving the faulty video stream. The operating status data includes panoramic... The system monitors the CPU utilization, memory usage, and video stream data processing time of the imaging system. Image display effect data includes whether the panoramic imaging system outputs images with missing parts, blurriness, flickering, or display asynchrony, and whether abnormal error messages appear. Video stream parameter changes include fluctuations in frame rate, resolution, number of data packets, and data packet integrity after fault injection. Through the collaborative work of each module, accurate simulation and comprehensive monitoring of video transmission anomalies in the panoramic imaging system can be achieved in a hardware-in-the-loop testing environment. This ensures that the performance verification of the panoramic imaging system under abnormal video transmission scenarios is more in line with actual application conditions, meets the accuracy and effectiveness requirements of intelligent driving systems for testing panoramic imaging systems, and provides support for ensuring the reliability and stability of the panoramic imaging system's performance.

[0056] Furthermore, in one embodiment, the fault injection circuit includes a switching circuit for selectively blocking the data packet transmission path of a portion of the original video stream to simulate packet loss or data interruption.

[0057] In this embodiment, the switching circuit is adapted to the original video stream transmission path output by the video source. Under the control of preset video transmission anomaly simulation parameters (such as packet loss rate and data interruption frequency), it selectively blocks part of the data packet transmission path of the original video stream. This simulates data packet loss caused by network congestion or data interruption caused by transmission line failure during real vehicle video transmission. It provides accurate fault simulation conditions for hardware-in-the-loop testing of the panoramic imaging system under transmission anomaly scenarios such as packet loss or data interruption, ensuring the consistency between the fault simulation scenario and the actual transmission conditions of the real vehicle. This provides reliable fault input support for verifying the performance of the panoramic imaging system under such transmission anomalies.

[0058] Furthermore, in one embodiment, the fault injection circuit includes a signal delay module, which is used to modify the timestamps of data packets in the original video stream to simulate transmission delay or jitter.

[0059] In this embodiment, the signal delay module is adapted to the data packet processing link of the original video stream. It is used to modify the timestamp of the data packets in the original video stream according to preset video transmission anomaly simulation parameters (such as delay time and jitter amplitude). This simulates the transmission delay caused by excessively long transmission lines and network congestion during the transmission of real vehicle video, as well as the transmission jitter caused by signal interference. This provides fault input that fits the actual working conditions for the hardware-in-the-loop testing of the panoramic imaging system under abnormal scenarios such as transmission delay or jitter, ensuring the accuracy and authenticity of the fault simulation. This provides reliable support for comprehensively verifying the performance of the panoramic imaging system in terms of image display synchronization and stability under such anomalies.

[0060] The functions of each module in the above-mentioned panoramic image system transmission anomaly simulation system correspond to the steps in the above-mentioned panoramic image system transmission anomaly simulation method embodiment, and their functions and implementation processes will not be described in detail here.

[0061] Thirdly, embodiments of this application provide a panoramic imaging system transmission anomaly simulation device, which can be a personal computer (PC), laptop computer, server, or other device with data processing capabilities.

[0062] Reference Figure 3 , Figure 3 This is a schematic diagram of the hardware structure of the panoramic imaging system transmission anomaly simulation device involved in the embodiments of this application. In this embodiment, the panoramic imaging system transmission anomaly simulation device may include a processor, a memory, a communication interface, and a communication bus.

[0063] The communication bus can be of any type and is used to interconnect the processor, memory, and communication interface.

[0064] The communication interface includes input / output (I / O) interfaces, physical interfaces, and logical interfaces used for interconnecting internal components of the panoramic imaging system transmission anomaly simulation device, as well as interfaces used for interconnecting the panoramic imaging system transmission anomaly simulation device with other devices (such as other computing devices or user equipment). Physical interfaces can be Ethernet interfaces, fiber optic interfaces, ATM interfaces, etc.; user equipment can be displays, keyboards, etc.

[0065] Memory can be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), flash memory, optical storage, hard disk, programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), etc.

[0066] The processor can be a general-purpose processor, which can call the panoramic image system transmission anomaly simulation program stored in the memory and execute the panoramic image system transmission anomaly simulation method provided in the embodiments of this application. For example, the general-purpose processor can be a central processing unit (CPU). The method executed when the panoramic image system transmission anomaly simulation program is called can be referred to in the various embodiments of the panoramic image system transmission anomaly simulation method of this application, and will not be repeated here.

[0067] Those skilled in the art will understand that Figure 3 The hardware structure shown does not constitute a limitation of this application and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0068] Fourthly, embodiments of this application also provide a readable storage medium.

[0069] The present application has a readable storage medium storing a panoramic imaging system transmission anomaly simulation program, wherein when the panoramic imaging system transmission anomaly simulation program is executed by a processor, it implements the steps of the panoramic imaging system transmission anomaly simulation method as described above.

[0070] The method implemented when the panoramic image system transmission anomaly simulation program is executed can be referred to in the various embodiments of the panoramic image system transmission anomaly simulation method of this application, and will not be repeated here.

[0071] It should be noted that the sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0072] The terms "comprising" and "having," and any variations thereof, in the specification, claims, and accompanying drawings of this application are intended to cover a non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to such process, method, product, or apparatus. The terms "first," "second," and "third," etc., are used to distinguish different objects, etc., and do not indicate a sequence, nor do they limit "first," "second," and "third" to different types.

[0073] In the description of the embodiments of this application, terms such as "exemplary," "for example," or "for instance" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplary," "for example," or "for instance" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary," "for example," or "for instance" is intended to present the relevant concepts in a concrete manner.

[0074] In the description of the embodiments of this application, unless otherwise stated, " / " means "or". For example, A / B can mean A or B. The "and / or" in the text is merely a description of the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of this application, "multiple" means two or more.

[0075] In some processes described in the embodiments of this application, multiple operations or steps are included in a specific order. However, it should be understood that these operations or steps may not be executed in the order they appear in the embodiments of this application, or they may be executed in parallel. The sequence number of the operation is only used to distinguish different operations, and the sequence number itself does not represent any execution order. In addition, these processes may include more or fewer operations, and these operations or steps may be executed sequentially or in parallel, and these operations or steps may be combined.

[0076] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device to execute the methods described in the various embodiments of this application.

[0077] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A method for simulating transmission anomalies in a panoramic image system, characterized in that, The method for simulating transmission anomalies in the panoramic imaging system includes: Based on the acquisition of preset video transmission anomaly simulation parameters, a fault injection operation is performed on the original video stream output by the video source through the fault injection circuit in the hardware circuit. Based on the video stream after the fault injection operation is performed, it is injected into the panoramic imaging system through a multi-format interface in the hardware circuit. The real-time monitoring panoramic imaging system receives video stream data after a fault injection operation, including operational status data, image display effect data, and changes in video stream parameters.

2. The panoramic imaging system transmission anomaly simulation method as described in claim 1, characterized in that, The fault injection operation performed on the original video stream output from the video source via the fault injection circuit in the hardware circuit includes: By selectively blocking part of the data packet transmission path of the original video stream through a switching circuit, packet loss or data interruption can be simulated.

3. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 1, characterized in that, The fault injection operation performed on the original video stream output from the video source via the fault injection circuit in the hardware circuit includes: The timestamps of data packets in the original video stream are modified by the signal delay module to simulate transmission delay or jitter.

4. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 1, characterized in that, The fault injection operation performed on the original video stream output from the video source via the fault injection circuit in the hardware circuit includes: The data tampering unit modifies the content of data packets in the original video stream or adjusts the transmission order of data packets to simulate packet errors or data corruption.

5. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 1, characterized in that, The operational status data includes the CPU utilization rate, memory usage rate, and video stream data processing time of the panoramic imaging system. The image display effect data includes whether the panoramic imaging system output images have missing, blurry, flickering, or display asynchrony phenomena, as well as whether abnormal error messages appear. The changes in video stream parameters include fluctuations in frame rate, resolution, number of data packets, and data packet integrity of the video stream after fault injection.

6. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 1, characterized in that, Before performing a fault injection operation on the original video stream output by the video source through a fault injection circuit in the hardware circuit based on the acquisition of preset video transmission anomaly simulation parameters, the method further includes: Based on the parameterized results of common video transmission anomalies, the preset video transmission anomaly simulation parameters for subsequent fault injection operations are determined. If you choose to configure a single type of video transmission anomaly, select one anomaly type from signal anomaly, transmission anomaly, and processing anomaly, and match the parameters corresponding to that anomaly type. If you choose to configure multiple types of video composite anomalies, select at least two anomaly types from signal anomalies, transmission anomalies, and processing anomalies, and match the corresponding parameters for each selected anomaly type.

7. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 6, characterized in that, The parameterization corresponding to the signal anomaly includes the duration of signal loss, the intensity of signal distortion, and the duration of signal delay.

8. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 6, characterized in that, The parameterization corresponding to the transmission anomaly includes packet loss rate, jitter amplitude, packet error type, and data corruption degree.

9. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 6, characterized in that, The parameterization corresponding to the processing anomalies includes data interruption frequency, data packet out-of-order ratio, and data processing failure triggering conditions.

10. The method for simulating transmission anomalies in a panoramic imaging system as described in claim 1, characterized in that, After the real-time monitoring panoramic imaging system receives the operating status data, image display effect data, and video stream parameter changes of the video stream following the fault injection operation, it further includes: Based on real-time monitored operating status data, image display effect data, and video stream parameter changes, the error handling mechanism of the panoramic imaging system for video transmission anomalies is analyzed, and the system's ability to identify, correct errors, and maintain image display quality in abnormal scenarios is evaluated.

11. A panoramic imaging system transmission anomaly simulation system, characterized in that, The panoramic image system transmission anomaly simulation system includes: The parameter acquisition module is used to acquire preset video transmission anomaly simulation parameters; A fault injection module is connected to the parameter acquisition module. The fault injection module includes a hardware circuit and a fault injection circuit disposed in the hardware circuit. The fault injection circuit is used to perform a fault injection operation on the original video stream output by the video source based on the analog parameters output by the parameter acquisition module. A video injection module is connected to the fault injection module, and the video injection module is used to transmit the video stream after the fault injection operation is performed by the fault injection module to the panoramic imaging system. The monitoring module is used to connect with an external panoramic imaging system and to monitor in real time the operating status data, image display effect data, and changes in video stream parameters of the panoramic imaging system after receiving a faulty video stream.

12. The panoramic imaging system transmission anomaly simulation system as described in claim 11, characterized in that, The fault injection circuit includes a switching circuit, which is used to selectively block part of the data packet transmission path of the original video stream to simulate packet loss or data interruption.

13. The panoramic imaging system transmission anomaly simulation system as described in claim 11, characterized in that, The fault injection circuit includes a signal delay module, which is used to modify the timestamps of data packets in the original video stream to simulate transmission delay or jitter.

14. A device for simulating transmission anomalies in a panoramic imaging system, characterized in that, The panoramic imaging system transmission anomaly simulation device includes a processor, a memory, and a panoramic imaging system transmission anomaly simulation program stored in the memory and executable by the processor, wherein when the panoramic imaging system transmission anomaly simulation program is executed by the processor, it implements the steps of the panoramic imaging system transmission anomaly simulation method as described in any one of claims 1 to 10.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a panoramic imaging system transmission anomaly simulation program, wherein when the panoramic imaging system transmission anomaly simulation program is executed by a processor, it implements the steps of the panoramic imaging system transmission anomaly simulation method as described in any one of claims 1 to 10.

Images