Performance test method and system of wireless camera and computer readable storage medium

Abstract

The invention discloses a wireless camera performance test method and system and a computer readable storage medium, an AP simulation device and an STA simulation device are used for respectively simulating a target AP and a streaming server, various complex network environments can be simulated, various wireless network environments in actual use can be more accurately and widely simulated, and the performance test efficiency of a wireless camera is improved. The performance of the camera in a real environment can be evaluated more accurately; secondly, according to the embodiment of the invention, the practical application links such as camera video acquisition, video transmission and the like are specifically tested from the use scene of the camera, and the test content is closer to the practical use scene of the camera, so that the test result has higher reference value; the network performance and the wireless transmission performance of the wireless camera can be comprehensively evaluated, and more comprehensive and detailed data support is provided for performance optimization and quality control of the camera.

Description

Technical Field

[0001] The present invention relates to the field of intelligent terminals, and in particular to a performance testing method and system for a wireless camera and a computer-readable storage medium. Background Art

[0002] Camera (CAMERA or WEBCAM), also known as computer camera, computer eye, electronic eye, etc., is a video input device. Cameras generally have functions such as static image capture and video recording. After the lens captures the image, the photosensitive component circuit and control component in the camera process the image and convert it into a digital signal that can be recognized by the computer, and then transmit it to the computer and the software restores the image. Cameras are widely used in real-time monitoring, video conferencing, telemedicine and other aspects. With the continuous development of camera technology, more and more cameras support wireless transmission functions, especially data transmission via WiFi.

[0003] Wireless cameras generally need to be tested before leaving the factory. Traditional wireless camera testing methods mainly focus on battery performance testing, shooting function testing, safety performance testing, etc. Testing of WiFi performance is limited to detecting whether the wireless camera can connect to the wireless access point (AP). These traditional wireless camera tests are relatively simple and not comprehensive enough. They do not consider the wireless transmission scenarios in actual use and lack pertinence, which in turn affects the accuracy and referenceability of the test results. Summary of the invention

[0004] The main purpose of the present invention is to provide a performance testing method, system and computer-readable storage medium for a wireless camera, aiming to solve the technical problem that traditional wireless camera testing does not take into account the WiFi transmission scenarios in actual use and lacks pertinence.

[0005] To achieve the above-mentioned purpose, an embodiment of the present invention provides a performance testing method for a wireless camera, and the performance testing method for a wireless camera is applied to a wireless camera testing system; The wireless camera test system includes a wireless camera, a video playback device, a shielding box, an AP simulation device, and a STA simulation device; The wireless camera and the video playback device are arranged in the shielding box; the AP simulation device and the STA simulation device are arranged outside the shielding box; The performance testing method of the wireless camera includes: The AP simulation device performs AP simulation to obtain a target AP; The STA simulation device performs STA simulation to obtain a streaming server; The wireless camera is connected to the streaming server through the target AP; The video playing device plays the test video; The wireless camera collects video from the video playback screen of the video playback device to obtain a first collected video, and transmits the first collected video to the streaming server through the target AP; The streaming server obtains first test data of the wireless camera based on the received first collected video.

[0006] Furthermore, to achieve the above-mentioned purpose, an embodiment of the present invention may also provide a wireless camera test system, the wireless camera test system comprising a wireless camera, a video playback device, a shielding box, an AP simulation device, and a STA simulation device; The wireless camera and the video playback device are arranged in the shielding box; the AP simulation device and the STA simulation device are arranged outside the shielding box; The AP simulation device is used to perform AP simulation to obtain a target AP; The STA simulation device is used to perform STA simulation to obtain a streaming server; The wireless camera is used to connect to the streaming server through the target AP; The video playback device is used to play the test video; The wireless camera is also used to collect video from the video playback screen of the video playback device to obtain a first collected video, and transmit the first collected video to the streaming server through the target AP; The streaming server is used to obtain first test data of the wireless camera based on the received first collected video.

[0007] Furthermore, to achieve the above-mentioned purpose, an embodiment of the present invention may also provide a computer-readable storage medium, on which a control program is stored, and when the control program is executed by a processor, the steps of the performance testing method of the wireless camera as described above are implemented.

[0008] The embodiment of the present invention simulates the target AP and the streaming server respectively through the AP simulation device and the STA simulation device, and can simulate various complex network environments, thereby more accurately and extensively simulating various wireless network environments in actual use, and can more accurately evaluate the performance of the camera in a real environment; secondly, the embodiment of the present invention will also start from the use scenario of the camera, and conduct targeted tests on the actual application links such as camera video acquisition and video transmission. The test content is closer to the actual use scenario of the camera, so that the test results have a higher reference value, and can comprehensively evaluate the network performance and wireless transmission performance of the wireless camera, and provide more comprehensive and detailed data support for the performance optimization and quality control of the camera. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 A schematic diagram of a flow chart of a first embodiment of a performance testing method for a wireless camera of the present invention; Figure 2 is a first schematic diagram of the wireless camera testing system of the present invention; Figure 3 FIG. 4 is a second schematic diagram of the wireless camera testing system of the present invention.

[0010] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0011] In order to make the purpose, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure provided in the drawings is not intended to limit the scope of the present disclosure for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0012] Camera (CAMERA or WEBCAM), also known as computer camera, computer eye, electronic eye, etc., is a video input device. Cameras generally have functions such as static image capture and video recording. After the lens captures the image, the photosensitive component circuit and control component in the camera process the image and convert it into a digital signal that can be recognized by the computer, and then transmit it to the computer for image restoration by software. Cameras are widely used in real-time monitoring, video conferencing, telemedicine and other aspects. With the continuous development of camera technology, more and more cameras support wireless transmission functions, especially data transmission through WiFi. Wireless cameras generally need to be tested before leaving the factory. Traditional wireless camera testing methods mainly focus on battery performance testing, shooting function testing, safety performance testing, etc. The test of WiFi performance is limited to detecting whether the wireless camera can connect to the wireless access point (AP). These traditional wireless camera tests are relatively simple and not comprehensive. They do not consider the wireless transmission scenarios in actual use and lack pertinence, which in turn affects the accuracy and reference of the test results.

[0013] In this regard, the embodiment of the present invention can simulate various complex network environments by simulating the target AP and the streaming server respectively through the AP simulation device and the STA simulation device, thereby more accurately and extensively simulating various wireless network environments in actual use, and can more accurately evaluate the performance of the camera in a real environment; secondly, the embodiment of the present invention will also start from the use scenario of the camera, and conduct targeted tests on the actual application links such as camera video acquisition and video transmission. The test content is closer to the actual use scenario of the camera, so that the test results have a higher reference value, and can comprehensively evaluate the network performance and wireless transmission performance of the wireless camera, and provide more comprehensive and detailed data support for the performance optimization and quality control of the camera.

[0014] The embodiment of the present invention provides a performance test method for a wireless camera. Figure 1 , Figure 1 It is a flowchart of the first embodiment of the performance test method of the wireless camera of the present invention. It should be noted that although the logical order is shown in the flowchart, in some cases, the steps shown or described can be performed in a different order than here.

[0015] Specifically, the performance test method of the wireless camera in this embodiment is applied to the wireless camera test system. Figure 2 , Figure 2The first schematic diagram of the wireless camera test system in this embodiment. The wireless camera test system includes a wireless camera, a video playback device, a shielding box, an AP simulation device, and a STA simulation device; the wireless camera and the video playback device are arranged in the shielding box, and the shielding box can be used for signal shielding; the AP simulation device and the STA simulation device are arranged outside the shielding box.

[0016] The performance testing method of the wireless camera in this embodiment includes: Step S10, the AP simulation device performs AP simulation to obtain a target AP; The AP simulation device in this embodiment can also be called a host computer. It is a device that can be used to simulate a wireless access point (AccessPoint). It can simulate APs with different parameters through software configuration. It is a set of AP simulation hardware and software that simulates a real router. In practice, it can be in the form of a hardware-software integrated machine. It can provide wireless signals for other devices to connect and use. During the test, it is necessary to turn on the power of the AP simulation device, turn on the device switch, and start the AP simulation software; then, on the interface of the AP simulation software, set the parameters of the target AP according to the test requirements, including SSID (wireless network name), channel, encryption method (such as WPA2), signal strength, etc.; after completing the parameter configuration, the AP simulation device can start simulating the target AP and provide wireless signals to the outside. Among them, the target AP simulates the AP that the wireless camera needs to connect to during daily use; for example, in the home use scenario, the target AP is a home AP; in the parking lot entrance and exit scenario, the target AP is a dedicated AP for parking lot management; in the city security scenario, the target AP is a dedicated AP for city security.

[0017] Step S20, the STA simulation device performs STA simulation to obtain a streaming server; The STA simulation device in this embodiment is used to simulate a wireless terminal device (STA, Station), and the simulated STA can establish a connection with the AP simulated by the AP simulation device and perform data transmission. STAs with different behaviors, such as connection requests, data transmission, etc., can be simulated through software configuration. The STA simulation device can also be in the form of a hardware and software integrated machine in practice. During the test, it is necessary to turn on the power of the STA simulation device, turn on the device switch, start the STA simulation software, and then configure the relevant parameters of the streaming server to be simulated through the STA simulation software, including IP address, port number, transmission protocol (such as UDP or TCP), etc. Among them, the streaming server is used to simulate the platform end of the wireless camera, and will perform uplink and downlink streaming with the wireless camera to simulate daily software upgrades (downlink) and uplink video uploads (uplink), etc. After completing the parameter configuration, the STA simulation device can start simulating the streaming server.

[0018] Step S30, the wireless camera is connected to the streaming server through the target AP; In this embodiment, after simulating the target AP and the streaming server, the wireless camera can be turned on and controlled to search for a wireless network to connect to the target AP. After the connection is successful, the network parameters of the wireless camera can be set, such as setting its IP address, subnet mask, gateway and other parameters to ensure that it can communicate and connect with the streaming server. After the connection, the wireless camera can transmit data with the streaming server through the target AP. For example, a streaming tool (such as iperf or iperf3) can be installed inside the wireless camera, and simulated data can be generated through the streaming tool for data transmission with the streaming service. As for the type and transmission of simulated data, it can be determined according to the business type of the wireless camera. For example, compared with mobile phones, the data packets sent by the wireless camera are mainly small packets of video data streams, and the transmission is to send and receive packets at a certain packet interval, size, and rate.

[0019] Furthermore, the control of the wireless camera can be achieved through the AP simulation device (host computer), that is, the AP simulation device also has the control function of the wireless camera. Specifically, the AP simulation device can enter the wireless camera system through telnet or ssh according to the camera IP address to control the wireless camera; or connect the AP simulation device and the wireless camera through a serial port line, and then enter the wireless camera system through the AP simulation device to control the wireless camera.

[0020] Step S40, the video playback device plays a test video; In this embodiment, in order to more accurately simulate the actual use scenario of the wireless camera, a video playback device (such as a mobile phone, tablet computer, etc.) can be used to import a pre-prepared test video file, which should have a clear picture and a stable frame rate to facilitate subsequent video acquisition and quality assessment. The video playback device then plays the test video, which can include a video segment with a static picture and a video segment with a changing picture.

[0021] Step S50, the wireless camera collects video from the video playback screen of the video playback device to obtain a first collected video, and transmits the first collected video to the streaming server through the target AP; In this embodiment, the wireless camera starts to collect the video playback screen of the video playback device in real time to obtain the first collected video. At the same time, the wireless camera transmits the collected video data to the streaming server through the target AP through the established connection. At this time, if the video playback device plays a video segment with a static screen, it can be considered that the wireless camera is working in a silent state (no object moves within the video shooting range); if the video playback device plays a static video segment, it can be considered that the wireless camera is working in an active state (there are objects moving within the video shooting range). In this way, the test scenarios are enriched and more in line with the use scenarios of simulating the actual video capture of the wireless camera.

[0022] Step S60: the streaming server obtains first test data of the wireless camera based on the received first collected video.

[0023] In this embodiment, the streaming server continuously receives the first collected video data transmitted by the wireless camera and caches it. The streaming server can then analyze the first collected video, extract key first test data, such as frame rate, packet loss rate, delay, throughput, etc., and produce a corresponding first test report based on the first test data. The report lists the values ​​of various performance indicators in detail and can provide charts for display, so that testers can intuitively understand the video transmission performance of the camera.

[0024] In addition, since the communication between the wireless camera and the streaming server is implemented through the target AP, the AP simulation device can also cache the first collected video data transmitted by the wireless camera, and then analyze it, extract the first test data and generate a first test report.

[0025] Furthermore, in order to simulate the weakening of the AP signal due to the distance, barriers, etc. between the wireless camera and the target AP, the signal of the target AP can also be attenuated. Specifically, the wireless camera test system in this embodiment may also include an attenuator, which reduces the power of the signal through a resistor network or other circuit elements. The attenuator in this embodiment can be set near the AP simulation device. During the test, the attenuator generates an attenuation signal to adjust the signal strength of the target AP. For example, the original target AP sends a signal strength of 20dbm, and the attenuation signal sent by the attenuator can make an attenuation adjustment of 10dbm to the signal strength of the target AP, so the signal strength of the target AP after attenuation is 10dbm. In the above manner, the weakening of the AP signal due to the distance, barriers, etc. between the wireless camera and the target AP can be simulated, and the test content is closer to the actual use scenario of the camera.

[0026] The embodiment of the present invention obtains the target AP and the streaming server respectively through the AP simulation device and the STA simulation device, and can simulate various complex network environments, thereby more accurately and extensively simulating various wireless network environments in actual use, and can more accurately evaluate the performance of the camera in a real environment; secondly, the embodiment of the present invention will also start from the use scenario of the camera, and conduct targeted tests on the actual application links such as camera video acquisition and video transmission. The test content is closer to the actual use scenario of the camera, so that the test results have a higher reference value, and can comprehensively evaluate the network performance and wireless transmission performance of the wireless camera, and provide more comprehensive and detailed data support for the performance optimization and quality control of the camera.

[0027] Based on the first embodiment of the performance testing method for a wireless camera described above, a second embodiment of the performance testing method for a wireless camera of the present invention is proposed.

[0028] In this embodiment, the wireless camera testing system further includes a horizontal rotating table. Figure 3 , Figure 3 2 is a second schematic diagram of the wireless camera testing system in this embodiment. The horizontal rotating table is arranged in the shielding box, and the wireless camera is arranged on the horizontal rotating table.

[0029] The performance testing method of the wireless camera also includes: Step a70, the horizontal rotating platform rotates in a preset direction and at a preset angle to adjust the orientation of the wireless camera.

[0030] The wireless camera in this embodiment is set on a horizontal rotating table. By rotating the horizontal rotating table in a preset direction and at a preset angle, the wireless camera can be driven to rotate at a preset angle, thereby adjusting the orientation of the camera, and then testing the wireless transmission performance of the wireless camera in different orientations. During the test, a number of angles can be pre-set, and then the horizontal rotating table can be controlled to rotate to the angle, and the wireless camera can be tested at the angle, that is, the above steps S40-S60 are executed. In the above manner, the wireless transmission performance of the wireless camera in different orientations can be tested, enriching the test scenarios.

[0031] Based on the first or second embodiment of the performance testing method for a wireless camera described above, a third embodiment of the performance testing method for a wireless camera of the present invention is proposed.

[0032] In this embodiment, after step S60, the following steps are further included: Step a80, the AP simulation device performs AP simulation to obtain an interfering AP; In order to simulate various interference situations that may be encountered in an actual wireless network environment, so as to more comprehensively test the performance of the wireless camera, the AP simulation device in this embodiment will also perform simulation to obtain an interference AP to simulate the interference of other APs on the target AP during actual use. Among them, the parameters of the interference AP should be different from those of the target AP. For example, the SSID of the interference AP can be set to "InterferenceAP", a channel different from the target AP can be selected (such as channel 6 for the target AP and channel 11 for the interference AP), and an appropriate signal strength can be set, so that it can interfere with the target AP.

[0033] Step a90, the STA simulation device performs STA simulation to obtain at least two interfering STAs; wherein at least one interfering STA is connected to the target AP, and at least one interfering STA is connected to the interfering AP; In order to simulate various interference situations that may be encountered in an actual wireless network environment, so as to more comprehensively test the performance of the wireless camera, the STA simulation device in this embodiment will also perform simulation to obtain an interfering STA to simulate the interference of other STAs in actual use. As for the AP connection situation of the interfering STA, at least one interfering STA is connected to the target AP, and at least one interfering STA is connected to the interfering AP. In this way, a scenario in which multiple STAs are connected to different APs and compete for wireless resources in an actual environment can be simulated.

[0034] Step a100, the wireless camera collects video from the video playback screen of the video playback device to obtain a second collected video, and transmits the second collected video to the streaming server through the target AP; After simulating the interference scenario, the wireless camera can again collect the video playback screen of the video playback device in real time to obtain a second collected video, and transmit the second collected video to the streaming server through the target AP.

[0035] Step a110: the streaming server obtains second test data of the wireless camera based on the received second captured video.

[0036] When receiving the second collected video, the streaming server can analyze the second collected video, extract key second test data, such as frame rate, packet loss rate, delay, throughput, etc., and generate a corresponding second test report based on the second test data. In addition, the first test data and the second test data can be compared and analyzed to analyze the impact of the interference AP and the interference STA on the transmission performance of the wireless camera. In this embodiment, by setting the interference AP and the interference STA, various interference situations that may be encountered in the actual wireless network environment are simulated, so as to more comprehensively test the performance of the wireless camera.

[0037] Furthermore, in order to test the impact of different interference strengths of STA and AP on the transmission performance of the wireless camera, the signal strength of the interfering STA and the interfering AP can be adjusted accordingly in this embodiment. Specifically, the wireless camera test system in this embodiment can also include an attenuator, which reduces the power of the signal through a resistor network or other circuit elements. The attenuator in this embodiment can be set near the AP simulation device or the STA simulation device. During the test, the attenuator generates an attenuated signal, thereby adjusting the signal strength of the interfering AP and / or the interfering STA. In the above manner, interfering APs and interfering STAs with different strengths can be simulated, enriching the test scenarios, making the test content closer to the actual use scenarios of the camera, simulating various interference situations that may be encountered in the actual wireless network environment, and thus more comprehensively testing the performance of the wireless camera.

[0038] Based on any one of the above embodiments of the performance testing method for a wireless camera, a fourth embodiment of the performance testing method for a wireless camera of the present invention is proposed.

[0039] In this embodiment, after step S30, the following steps are further included: Step a120, the AP simulation device simulates restarting the target AP; During the actual use of the wireless camera, the AP may unexpectedly lose power and then recover, and the wireless camera should be able to reconnect automatically when unattended. In this regard, when testing this embodiment, the reconnection performance of the wireless camera can also be tested. Specifically, the restart parameters of the target AP can be set on the AP simulation software interface of the AP simulation device, including the restart interval (such as restarting every 5 minutes) and the number of restarts (such as restarting 3 times); then, the AP simulation device starts to simulate the restart process of the target AP according to the restart parameters. After the set time interval, the target AP will automatically disconnect from the wireless camera, then restart and resume the provision of wireless signals.

[0040] Step a130, the wireless camera reconnects after the target AP is restarted; The wireless camera has an automatic reconnection mechanism. When it detects that the connection with the target AP is disconnected, it will automatically try to reconnect. The camera will re-search the target AP and initiate a connection request based on the previously saved network configuration information. In the camera's management interface or log, you can monitor and record the status of the reconnection process in real time, including the number of reconnection attempts, reasons for reconnection failures, and other information. At the same time, the streaming server can also detect the camera's reconnection request and connection status changes.

[0041] Step a140: the wireless camera and / or the AP simulation device obtains reconnection test data according to the reconnection situation, and the reconnection test data includes at least one of a reconnection success rate and a reconnection time.

[0042] Inside the wireless camera, the status of the reconnection process can be monitored and recorded in real time through a log or manager, including the number of reconnection attempts, reconnection time, reasons for reconnection failure, and other information. At the same time, the AP simulation device and the streaming server can also detect and record the number of reconnection requests and connection status changes of the wireless camera. Based on the recorded information, the wireless camera and / or the AP simulation device obtains reconnection test data based on the reconnection situation, and the reconnection test data includes at least one of the reconnection success rate and the reconnection time. For example, if the target AP restarts 3 times and the camera successfully reconnects 2 times, the reconnection success rate is 66.67%; for example, if the target AP restarts and disconnects at 10:00:00, and the camera successfully reconnects at 10:00:15, the reconnection time is 15 seconds.

[0043] By analyzing the reconnection test data, we can evaluate the stability and reliability of the camera when facing sudden network events such as AP restart, and provide a basis for improving product performance.

[0044] Based on any one of the above embodiments of the performance testing method for a wireless camera, a fifth embodiment of the performance testing method for a wireless camera of the present invention is proposed.

[0045] In this embodiment, step S50 includes: Step a51, the wireless camera collects video of the video playback screen of the video playback device to obtain a first collected video, and compresses and sub-packets the first collected video according to a preset packetization rule to obtain a plurality of first data packets, wherein the first data packet includes a packetization time and a data packet identifier for video reassembly; the first data packet is sent based on the preset packetization rule to send the first collected video to the streaming server through the target AP; In this embodiment, when testing the wireless camera, artificial intelligence technology can also be used to build a pre-trained preset AI model, and then the preset AI model is used to analyze the video quality sent by the wireless camera to the streaming server, and then the performance of the camera under different conditions is evaluated. For the training process of the preset AI model, it can be to first collect a large amount of video data transmitted by the camera under different network environments and interference conditions, and mark its quality level (such as clarity, smoothness, etc.); then build an initial model based on a deep learning algorithm (such as a convolutional neural network), and use the pre-collected video data to train the initial model so that it can recognize the quality features in the video. When the training is completed, the preset AI model can be obtained and used to test the wireless camera.

[0046] Specifically, the wireless camera of this embodiment collects the video playback screen of the video playback device in real time to obtain a first collected video. For the first collected video, the wireless camera compresses the first collected video data through the built-in video codec according to the preset packetization rules. Using a preset coding standard (such as H.264 or H.265, etc.), while ensuring the video quality, the amount of data is reduced as much as possible to improve the transmission efficiency; then the compressed video data is divided into multiple first data packets according to a certain size and format, and each data packet contains a packetization time (i.e., a timestamp generated by the data packet) and a data packet identifier (such as a sequence number or a frame number) for video reassembly to ensure that the data packet can be correctly identified and reassembled during the transmission process. After obtaining the first data packet, the wireless camera sends the first data packet to the streaming server through the target AP according to the preset packetization rules, such as the sending interval and sending order of the data packet. The packetization rules can also include a retransmission mechanism for the data packet to cope with the packet loss that may occur during the transmission process.

[0047] The step S60 comprises: Step a61, the streaming server receives the first data packet and determines the receiving time of the first data packet; determines the transmission time according to the receiving time and the packetization time; reorganizes the video of the first data packet according to the data packet identifier to obtain a first restored video; performs spatial quality evaluation and temporal quality evaluation on the first restored video through a preset AI model, wherein the evaluation indicators of the spatial quality evaluation include at least one of target quality clarity and color accuracy, and the evaluation indicators of the temporal quality evaluation include at least one of frame rate stability and motion blur; determines the transmission quality of the first acquired video based on the transmission time, the evaluation indicators of the spatial quality evaluation, and the evaluation indicators of the temporal quality evaluation, and obtains the first test data of the wireless camera according to the transmission quality of the first acquired video.

[0048] The streaming server continuously monitors the network, waiting to receive the first data packet sent from the wireless camera. When each first data packet is received, the streaming server will record its reception time, that is, the timestamp of the data packet arriving at the server. According to the reception time of the first data packet received and the packetization time in the first data packet, the transmission time of each data packet can be calculated, which can reflect the time required for the data packet to be transmitted from the camera to the server. Using the data packet identifier, the first data packet can be reorganized, and then the corresponding video can be restored through the corresponding decoding method. For the convenience of explanation, the video restored by the streaming server based on the first data packet can be recorded as the first restored video. This step ensures the integrity and playability of the video data, providing a basis for subsequent quality evaluation.

[0049] After obtaining the first restored video, the spatial quality evaluation and temporal quality evaluation of the first restored video can be performed through the preset AI model. Among them, the spatial quality evaluation of the first restored video is mainly carried out from the perspective of the content of a single-frame video image, and the evaluation indicators of spatial quality can include target quality clarity and color accuracy; target quality clarity is used to reflect the clarity of the target to be identified in the first restored video, such as the clarity of the face, the clarity of the license plate, etc.; color accuracy is used to reflect the naturalness and accuracy of the video color, and can also reflect the color distortion. In practice, if the wireless transmission performance of the wireless camera is better, the target quality clarity and color accuracy of the first restored video will be higher. In the specific implementation, the preset AI model can give a corresponding score or grade by analyzing the image details, edge sharpness, and naturalness and consistency of the color of the first restored video. For example, the clarity evaluation may involve the calculation of parameters such as image contrast and sharpness; the color accuracy evaluation can be performed by comparing the deviation of the color in the video from the standard color. The temporal quality assessment of the first restored video is mainly carried out from the perspective of the content of multi-frame video images. The evaluation indicators of temporal quality assessment can include frame rate stability and picture continuity; frame rate stability is used to reflect the stability of the frame rate of each video segment in the first restored video, that is, to identify whether there is frame rate fluctuation or frame loss. In practice, the change of frame rate can be captured by using time series analysis methods (such as LSTM network); motion blur is used to reflect the blur degree of the moving object in the first restored video in the continuous video frames. In practice, if the wireless transmission performance of the wireless camera is better, the frame rate stability of the first restored video is higher and the motion blur is lower. In the specific implementation, the frame rate stability assessment can be measured by calculating the standard deviation of the frame rate; the picture continuity assessment can be carried out by analyzing the differences between adjacent frames.

[0050] Furthermore, the evaluation index of the spatial quality evaluation includes target quality clarity; and the step of performing spatial quality evaluation on the first restored video by using a preset AI model includes: Perform target detection on the video frames of the first restored video through a preset AI model to determine the identified target, wherein the type of the identified target corresponds to the usage scenario of the wireless camera; extract the edge features and texture features of the identified target, and determine the target quality clarity based on the edge features and texture features.

[0051] In this embodiment, when the evaluation index of the spatial quality evaluation includes the target quality clarity, the video frame of the first restored video is input into a preset AI model, which is a model based on deep learning (such as YOLO, Faster R-CNN, etc.). The preset AI model is used to detect the target of the video frame and identify the recognition target. Among them, considering that the image content that users pay attention to is different in different usage scenarios; for example, in home or monitoring scenarios, the image content that users pay attention to is people, and in the license plate recognition scene at the entrance and exit of the parking lot, the image content that users pay attention to is the license plate; in the road monitoring scene, the image content that users pay attention to is the vehicle; in this regard, in order to better describe the video quality, the type of recognition target can be associated with the usage scenario of the wireless camera, that is, for the videos shot and transmitted by the wireless camera in different usage scenarios, the recognition targets to be recognized and located by the preset AI model are different. After determining the recognition target, the preset AI model processes the image area of ​​the recognition target through the edge detection algorithm (such as Canny, Sobel, etc.) to extract its edge features, which reflect the contour and shape information of the target; at the same time, the grayscale co-occurrence matrix of the area where the recognition target is located will be calculated to extract texture features, such as contrast, entropy, etc. The extracted edge features and texture features can then be comprehensively evaluated to determine the target quality clarity of the recognition target. For example, targets with high edge sharpness, strong contrast, and rich texture details have higher quality clarity.

[0052] After completing the spatial quality evaluation and the temporal quality evaluation, the transmission quality of the first captured video can be determined by comprehensively considering the transmission time, the evaluation index of the spatial quality evaluation and the evaluation index of the temporal quality evaluation. For example, the transmission time, the evaluation index of the spatial quality evaluation and the evaluation index of the temporal quality evaluation can be converted into corresponding evaluation values, and these evaluation values ​​can be weighted to obtain a comprehensive evaluation value, which can integrate multiple factors such as transmission speed, video clarity, and fluency to reflect the overall performance of the wireless camera in the process of transmitting the first captured video. According to the transmission quality of the first captured video, the first test data of the wireless camera can be generated. These data include the specific values, scores or grades of each evaluation index, as well as possible performance bottleneck analysis, etc., which provide an important reference for the performance optimization and quality control of the camera.

[0053] This embodiment uses artificial intelligence technology to analyze the video quality sent by the wireless camera to the streaming server, and then integrates multiple factors such as transmission speed, video clarity, and smoothness to quantitatively evaluate the wireless transmission performance of the wireless camera, providing more comprehensive and detailed data support for the performance optimization and quality control of the camera.

[0054] In addition, an embodiment of the present invention further provides a wireless camera test system, the wireless camera test system comprising a wireless camera, a video playback device, a shielding box, an AP simulation device, and a STA simulation device; The wireless camera and the video playback device are arranged in the shielding box; the AP simulation device and the STA simulation device are arranged outside the shielding box; The AP simulation device is used to perform AP simulation to obtain a target AP; The STA simulation device is used to perform STA simulation to obtain a streaming server; The wireless camera is used to connect to the streaming server through the target AP; The video playback device is used to play the test video; The wireless camera is also used to collect video from the video playback screen of the video playback device to obtain a first collected video, and transmit the first collected video to the streaming server through the target AP; The streaming server is used to obtain first test data of the wireless camera based on the received first collected video.

[0055] The specific implementation of the wireless camera testing system of the present invention can be found in the various embodiments of the performance testing method of the wireless camera mentioned above, and will not be described in detail here.

[0056] In addition, an embodiment of the present invention further provides a computer-readable storage medium.

[0057] A control program is stored on a computer-readable storage medium in an embodiment of the present invention. When the control program is executed by a processor, each step of the performance testing method of the wireless camera described above is implemented.

[0058] The specific implementation of the computer-readable storage medium of the present invention is basically the same as the various embodiments of the performance testing method of the wireless camera mentioned above, and will not be described in detail here.

[0059] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0060] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0061] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0062] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A performance testing method for a wireless camera, characterized in that: The performance testing method of the wireless camera is applied to a wireless camera testing system; The wireless camera test system includes a wireless camera, a video playback device, a shielding box, an AP simulation device, and a STA simulation device; The wireless camera and the video playback device are arranged in the shielding box; The AP simulation device and the STA simulation device are arranged outside the shielding box; The performance testing method of the wireless camera includes: The AP simulation device performs AP simulation to obtain a target AP; The STA simulation device performs STA simulation to obtain a streaming server; The wireless camera is connected to the streaming server through the target AP; The video playing device plays the test video; The wireless camera collects video from the video playback screen of the video playback device to obtain a first collected video, and transmits the first collected video to the streaming server through the target AP; The streaming server obtains first test data of the wireless camera based on the received first collected video.

2. The performance testing method of a wireless camera as claimed in claim 1, characterized in that: The wireless camera test system also includes a horizontal rotating table; The horizontal rotating platform is arranged in the shielding box, and the wireless camera is arranged on the horizontal rotating platform; The performance testing method of the wireless camera also includes: The horizontal rotating platform rotates at a preset angle in a preset direction to adjust the orientation of the wireless camera.

3. The performance testing method of a wireless camera as claimed in claim 1, characterized in that: After the step of obtaining the first test data of the wireless camera based on the received first collected video, the streaming server further includes: The AP simulation device performs AP simulation to obtain an interference AP; The STA simulation device performs STA simulation to obtain at least two interfering STAs; wherein at least one interfering STA is connected to the target AP, and at least one interfering STA is connected to the interfering AP; The wireless camera collects video from the video playback screen of the video playback device to obtain a second collected video, and transmits the second collected video to the streaming server through the target AP; The streaming server obtains second test data of the wireless camera based on the received second captured video.

4. The performance testing method of a wireless camera as claimed in claim 3, characterized in that: The wireless camera test system also includes an attenuator; The performance testing method of the wireless camera also includes: The attenuator generates an attenuation signal to adjust the signal strength of the interfering AP and / or the signal strength of the interfering STA.

5. The performance testing method of a wireless camera as claimed in claim 1, characterized in that: The wireless camera test system also includes an attenuator; The performance testing method of the wireless camera also includes: The attenuator generates an attenuation signal to adjust the signal strength of the target AP.

6. The performance testing method of a wireless camera as claimed in claim 1, characterized in that: The performance testing method of the wireless camera also includes: The AP simulation device performs restart simulation on the target AP; The wireless camera reconnects after the target AP is restarted; The wireless camera and / or the AP simulation device obtains reconnection test data according to the reconnection situation, and the reconnection test data includes at least one of a reconnection success rate and a reconnection time.

7. The performance testing method of a wireless camera as claimed in claim 1, characterized in that: The step of the wireless camera collecting video from the video playback screen of the video playback device to obtain a first collected video, and transmitting the first collected video to the streaming server through the target AP includes: The wireless camera collects video from the video playback screen of the video playback device to obtain a first collected video, and compresses and sub-packets the first collected video according to a preset packetization rule to obtain a plurality of first data packets, wherein the first data packet includes a packetization time and a data packet identifier for video reassembly; the first data packet is sent based on the preset packetization rule to send the first collected video to the streaming server through the target AP; The step of obtaining the first test data of the wireless camera based on the received first collected video by the streaming server includes: The streaming server receives the first data packet and determines a receiving time of the first data packet; determines a transmission time according to the receiving time and the packetization time; reconstructs the video of the first data packet according to the data packet identifier to obtain a first restored video; performs spatial quality evaluation and temporal quality evaluation on the first restored video through a preset AI model, wherein the evaluation indicators of the spatial quality evaluation include at least one of target quality clarity and color accuracy, and the evaluation indicators of the temporal quality evaluation include at least one of frame rate stability and motion blur; determines the transmission quality of the first acquired video based on the transmission time, the evaluation indicators of the spatial quality evaluation, and the evaluation indicators of the temporal quality evaluation, and obtains the first test data of the wireless camera based on the transmission quality of the first acquired video.

8. The performance testing method of a wireless camera as claimed in claim 7, characterized in that: The evaluation index of the spatial quality evaluation includes target quality clarity; The step of performing spatial quality assessment on the first restored video by using a preset AI model includes: Performing target detection on the video frame of the first restored video through a preset AI model to determine an identified target; wherein the type of the identified target corresponds to the usage scenario of the wireless camera; The edge features and texture features of the identified target are extracted, and the target quality clarity is determined according to the edge features and texture features.

9. A wireless camera testing system, characterized in that: The wireless camera test system includes a wireless camera, a video playback device, a shielding box, an AP simulation device, and a STA simulation device; The wireless camera and the video playback device are arranged in the shielding box; The AP simulation device and the STA simulation device are arranged outside the shielding box; The AP simulation device is used to perform AP simulation to obtain a target AP; The STA simulation device is used to perform STA simulation to obtain a streaming server; The wireless camera is used to connect to the streaming server through the target AP; The video playback device is used to play the test video; The wireless camera is also used to collect video from the video playback screen of the video playback device to obtain a first collected video, and transmit the first collected video to the streaming server through the target AP; The streaming server is used to obtain first test data of the wireless camera based on the received first collected video.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a control program, and when the control program is executed by a processor, the steps of the performance testing method of a wireless camera as described in any one of claims 1 to 8 are implemented.

Images