Wireless Gamepad Stability Analysis System Based on Image Analysis

Abstract

The present invention relates to the technical field of wireless game controller detection, and specifically, to a wireless game controller stability analysis system based on image analysis. It includes a data acquisition unit, an image processing unit, an image analysis unit, and a conduction judgment unit. The present invention captures the images displayed on the monitor during the operation of the game controller, and segments the video frames of the obtained response video, so as to accurately obtain the time when each monitor responds to the instructions of the game controller. At the same time, it captures the actions of the game characters in the segmented images, obtains the action conditions of the game characters on each monitor under the instructions, and compares the standard action templates established by the image processing unit with the actual actions of the game characters on each monitor, so as to obtain the differences between the actions of the game characters on the monitor and the standard action templates, and thus more accurately obtain the response speed of the wireless game controller.

Description

Technical Field

[0001] The present invention relates to the technical field of wireless game controller detection, and more specifically, to a stability analysis system for wireless game controllers based on image analysis. Background Art

[0002] In the process of development, game controllers are divided into wired and wireless types. The transmission speed of wired game controllers is faster than that of wireless game controllers. However, wireless game controllers are not limited by the control of transmission lines during use, making it more convenient for users. Each has its own advantages and disadvantages. When users play games using a game controller, they click the buttons on the game controller to make the game characters on the display perform corresponding operations. If there is a delay after clicking the operation buttons on the game controller, it will cause delayed actions of the game characters on the display, thus affecting the user's gaming experience. Especially for wireless game controllers, the signal transmission speed determines the gaming experience. Therefore, after the production of game controllers, it is necessary to detect the performance of the game controllers to ensure their normal use.

[0003] Currently, when detecting wireless game controllers, staff need to wirelessly connect the game controller and then determine the delay situation of the wireless controller operating the game characters by operating the wireless controller. However, the manual detection method can only perform rough detection and cannot perform precise detection. With the increasing competition, the delay requirements for game controllers are also getting higher and higher. Therefore, a detection system is needed to replace manual detection and achieve precise detection of the delay effect of game controllers, thereby improving the user experience of game controllers in later use. Summary of the Invention

[0004] The purpose of the present invention is to provide a stability analysis system for wireless game controllers based on image analysis to solve the problems raised in the above background art.

[0005] To achieve the above purpose, a stability analysis system for wireless game controllers based on image analysis is provided, including a data acquisition unit, an image processing unit, an image analysis unit, and a conduction judgment unit;

[0006] The data acquisition unit is used to connect the circuits on the wireless controller circuit board, connect the wireless controller circuit board to three displays respectively. After the connection of the wireless controller circuit board is completed, input commands to the wireless controller circuit board to make the wireless controller circuit board make corresponding command responses, and capture the images on the three displays after the wireless controller circuit board makes commands;

[0007] The image processing unit establishes a standard action template according to the official actions of the game, receives the images captured by the data acquisition unit from three monitors, segments the received images into video frames, and then captures the human actions of the segmented video frames.

[0008] The image analysis unit compares the action postures of the three monitors according to the human actions captured by the image processing unit, and judges the action responses at each time point.

[0009] The conduction judgment unit receives the comparison of the response duration of the human actions by the image analysis unit, judges the action postures of the human, and then judges the wireless gamepad according to the comparison result of the response duration and the action postures.

[0010] As a further improvement of this technical solution, the data acquisition unit includes a line connection control module, an instruction output module, and an instruction recording module.

[0011] The line connection control module is used to control the circuit connection device for electrically connecting to the circuit board of the wireless gamepad, and after the circuit connection of the wireless gamepad circuit is completed, connect the wireless gamepad circuit to the three monitors. The connection methods of the wireless gamepad circuit to the three monitors are respectively: wireless, wired, and the combination of wired and wireless.

[0012] The instruction output module is used to send instructions to the circuit board of the wireless gamepad to make corresponding operations on the circuit board of the wireless gamepad.

[0013] The instruction recording module records the instructions output by the instruction output module, and also records the time points when the instructions are output during the recording.

[0014] As a further improvement of this technical solution, the data acquisition unit further includes a video action capture module, and the image processing unit includes a standard action template module.

[0015] After the instruction output module outputs instructions, the video action capture module captures the actions of the images and videos on the three monitors. At the same time, the video action capture module also captures the human actions provided by the game official, and after the video action capture is completed, transmits it to the image processing unit.

[0016] The standard action template module is used to define the videos of the human actions captured by the video action capture module as standard actions and make templates for the video content.

[0017] As a further improvement of this technical solution, the image processing unit further includes a video frame segmentation module and an action state capture module.

[0018] The video frame segmentation module is used to receive the image videos displayed on three monitors captured by the video action capture module, and after receiving, segment the image videos into video frames, so that the video forms individual pictures;

[0019] The action state capture module recognizes and captures the human actions in the pictures segmented by the video frame segmentation module.

[0020] As a further improvement of this technical solution, the steps for the video frame segmentation module to segment the image video into video frames are as follows:

[0021] S1. First, number the image videos obtained on the three monitors to distinguish the three image videos;

[0022] S2. Read several video frames in each image video, and at the same time number the images in each video frame according to the corresponding time;

[0023] S3. According to the positions of the video frames, extract the graphics displayed in each video frame separately, and at this time, several images are formed;

[0024] S4. Use the algorithm of the Canny edge detection operator to obtain the human contours in each image, and arrange the contours of the several obtained images according to the image numbers.

[0025] As a further improvement of this technical solution, the steps of the algorithm of the Canny edge detection operator are as follows:

[0026] ①. Perform Gaussian filtering on the image:

[0027] Use the one-dimensional Gaussian function to perform low-pass filtering and noise filtering on the original image f(x, y). The formula for Gaussian filtering is: , is the standard deviation of the Gaussian filtering function, which controls the smoothness. When is small, the filter positioning accuracy is high, but the signal-to-noise ratio is low; when is large, the situation of the filter is exactly the opposite. We need to determine the size of according to the actual situation;

[0028] ②. Use the directional gradient operator to calculate the directional gradient and the direction of the gradient of the image:

[0029] Set two templates and , and perform convolution operations on the image through the above two templates to obtain the gradient values of the x and y directions of the pixel points in the picture;

[0030] Then set as the gradient in the x direction, is the gradient in the y direction. When calculating the amplitude, the L1 norm (sum of absolute values) is used, that is ;

[0031] Then calculate the gradient direction ;

[0032] ③. Perform non-maximum suppression:

[0033] Compare the gradient directions of the edges in four directions: horizontal, vertical, 45°, and 135°, and use different neighboring pixels to determine the local maximum. If the gray value of a certain pixel is not the largest compared with the gray values of the two adjacent pixels in the gradient direction, this point is a non-edge point and is deleted; otherwise, it is a candidate edge point and is retained. This process is called "non-maximum suppression;

[0034] ④. Adopt a dual-threshold technique for edge hysteresis:

[0035] Detect the results of non-maximum suppression using high and low thresholds to obtain a high-value edge image and a low-threshold edge image. Then, based on the image, use the image to supplement and connect the image edges;

[0036] ⑤. Obtain the edges of the image.

[0037] As a further improvement of this technical solution, the image analysis unit includes a frame duration comparison module, an action posture comparison module, and an action reaction judgment module;

[0038] The frame duration comparison module receives the video images segmented by the video frame segmentation module, obtains the video frames occupied by the images displayed on each display to complete the action, calculates the time used to complete the specified action based on the number of video frames, and simultaneously compares the time used by each display to complete the specified action;

[0039] The action posture comparison module receives the action images captured by the action state capture module and the standard action template data in the standard action template module, and then compares the postures of the video frames of the completed action with the corresponding standard action templates;

[0040] The action reaction judgment module receives the results of the frame duration comparison module and the action posture comparison module for the video frames and the action postures, and then determines the posture and movement of the running action based on the comparison data to judge the difference between the image and the standard action.

[0041] As a further improvement of this technical solution, the conduction judgment unit includes a reaction duration comparison module, an action posture judgment module, and a judgment module;

[0042] The reaction duration comparison module receives the time data of the actions completed on the corresponding display in the frame duration comparison module and the time data of the instructions recorded in the instruction recording module, and then compares the time when the instruction is issued with the time corresponding to the video frame to determine the reaction duration of the start of movement and the completion of actions on each display. At the same time, the reaction durations among the three displays are compared;

[0043] The action posture judgment module receives the result of the action judgment by the action reaction judgment module, and after receiving it, arranges the contours corresponding to the images segmented from the image videos on the three displays in the order of video frames to form a video of the action contour. Then, the video of the action contour is combined with the video of the standard action, and then the action contour videos corresponding to the three displays and the standard action video are compared for corresponding actions to determine the distortion degree of the action posture;

[0044] The evaluation module combines the comparison result of the reaction duration by the reaction duration comparison module and the comparison result of the action posture in the action posture judgment module to evaluate the operation performance of the wireless game handle circuit board. After an action evaluation is completed, it feeds back to the line connection control module, so that the line connection control module outputs an instruction for the next action according to the instruction of the instruction output module.

[0045] Compared with the prior art, the beneficial effects of the present invention are:

[0046] In the wireless game handle stability analysis system based on image analysis, the game handle is connected in a wired, wireless, or wired and wireless combination manner through the data acquisition unit, and instructions are output to operate the game handle. During the operation of the game handle, the images displayed on the display are captured to obtain the reaction videos of the game characters on the three displays. The image processing unit establishes a standard action template, and the reaction videos obtained by the data acquisition unit are segmented into video frames to accurately obtain the time when each display responds to the instructions of the game handle. At the same time, the image processing unit captures the actions of the game characters in the segmented images to obtain the action conditions of the game characters on each display under the instructions. The image analysis unit compares the standard action template established by the image processing unit with the actual actions of the game characters on each display to obtain the differences between the actions of the game characters on the display and the standard action template. The conduction judgment unit combines the time of the action reaction and the posture of the action to judge the situation of the delayed transmission of the game handle. By ensuring the reaction situation of the wireless game handle according to the wired, wireless, or wired and wireless combination connection methods, the reaction speed of the wireless game handle is obtained more accurately, ensuring that each wireless game handle is qualified before leaving the factory. Brief Description of the Drawings

[0047] Figure 1 This is the overall framework structure block diagram of the present invention;

[0048] Figure 2 This is the refined structure block diagram of the overall framework of the present invention;

[0049] Figure 3 This is the demonstration block diagram of the present invention.

[0050] The meanings of each label in the figure are as follows:

[0051] 1. Data acquisition unit; 11. Line connection control module; 12. Instruction output module; 13. Video motion capture module; 14. Instruction recording module;

[0052] 2. Image processing unit; 21. Standard motion template module; 22. Video frame segmentation module; 23. Motion state capture module;

[0053] 3. Image analysis unit; 31. Frame duration comparison module; 32. Motion posture comparison module; 33. Motion reaction judgment module;

[0054] 4. Conduction judgment unit; 41. Reaction duration comparison module; 42. Motion posture judgment module; 43. Evaluation module. Detailed implementation manners

[0055] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0056] Embodiment 1

[0057] Please refer to Figures 1 - 3 As shown, a wireless gamepad stability analysis system based on image analysis is provided, including a data acquisition unit 1, an image processing unit 2, an image analysis unit 3, and a conduction judgment unit 4;

[0058] The data acquisition unit 1 is used to connect the circuits on the wireless gamepad circuit board, and connect the wireless gamepad circuit board to three monitors respectively. At the same time, after the connection of the wireless gamepad circuit board is completed, an instruction is input to the wireless gamepad circuit board to make the wireless gamepad circuit board make corresponding instruction responses, and the images on the three monitors are captured after the wireless gamepad circuit board makes an instruction;

[0059] The data acquisition unit 1 includes a line connection control module 11, an instruction output module 12, and an instruction recording module 14;

[0060] The circuit connection control module 11 is used to control the circuit connection device for electrically connecting with the wireless handle circuit board. After the circuit connection of the wireless handle circuit is completed, it connects the wireless handle circuit to three displays. The connection methods between the wireless handle circuit and the three displays are as follows: wireless, wired, and a combination of wired and wireless. Among them, the wireless one is the item to be detected, while the wired one and the combination of wired and wireless are used for comparison with the wireless one. The background displayed on the display is a solid-color background, and the game characters are in the solid-color background. The color of the solid-color background is a color that is convenient for the computer to extract, such as white;

[0061] After placing the wireless handle circuit board on the circuit connection device, there are metal contacts on the circuit connection device that match the positions of the buttons on the wireless handle circuit board. When the circuit connection device makes an electrical connection with the wireless handle circuit board, the metal contacts come into contact with the wireless handle circuit board;

[0062] The instruction output module 12 is used to send instructions to the wireless handle circuit board to make corresponding operations on the wireless handle circuit board. That is, the instruction output module 12 sends an electrical signal to the wireless handle circuit board through the metal contacts, and the sent electrical signal is used to control the movement of the game characters on the display;

[0063] The instruction recording module 14 records the instructions output by the instruction output module 12, and also records the time point when the instructions are output during the recording. At this time, the recorded time is the initial time of this detection, that is, 0 o'clock. After the instruction output module 12 issues an instruction signal, the time recording starts;

[0064] The data acquisition unit 1 further includes a video motion capture module 13. After the instruction output module 12 outputs an instruction, the video motion capture module 13 captures the actions in the image videos on the three displays. The capture method uses a camera for capture, which is simple to operate and has a low usage cost. At the same time, the video motion capture module 13 also captures the character actions provided by the game official, and after the video motion capture is completed, it transmits them to the image processing unit 2;

[0065] The image processing unit 2 establishes a standard action template according to the official actions of the game, receives the pictures captured by the data acquisition unit 1 on the three displays, divides the received pictures into video frames, and then captures the character actions in the divided video frames;

[0066] The image processing unit 2 includes a standard action template module 21;

[0067] The standard action template module 21 is used to define the video of the human action captured by the video action capture module 13 as a standard action, and to produce a template for the video content. By establishing a template for the human action, a reference record is made for the video of the human action captured by the video action capture module 13, so as to facilitate determining whether the action of the person displayed on the monitor is standard.

[0068] The image processing unit 2 further includes a video frame segmentation module 22 and an action state capture module 23;

[0069] The video frame segmentation module 22 is used to receive the image videos displayed on the three monitors captured by the video action capture module 13, and after receiving, segment the image videos according to video frames, so that the video forms individual pictures;

[0070] The steps for the video frame segmentation module 22 to segment the image video according to video frames are as follows:

[0071] S1. First, number the image videos obtained from the three monitors to distinguish the three image videos. For example, number the image videos obtained from the three monitors as A, B, and C respectively;

[0072] S2. Read several video frames in each image video, and at the same time number the images in each video frame according to the corresponding time. Taking the image video numbered A as an example, when several video frames are read in the image video of A and numbered, such as the picture of the nth frame and the m time when the instruction output module 12 issues an instruction, then number it as A-n-m;

[0073] S3. According to the position of the video frames, separately extract the graphics displayed in each video frame, and at this time several images are formed;

[0074] S4. Use the algorithm of the Canny edge detection operator to obtain the human contour in each image, and arrange the contours of the several images obtained according to the image numbers;

[0075] The steps of the algorithm of the Canny edge detection operator are as follows:

[0076] ①. Perform Gaussian filtering on the image:

[0077] Use a one-dimensional Gaussian function to perform low-pass filtering and noise filtering on the original image f(x, y). The formula for Gaussian filtering is: , is the standard deviation of the Gaussian filtering function, which controls the smoothness. When is small, the filter positioning accuracy is high, but the signal-to-noise ratio is low; when is large, the situation of the filter is exactly the opposite. We need to determine the size of according to the actual situation;

[0078] ②. Calculate the directional gradient of the image and the direction of the gradient using the directional gradient operator:

[0079] Set two templates and , and perform a convolution operation on the image through the above two templates to obtain the gradient values of the pixels in the x and y directions of the picture;

[0080] Then set as the gradient in the x direction, as the gradient in the y direction. When calculating the amplitude, use the L1 norm (sum of absolute values), that is ;

[0081] Then calculate the gradient direction ;

[0082] ③. Perform non-maximum suppression:

[0083] Compare the gradient directions of the edges in four directions: horizontal, vertical, 45°, and 135°, with different neighboring pixels to determine the local maximum value. If the gray value of a certain pixel is not the largest compared to the gray values of the two adjacent pixels in the gradient direction, this point is a non-edge point and is deleted; otherwise, it is a candidate edge point and is retained;

[0084] ④. Adopt a double-threshold technique for edge hysteresis:

[0085] Detect the results of non-maximum suppression using high and low thresholds to obtain a high-value edge image and a low-threshold edge image. Then, based on the image, use the image to supplement and connect the image edges. After the edge lines on the image are supplemented, the edges of the figure will gradually become complete. When the edges of the figure are completely supplemented, the image has been processed;

[0086] ⑤. Obtain the edges of the image:

[0087] Obtain the pose of the game character in the image by obtaining the edges of the image, and obtain the action situation of the character in this frame of image through the pose of the game character;

[0088] The action state capture module 23 recognizes and captures the character's actions in the pictures segmented by the video frame segmentation module 22;

[0089] The process of the action state capture module 23 capturing the character's actions is a process of recognizing the edges of the images obtained by the video frame segmentation module 22. At the same time, after recognizing the edges of the images, the edge lines of the images are captured and extracted. After extraction, the edge lines of the images are numbered, and they are numbered as A-n-m-line based on the above A-n-m;

[0090] The image analysis unit 3 compares the motion postures of the three displays based on the human motions captured by the image processing unit 2, and judges the motion responses at each time point;

[0091] The image analysis unit 3 includes a frame duration comparison module 31, a motion posture comparison module 32, and a motion response judgment module 33;

[0092] The frame duration comparison module 31 receives the video images segmented by the video frame segmentation module 22, obtains the video frames occupied by the images displayed on each display to complete the motion, calculates the time used to complete the specified motion based on the number of video frames, and at the same time compares the time used by each display to complete the specified motion, that is, the time difference between the time recorded on the instruction recording module 14 when a certain motion appears in video A and the time recorded on the instruction recording module 14 when a certain motion appears in video B and the time recorded on the instruction recording module 14 when a certain motion appears in video C. By comparing the times, the transmission speeds of the instructions in three connection methods with the wireless gamepad circuit board are obtained;

[0093] The motion posture comparison module 32 receives the motion images captured by the motion state capture module 23 and the standard motion template data in the standard motion template module 21, and then compares the postures of the video frames of the completed motion with the corresponding standard motion templates;

[0094] The process of comparing the postures of the video frames with the corresponding standard motion templates is as follows:

[0095] The lines of the images captured by the motion state capture module 23 are sent to the motion posture comparison module 32. At this time, the lines of the images transmitted from the motion state capture module 23 to the motion posture comparison module 32 are all the lines of the video images obtained on the three displays;

[0096] Then the standard motion templates of the standard motion template module 21 are transmitted to the motion posture comparison module 32. The image lines of the characters starting to perform motions obtained on the three displays and the standard motion templates are placed together, and the lines corresponding to each video frame are matched. The matching points here are not related to time. For example, when the gamepad controls the game character to perform a swinging-arm operation, when the motion posture comparison module 32 performs motion posture comparison, any motion during the start of the swinging-arm operation is used, and they are all corresponding, that is, the corresponding motions of the three displays are all the initial motions of the arm lifting first, and the standard motion template is also this motion. Comparing the four corresponding motions together can enable the motion posture comparison module 32 to quickly compare the differences between the motions of the characters displayed on the three displays and the standard motion templates;

[0097] The action response judgment module 33 receives the results of the video frame duration comparison module 31 and the action posture comparison module 32 on the video frames and the action postures. Then, according to the comparison data, it determines the posture and movement of the running action to judge the difference between the image and the standard action. When the action response judgment module 33 makes a judgment, it compares the pictures of each action.

[0098] The conduction judgment unit 4 receives the comparison of the response duration of the human action by the image analysis unit 3 and judges the action posture of the person. Then, it judges the wireless handle according to the comparison result of the response duration and the action posture;

[0099] The conduction judgment unit 4 includes a response duration comparison module 41, an action posture judgment module 42, and a judgment module 43;

[0100] The response duration comparison module 41 receives the time of completing the action on the corresponding display in the frame duration comparison module 31 and the time data of the instruction recorded in the instruction recording module 14. Then, it compares the time when the instruction is issued with the time corresponding to the video frame to determine the response duration of starting and completing the action on each display. At the same time, it compares the response durations among the three displays. In this way, first, the total time for each display to complete the action corresponding to the instruction can be obtained, and at the same time, the time consumed by the corresponding person on the display for each action can also be obtained. This consumed time is the time difference between the time when this action is displayed on the display and the time when the instruction is issued;

[0101] The action posture judgment module 42 receives the result of the action judgment by the action response judgment module 33. After receiving it, it arranges the contours corresponding to the images segmented from the video images on the three displays in the order of the video frames to form a video of the action contour. Then, it combines the video of the action contour with the video of the standard action. Then, it compares the action contour videos corresponding to the three displays with the standard action video for the corresponding actions to determine the distortion degree of the action posture;

[0102] The evaluation module 43 combines the comparison result of the reaction duration by the reaction duration comparison module 41 and the comparison result of the action posture in the action posture judgment module 42 to evaluate the operation performance of the wireless gamepad circuit board. At this time, the evaluation module 43 combines the data in the reaction duration comparison module 41 and the action posture judgment module 42, so that the evaluation module 43 combines the total time of the actions corresponding to the instruction displayed on the three displays and the time consumed by the corresponding person for each action with the distortion degree information of the action posture by the action posture judgment module 42 to make a judgment on the difference between wired and wireless. When the judged difference is within the qualified range specified by the company, it means that the electronic components installed on the wireless gamepad circuit board are all qualified and meet the factory standard of the wireless gamepad circuit board. After an action evaluation is completed, it feeds back to the line connection control module 11, so that the line connection control module 11 outputs an instruction for the next action according to the instruction of the instruction output module 12. Through repeated tests several times, the test effect of the wireless gamepad circuit board is improved to ensure that each wireless gamepad circuit board leaving the factory is qualified.

[0103] The data acquisition unit 1 connects the gamepad in a wired, wireless, and wired - combined - wireless manner, and outputs instructions to operate the gamepad. During the operation of the gamepad, it captures the images displayed on the monitor, obtains the reaction videos of the game characters on the three monitors, and the image processing unit 2 establishes a standard action template, and divides the video frames of the reaction videos obtained by the data acquisition unit 1, so as to accurately obtain the time for each monitor to respond to the instructions of the gamepad. At the same time, the image processing unit 2 captures the actions of the game characters in the divided images, obtains the action conditions of the game characters on each monitor under the instructions, and the image analysis unit 3 compares the standard action template established by the image processing unit 2 with the actual actions of the game characters on each monitor, so as to obtain the difference between the actions of the game characters on the monitor and the standard action template, and the conduction judgment unit 4 combines the reaction time of the action and the posture of the action to judge the situation of delayed transmission of the gamepad. By ensuring the reaction situation of the wireless gamepad according to the wired, wireless, and wired - combined - wireless connection methods, the reaction speed of the wireless gamepad in use can be obtained more accurately, ensuring that each wireless gamepad is qualified before leaving the factory.

[0104] The basic principles, main features and advantages of the present invention have been shown and described above. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and the descriptions in the specification are only preferred examples of the present invention and are not used to limit the present invention. Without departing from the spirit and scope of the present invention, the present invention will have various changes and improvements, and these changes and improvements all fall within the scope of the present invention claimed. The scope of protection claimed by the present invention is defined by the appended claims and their equivalents.

Claims

1. A wireless game controller stability analysis system based on image analysis, characterized by: It comprises a data acquisition unit (1), an image processing unit (2), an image analysis unit (3) and a conduction judgment unit (4); The data acquisition unit (1) is used to connect the circuit on the wireless handle circuit board and connect the wireless handle circuit board to the three displays respectively. After the wireless handle circuit board is connected, a command is input to the wireless handle circuit board so that the wireless handle circuit board responds to the command accordingly. After the wireless handle circuit board responds to the command, the images on the three displays are captured. The data acquisition unit (1) further comprises a video motion capture module (13), and the image processing unit (2) comprises a standard motion template module (21); The image processing unit (2) establishes a standard action template according to the official action of the game, receives the images captured by the data acquisition unit (1) on the three displays, divides the received images into video frames, and then captures the character actions in the divided video frames; The image processing unit (2) further comprises a video frame segmentation module (22) and a motion state capture module (23); The video frame segmentation module (22) is used to receive the image video displayed on three displays captured by the video motion capture module (13), and after receiving the image video, segment the image video according to the video frame so that the video forms a single picture; The action state capturing module (23) recognizes and captures the action of the person in the picture segmented by the video frame segmentation module (22); The image analysis unit (3) compares the action postures of the three displays according to the character actions captured by the image processing unit (2), and determines the action response according to each time point; The image analysis unit (3) comprises a frame duration comparison module (31), an action posture comparison module (32) and an action reaction judgment module (33); The frame duration comparison module (31) receives the segmented video images from the video frame segmentation module (22), obtains the video frames occupied by the image displayed on each display to complete the action, calculates the time taken to complete the specified action based on the number of video frames, and compares the time taken by each display to complete the specified action; The action posture comparison module (32) receives the action image captured by the action state capture module (23) and the standard action template data in the standard action template module (21), and then compares the posture of the video frame of the completed action with the corresponding standard action template; The action reaction judgment module (33) receives the results of the comparison of the video frame and the action posture by the frame duration comparison module (31) and the action posture comparison module (32), and then determines the posture and the motion of the running action based on the compared data to judge the difference between the image and the standard action; The transmission judgment unit (4) receives the image analysis unit (3) to compare the reaction time of the character's action, judges the character's action posture, and then judges the wireless controller according to the reaction time comparison result and the action posture; The conduction judgment unit (4) comprises an action posture judgment module (42), wherein the action posture judgment module (42) receives the result of action judgment by the action reaction judgment module (33), and after receiving the result, arranges the contours corresponding to the images of the image video segmentation on the three displays in the order of the video frames to form a video of the action contour, and then combines the video of the action contour and the video of the standard action together, and then compares the action contour videos corresponding to the three displays with the standard action video for corresponding actions to determine the degree of distortion of the action posture.

2. The wireless game controller stability analysis system based on image analysis according to claim 1, characterized in that: The data acquisition unit (1) comprises a line connection control module (11), an instruction output module (12) and an instruction recording module (14); The line connection control module (11) is used to control a circuit connection device for electrically connecting to a wireless handle circuit board, and after the circuit connection of the wireless handle circuit is completed, connect the wireless handle circuit to three displays, wherein the wireless handle circuit and the three displays are connected in the following ways: wireless, wired, and a combination of wired and wireless; The command output module (12) is used to transmit commands to the wireless handle circuit board, so that the wireless handle circuit board performs corresponding operations; The instruction recording module (14) records the instructions output by the instruction output module (12), and also records the time point when the instructions are output.

3. The wireless game controller stability analysis system based on image analysis according to claim 2, characterized in that: After the instruction output module (12) outputs the instruction, the video motion capture module (13) captures the motion of the image videos on the three displays. At the same time, the video motion capture module (13) also captures the character motion provided by the game official, and after the video motion capture is completed, it is transmitted to the image processing unit (2); The standard action template module (21) is used to define the video of the character action captured by the video action capture module (13) as a standard action, and to create a template for the video content.

4. The wireless game controller stability analysis system based on image analysis according to claim 2, characterized in that: The steps of the video frame segmentation module (22) segmenting the image video according to the video frames are as follows: S1. First, the images and videos obtained on the three displays are numbered to distinguish the three images and videos; S2, reading a number of video frames in each image video, and numbering the images in each video frame according to the corresponding time; S3, according to the position of the video frame, the graphics displayed in each video frame are extracted separately, and a plurality of images are formed at this time; S4. Use the Canny edge detection operator algorithm to obtain the outline of the person in each image, and arrange the obtained outlines of several images according to the image numbers.

5. The wireless game controller stability analysis system based on image analysis according to claim 4, characterized in that: The steps of the algorithm of the Canny edge detection operator are: ①, perform Gaussian filtering on the image; ② Use the directional gradient operator to calculate the directional gradient of the image and the direction of the gradient; ③. Perform non-maximum suppression; ④. Use dual threshold technology for edge hysteresis; ⑤. Get the edge of the image.

6. The wireless game controller stability analysis system based on image analysis according to claim 4, characterized in that: The conduction judgment unit (4) comprises a reaction time comparison module (41) and a judgment module (43); The reaction time comparison module (41) receives the time of completing the action on the corresponding display in the frame time comparison module (31) and the time data of the instruction recorded in the instruction recording module (14), and then compares the time when the instruction is issued with the time corresponding to the video frame to determine the reaction time of starting the movement and completing the action on each display, and compares the reaction time between the three displays at the same time; The evaluation module (43) evaluates the operating performance of the wireless handle circuit board by combining the comparison result of the reaction time by the reaction time comparison module (41) and the comparison result of the action posture by the action posture judgment module (42), and after the evaluation of an action is completed, feedback is given to the line connection control module (11), so that the line connection control module (11) performs the instruction output of the next action according to the instruction of the instruction output module (12).

Images