Remote data testing method and device based on equipment mutual shooting, equipment and medium

Abstract

The invention relates to the technical field of equipment testing, and discloses a remote data testing method and device based on equipment mutual shooting, equipment and a medium. The method comprises the following steps: acquiring a shooting picture of a shooting device for a test device; performing conversion processing on the shot picture, and triggering a test equipment screen corresponding to the shot picture to be displayed on a shooting equipment screen; generating a test operation aiming at the test equipment based on an operation generated aiming at the screen of the shooting equipment, mapping the test operation to the test equipment, and displaying an operation process of the test equipment on the screen of the test equipment; and controlling the shooting equipment to carry out screen recording on the operation process to obtain remote test data for the test equipment. By implementing the technical scheme of the invention, a screen projection stream of the test equipment does not need to be called, the influence of the screen projection stream on the test equipment is reduced, the output of remote test data and local test are ensured to be unbiased, and the accuracy of a remote test result is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of device testing, and in particular to a remote data testing method, device, equipment and medium based on device mutual shooting. Background Art

[0002] Software real-machine testing is an inevitable part of the entire software testing and software iteration process. The main purpose of software real-machine testing is to allow the tested software to simulate running in the environment of actual users' real devices (different models and network environments, etc.), and obtain software performance data that is closest to the actual user usage scenarios under different models, so as to determine the most likely potential problems under different models and network environments, thereby ensuring the comprehensiveness, authenticity and reliability of software testing.

[0003] Then, the current software real machine testing in related technologies either requires manual calibration or requires turning on the built-in screen recording of the test equipment. Manual calibration not only consumes a large amount of manpower costs, but also makes it difficult to ensure the reliability of calibration; the built-in screen recording will affect the performance of the test equipment, resulting in the inability to fully simulate the user's real operation scenario, affecting the test effect. Summary of the invention

[0004] In view of this, the embodiments of the present disclosure provide a remote data testing method, apparatus, device and medium based on device mutual shooting to solve the problem of poor software real machine testing effect.

[0005] In a first aspect, an embodiment of the present disclosure provides a remote data testing method based on mutual shooting of devices, which is used for a visualization platform. The visualization platform is remotely connected to a shooting device and a test device respectively. The shooting device is used to shoot the test device. The method includes: obtaining a shooting picture of the test device by the shooting device; transforming the shooting picture to trigger the display of a test device screen corresponding to the shooting picture on the shooting device screen; generating a test operation for the test device based on the operation generated on the shooting device screen, mapping the test operation to the test device, and displaying the operation process of the test device on the test device screen; controlling the shooting device to record the operation process to obtain remote test data for the test device.

[0006] The remote data testing method based on device mutual shooting provided by the disclosed embodiment shoots the screen of the test device through the shooting device, converts the screen of the test device to the screen of the shooting device, and then maps the operations performed on the screen of the shooting device to the test device, and displays the corresponding operation process on the screen of the test device, thereby realizing the test operation of the test device through the shooting device, and recording the operation process on the screen of the test device through the shooting device, realizing the test effect that can be achieved by the screen projection stream of the test device. Moreover, the test process does not need to call the screen projection stream of the test device, which reduces the impact of the screen projection stream on the test device, ensures the output of remote test data and the unbiased local test, and improves the accuracy of remote test results.

[0007] In a second aspect, an embodiment of the present disclosure provides a test equipment bracket, which is applied to the remote data testing method based on mutual shooting of devices in the first aspect or any corresponding implementation thereof, and the test equipment bracket includes: a slide rail assembly; at least one pair of equipment brackets, which are slidably mounted on the slide rail assembly, and under the action of external force, the pair of equipment brackets have a first position close to each other and a second position away from each other when sliding on the slide rail assembly.

[0008] The test equipment bracket provided in the embodiment of the present disclosure is provided with at least one pair of equipment brackets to place the shooting equipment and the test equipment in pairs, so as to facilitate the shooting and screen recording of the test equipment by the shooting equipment. At the same time, the equipment bracket can slide on the slide rail assembly, so as to realize the flexible adjustment of the placement positions of the shooting equipment and the test equipment, and improve the shooting effect of the shooting equipment on the test equipment.

[0009] In the third aspect, an embodiment of the present disclosure provides a remote data testing device based on mutual shooting of devices, which is used for a visualization platform. The visualization platform is remotely connected to a shooting device and a test device respectively. The shooting device is used to shoot the test device. The device includes: an acquisition module, which is used to acquire a shooting picture of the test device screen by the shooting device; a transformation module, which is used to transform the shooting picture, and trigger the display of the test device screen corresponding to the shooting picture on the shooting device screen; a test operation generation module, which is used to generate a test operation for the test device based on the operation generated for the shooting device screen, and map the test operation to the test device, and display the operation process of the test device on the test device screen; a screen recording control module, which is used to control the shooting device to record the operation process to obtain remote test data for the test device.

[0010] In a fourth aspect, an embodiment of the present disclosure provides a computer device, comprising: a memory and a processor, the memory and the processor are communicatively connected to each other, computer instructions are stored in the memory, and the processor executes the remote data testing method based on mutual shooting of devices according to the above-mentioned first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0011] In a fifth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the remote data testing method based on mutual shooting of devices according to the first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0013] Figure 1 is a flowchart of a remote data testing method based on mutual shooting of devices according to some embodiments of the present disclosure;

[0014] Figure 2 is a schematic diagram of a shooting device screen and a testing device screen according to some embodiments of the present disclosure;

[0015] Figure 3 is a flowchart of another remote data testing method based on mutual shooting of devices according to some embodiments of the present disclosure;

[0016] Figure 4 is a schematic diagram of point calibration according to some embodiments of the present disclosure;

[0017] Figure 5 is a schematic diagram of generating a target screen projection stream on a shooting device according to some embodiments of the present disclosure;

[0018] Figure 6 is a comparison diagram of shooting display range adjustment of shooting devices according to some embodiments of the present disclosure;

[0019] Figure 7 is a schematic diagram of a test equipment stand according to some embodiments of the present disclosure;

[0020] Figure 8 is a structural block diagram of a remote data testing device based on device mutual shooting according to an embodiment of the present disclosure;

[0021] Fig. 9It is a schematic diagram of the hardware structure of the computer device of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0023] At present, there are mainly three solutions for software real machine testing:

[0024] (1) The tester manually restores the target test scenario, that is, manually operates the device to perform operations in different software scenario links, and records and replays them through the screen recorder of the built-in device. After recording, the screen recording of the test scenario operation is manually calibrated.

[0025] (2) Write an automated test script for the corresponding test scenario, automatically simulate the operations of the target scenario through ADB bridging (including automatically starting / ending screen recording), and manually calibrate the screen recording of the test scenario operation after recording is completed.

[0026] (3) Device visualization: The device screen is represented by a projection stream, so that remote operation and screen recording can be performed on the visualization platform to simulate the target scene operation. After the recording is completed, manual calibration is performed on the screen recording of the test scene operation. Of course, this solution also supports the remote delivery of automated scripts.

[0027] The second solution is equivalent to the automated version of the first solution. The automated scripts introduced replace manual operations, reducing labor costs and improving efficiency in the operation process. The third solution is equivalent to the remote operation solution of the first solution and covers the capabilities of the first and second solutions. It does not require the equipment and testers to be in the same area, which improves cross-regional remote testing operations.

[0028] However, the above three solutions all have the following defects: since it is necessary to turn on the built-in screen recording of the test device itself, it is impossible to fully simulate the user's actual operation scenario. In addition, the third remote operation solution requires screen mirroring of the device itself. In actual use, users will not turn on the built-in screen recording and screen projection to perform software operations. The built-in screen recording has a certain degree of loss on the performance of the test device itself, resulting in the obtained test data not being the most reliable and real, and the test results cannot be fully used and can only be used as a reference.

[0029] Based on this, the technical solution disclosed in the present invention uses a shooting device to shoot the screen of the test device, converts the screen of the test device to the screen of the shooting device, and then maps it to the screen of the test device by operating on the screen of the shooting device. The test process does not need to call the screen projection stream of the test device, which reduces the impact of the screen projection stream on the test device, ensures the output of remote test data and the unbiased local test, and improves the accuracy of the remote test results.

[0030] According to an embodiment of the present disclosure, an embodiment of a remote data testing method based on mutual shooting of devices is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0031] In this embodiment, a remote data testing method based on mutual shooting of devices is provided, which can be used for the above-mentioned visualization platform. The visualization platform is constructed by computer devices such as computers and servers, and the visualization platform is remotely connected to the shooting device and the testing device respectively. Figure 1 is a flow chart of a remote data testing method based on device mutual shooting according to an embodiment of the present disclosure, such as Figure 1 As shown, the process includes the following steps:

[0032] Step S101, obtaining a picture taken by a shooting device on a test device.

[0033] The shooting device and the test device are placed in relative positions, and the camera of the shooting device is aimed at the screen of the test device, so that the shooting device can shoot the test device. The visualization platform is connected to the shooting device and the test device respectively, and communicates with the shooting device and the test device remotely through the debugging tool, for example, communicating with the shooting device and the test device of the Android system through the Android Debug Bridge (ADB).

[0034] Specifically, after starting the test process for the test device, the shooting device and the test device are started through the visualization platform, and the camera of the shooting device is started at the same time, and the screen of the test device is shot through the camera of the shooting device to obtain the shooting picture for the test device. The shooting device sends the captured shooting picture to the visualization platform, and accordingly, the visualization platform can receive the shooting picture and display the shooting picture in the display interface of the visualization platform.

[0035] For example, a screen mirroring program is provided in an Android shooting device, and the visualization platform can view and control the shooting device through the screen mirroring program, so as to realize remote testing by controlling the shooting device to shoot the test device.

[0036] Step S102, performing transformation processing on the captured image, triggering display of the test device screen corresponding to the captured image on the capture device screen.

[0037] In order to ensure that the shooting device can capture the entire test device screen, there is a certain shooting distance between the shooting device and the test device. Therefore, the shooting picture includes the test device screen and the test device frame, such as Figure 2 After obtaining the captured image, the captured image is transformed through the visualization platform to correct the view deviation of the captured image, and the image of the test device screen is extracted from the captured image to fully display the image of the test device screen on the capture device screen.

[0038] Step S103 , generating a test operation for the test device based on the operation generated on the screen of the shooting device, mapping the test operation to the test device, and displaying the operation process of the test device on the screen of the test device.

[0039] The shooting screen displays the complete test device screen, and the tester can perform operations on the shooting device screen through the visualization platform, such as clicking operations, opening applications, etc. Correspondingly, the visualization platform can map the operations generated on the shooting device screen to the test device, that is, the operations generated on the shooting device screen are used as test operations for the test device, so that the test device can respond to the test operation and display the operation process corresponding to the test operation on the test device screen.

[0040] Step S104, controlling the camera to record the operation process to obtain remote test data for the test device.

[0041] When the visualization platform completes the delivery of the test operation, it turns on the screen recording function of the camera to record the operation process of the test device in response to the test operation and perform the test function, and generates a corresponding screen recording file to be transmitted to the visualization platform. For example, the test device responds to the test operation to open application A and enter the display interface of application A.

[0042] Correspondingly, the visualization platform can obtain the test screen recording file of the shooting device for the test device, and generate remote test data for the test device by analyzing the test screen recording file.

[0043] The remote data testing method based on mutual shooting of devices provided in this embodiment uses a shooting device to shoot the screen of the test device, converts the screen of the test device to the screen of the shooting device, and then maps the operations performed on the screen of the shooting device to the test device, and displays the corresponding operation process on the screen of the test device, thereby realizing the test operation of the test device through the shooting device, and recording the operation process on the screen of the test device through the shooting device, realizing the test effect that can be achieved by the screen projection stream of the test device. Moreover, the test process does not need to call the screen projection stream of the test device, which reduces the impact of the screen projection stream on the test device, ensures the output of remote test data and the unbiased local test, and improves the accuracy of remote test results.

[0044] In this embodiment, a remote data testing method based on mutual shooting of devices is provided, which can be used for the above-mentioned visualization platform. The visualization platform is constructed by computer devices such as computers and servers, and the visualization platform is remotely connected to the shooting device and the testing device respectively. Figure 3 is a flow chart of a remote data testing method based on device mutual shooting according to an embodiment of the present disclosure, such as Figure 3 As shown, the process includes the following steps:

[0045] Step S201, obtaining a picture taken by a camera for a test device. For detailed description, please refer to the relevant description of the above embodiment, which will not be repeated here.

[0046] Step S202, transforming the captured image to trigger display of the test device screen corresponding to the captured image on the capture device screen.

[0047] Specifically, the above step S202 may include:

[0048] Step S2021, obtaining screen display parameters of the test device.

[0049] The screen display parameters are used to characterize the screen display properties of the test device. Specifically, the screen display parameters may include screen resolution, screen refresh rate, screen contrast, etc., which are not specifically limited here. The test device and the visualization platform are remotely connected in communication, and the visualization platform can read the relevant device parameters of the test device and obtain the corresponding screen display parameters therefrom.

[0050] Step S2022: determining the point information of the screen outline based on the screen outline corresponding to the captured image.

[0051] The screen outline is the geometric shape of the test device screen in the captured image. The screen outline can include polygons, circles, and other closed geometric shapes. The point information is the key points that constitute the screen outline. The point information can be determined by analyzing the points that constitute the screen outline. Figure 2Taking the irregular quadrilateral shown as an example, its point information is the four vertices corresponding to the irregular quadrilateral.

[0052] In some optional implementations, the above step S2022 may include:

[0053] Step a1: displaying a screen outline corresponding to the shooting picture in a visualization interface of a visualization platform.

[0054] Step a2: in response to a point calibration operation on the screen contour, determining point information of the screen contour based on the point calibration operation.

[0055] The shooting device can transmit the captured images of the test device to the visualization platform, and the visualization platform can display the captured images in a visualization interface. The captured images include the screen image of the test device, so that the remote tester can determine the screen outline of the test device from the screen image.

[0056] The point calibration operation is an operation in which the tester calibrates key points from the screen outline through the visualization platform. Specifically, the point calibration operation can be triggered by the tester through the input device of the mouse or keyboard. Accordingly, the visualization platform can respond to the point calibration operation triggered by the tester and determine the key points selected by the point calibration operation, that is, the point information corresponding to the screen outline.

[0057] In a specific implementation, the tester can perform point calibration operations in a clockwise or counterclockwise manner, such as Figure 4 As shown, the vertices of the irregular quadrilateral are marked in a clockwise manner.

[0058] In the above implementation, the test device screen in the shooting picture is calibrated with the help of a visual interface, so that the test device screen can be displayed in the shooting device screen in the form of a plane perspective through point calibration, thereby ensuring the matching degree between the shooting device screen and the test device screen.

[0059] Step S2023, based on the point information and screen display parameters, the captured image is perspective transformed to generate a target projection stream for the captured image.

[0060] The target screen projection stream is generated on the shooting device by calling the screen projection function of the shooting device to generate a screen projection stream for the shooting screen of the test device, thereby achieving an effect similar to that of turning on the screen projection stream on the test device through the screen projection stream of the shooting device.

[0061] The actual screen size information of the test device can be determined by combining the screen display parameters. Then, the calibrated point information is used as the initial point, and the target point is determined according to the actual screen size information. The screen image in the captured image is transformed in perspective according to the initial point and the target point, so that a target projection stream for the captured image can be formed on the camera.

[0062] In some optional implementations, the above step S2023 may include:

[0063] Step b1, based on the point information and screen display parameters, generate an initial screen projection stream corresponding to the captured image on the shooting device.

[0064] Step b2: Use perspective transformation to convert the initial projection stream into the target projection stream.

[0065] The visualization platform can call the screen projection function of the shooting device to generate an initial screen projection stream according to the point information and screen display parameters. Then, the visualization platform can enter the new screen projection stream push room, and send the point information and the screen display parameters of the test device to the server of the visualization platform through the network transmission protocol (such as websocket), and send the push room number to the server. As a result, the server of the visualization platform can convert the initial screen projection stream into the target screen projection stream through perspective transformation and add it to the push room.

[0066] Perspective transformation is the process of converting an image from one viewpoint to another while keeping straight lines continuous and parallel.

[0067] In the above implementation, by obtaining the point information and screen display parameters of the test device screen, the screen projection function of the shooting device is called to generate a screen projection stream for the test device screen in the shooting device, so that the test device transmits any screen projection stream data, thereby obtaining more accurate test data in the actual test phase.

[0068] Step S2024, displaying the test device screen on the shooting device screen based on the target screen projection stream.

[0069] The visualization platform can subscribe to the target screen projection stream generated in the streaming room for streaming. Specifically, the visualization platform can stream the subscribed target screen projection stream to the shooting device for display, so as to achieve the effect of displaying the test device screen through the shooting device screen, such as Figure 5 shown.

[0070] Step S203 , generating a test operation for the test device based on the operation generated on the screen of the shooting device, mapping the test operation to the test device, and displaying the operation process of the test device on the screen of the test device.

[0071] Specifically, the above step S203 may include:

[0072] Step S2031: forward the operation generated on the screen of the shooting device to the test device, and generate a test operation on the test device.

[0073] The tester operates the screen of the shooting device through the visualization platform, and the visualization platform captures the operations generated on the shooting device screen and determines the captured operations as test operations for the test device. Then, the visualization platform can forward the operations generated on the shooting device screen that it captures to the test device to generate test operations for the test device. Correspondingly, the test device can receive the test operation and respond, thereby realizing the mapping of the test operation to the test device and achieving the effect of operating the test device screen through the shooting device screen.

[0074] Step S2032: Based on the response result of the test device to the test operation, the operation process corresponding to the test operation is displayed on the screen of the test device.

[0075] After receiving the test operation issued by the visualization platform, the test device can respond to the test operation issued by the visualization platform and display the operation process generated in response to the test operation on the test device screen, thereby achieving an effect similar to that of the tester operating directly on the test device screen.

[0076] Step S204, control the camera to record the operation process, and obtain remote test data for the test device. For detailed description, please refer to the relevant description of the above embodiment, which will not be repeated here.

[0077] The remote data testing method based on device mutual shooting provided in this embodiment obtains the screen display parameters of the test device and combines the point information of the screen contour of the test device to perform perspective transformation on the shooting picture to correct the view deviation of the test device screen in the shooting device screen. At the same time, a screen projection stream of the test device screen is generated on the shooting device to display the test device screen on the shooting device screen. In this way, screen projection for the test device is achieved through the shooting device.

[0078] As an optional implementation, before acquiring the captured image of the test device by the capturing device, the method may further include:

[0079] Step c1, obtaining a first current position of the shooting device and a second current position of the testing device.

[0080] Step c2, detecting whether the screen of the test device can completely appear on the screen of the shooting device.

[0081] Step c3: when the test device screen does not completely appear on the shooting device screen, adjust the first current position and / or the second current position.

[0082] The first current position is the current spatial position of the shooting device, and the second current position is the current spatial position of the test device, and there is a certain distance between the first current position and the second current position. The visualization platform controls the shooting device to turn on the camera function to shoot the screen of the test device, and combines the shooting picture uploaded by the shooting device to determine whether the test device screen can appear completely on the shooting device screen.

[0083] When the screen of the test device does not appear completely on the screen of the shooting device, it means that the distance between the first current position of the shooting device and the second current position of the test device is not appropriate and needs to be adjusted. At this time, corresponding adjustment instructions can be generated to automatically adjust the first current position of the shooting device and / or the second current position of the test device.

[0084] Of course, adjustment reminder information may also be generated and sent to personnel who place the photographing equipment and the testing equipment to remind the personnel to adjust the first current position of the photographing equipment and / or the second current position of the testing equipment.

[0085] When the screen of the test device can completely appear on the screen of the shooting device, it means that the distance between the first current position of the shooting device and the second current position of the test device is appropriate. At this time, the screen of the test device can be directly shot by the shooting device.

[0086] The remote data testing method based on mutual shooting of devices provided in this embodiment avoids the problem of incomplete display of the test device screen and affecting the test by detecting whether the test device screen can be completely displayed on the shooting device screen. At the same time, by adjusting the placement of the shooting device and the test position, it can ensure that the test device screen is fully displayed on the shooting device screen to the greatest extent, so as to ensure the test accuracy in the subsequent test links.

[0087] As an optional implementation, before acquiring the captured image of the test device by the capturing device, the method may further include: in response to a capturing adjustment operation on the capturing device, adjusting a capturing display range of the capturing device based on the capturing adjustment operation.

[0088] The shooting adjustment operation is the adjustment made by the tester to the shooting display screen of the shooting device. Through this shooting adjustment operation, the enhanced shooting function of the shooting device (such as Figure 6left), and call up the native camera function of the shooting device (such as Figure 6 Correspondingly, the visualization platform can send the shooting adjustment operation to the shooting device, and adjust the shooting function of the shooting device to the native camera function, so as to expand the shooting display range.

[0089] The remote data testing method based on mutual shooting of devices provided in this embodiment improves the visible screen ratio of the shooting device by adjusting the shooting display range of the shooting device, greatly reduces the situation where the test device cannot be fully displayed within the shooting display range of the shooting device, and reduces the possibility of manual intervention.

[0090] In this embodiment, a test device bracket is provided, which can be used in the above-mentioned remote data testing method based on mutual shooting of devices. Figure 7 is a schematic diagram of a test equipment bracket according to an embodiment of the present disclosure, such as Figure 7 As shown, the test equipment bracket includes: a slide rail assembly 1 and at least one pair of equipment brackets 2.

[0091] The slide rail assembly 1 is a straight structure for fixing the equipment bracket.

[0092] The two device sub-racks in the pair of device racks 2 are both slidably mounted on the slide rail assembly 1. Under the action of external force, the two device sub-racks in the pair of device racks 2 have a first position close to each other and a second position away from each other when sliding on the slide rail assembly 1.

[0093] Specifically, the two device sub-racks in a pair of device racks 2 can slide under human intervention or automatically under driving. When the two device sub-racks slide on the slide rails, they have a first position close to each other and a second position away from each other.

[0094] The test equipment bracket provided in this embodiment is provided with at least one pair of equipment brackets to place the shooting equipment and the test equipment in pairs, so as to facilitate the shooting and screen recording of the test equipment by the shooting equipment. At the same time, the equipment bracket can slide on the slide rail assembly, so as to realize the flexible adjustment of the placement positions of the shooting equipment and the test equipment, and improve the shooting effect of the shooting equipment on the test equipment.

[0095] In some optional embodiments, each device sub-bracket in the pair of device brackets 2 includes a slide 21 and a driving device 22 .

[0096] Among them, the slide seat 21 is provided with a fixing position for installing the shooting device or the testing device. The shooting device or the testing device is driven to slide on the slide rail assembly 2 by the slide seat 21 to achieve position adjustment of the shooting device and the testing device.

[0097] Among them, the driving device 22 is arranged in the slide 21 (not shown in the figure), which can drive the slide 21 to slide on the slide rail assembly 2 under the driving action, so as to realize the shooting equipment and the testing equipment to approach or move away from each other, thereby flexibly adjusting the distance between the shooting equipment and the testing equipment.

[0098] The test equipment bracket provided in this embodiment realizes automatic adjustment of the placement positions of the photographing equipment and the test equipment by arranging a driving device in the slide seat, thereby improving the intelligence of the adjustment of the placement positions.

[0099] In some optional embodiments, the driving device 22 is communicatively connected to the visualization platform and is suitable for receiving a position adjustment instruction for the slide issued by the visualization platform.

[0100] The position adjustment instruction is an instruction generated by the visualization platform when it determines that the distance between the shooting device and the test device cannot satisfy the requirement that the test device screen is fully displayed on the shooting device screen. The visualization platform is connected to the drive device 22 in communication, and can send the position adjustment instruction generated by it to the drive device 22. Accordingly, the drive device 22 can receive the position adjustment instruction and adjust the positions of the two slides 21 corresponding to a pair of device brackets 1 according to the position adjustment instruction to ensure that the distance between the shooting device and the test device can satisfy the requirement that the test device screen is fully displayed on the shooting device screen.

[0101] The test equipment bracket provided in this embodiment facilitates remote control of the position adjustment of the shooting equipment and the test equipment by communicating with the visualization platform, thereby maximizing the convenience of remote testing.

[0102] In this embodiment, a remote data testing device based on mutual shooting of devices is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and will not be repeated here. As used below, the term "module" can implement a combination of software and / or hardware for a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0103] This embodiment provides a remote data testing device based on mutual shooting of devices, which is used for a visualization platform. The visualization platform is remotely connected to a shooting device and a testing device respectively. Figure 8 As shown, including:

[0104] The acquisition module 401 is used to acquire a picture captured by a shooting device on the screen of a test device.

[0105] The transformation module 402 is used to transform the captured image and trigger the display of the test device screen corresponding to the captured image on the capture device screen.

[0106] The test operation generating module 403 is used to generate a test operation for the test device based on the operation generated on the shooting device screen, map the test operation to the test device, and display the operation process of the test device on the test device screen.

[0107] The screen recording control module 404 is used to control the shooting device to record the operation process and obtain remote test data for the test device.

[0108] In some optional implementation modes, the transformation module 402 may include:

[0109] The display parameter acquisition unit is used to acquire the screen display parameters of the test device.

[0110] The point determination unit is used to determine the point information of the screen contour based on the screen contour corresponding to the captured image.

[0111] The perspective transformation unit is used to perform perspective transformation on the captured image based on point information and screen display parameters, and generate a target projection stream for the captured image.

[0112] The display unit is used to display the test device screen on the shooting device screen based on the target screen projection stream.

[0113] In some optional implementations, the point determination sheet may include:

[0114] The contour display subunit is used to display the screen contour corresponding to the shooting picture in the visualization interface of the visualization platform.

[0115] The calibration subunit is used to respond to the point calibration operation on the screen contour and determine the point information of the screen contour based on the point calibration operation.

[0116] In some optional implementations, the perspective transformation unit may include:

[0117] The screen projection stream generation subunit is used to generate an initial screen projection stream corresponding to the captured image on the shooting device based on the point information and screen display parameters.

[0118] The projection stream conversion subunit is used to convert the initial projection stream into the target projection stream by using perspective transformation.

[0119] In some optional embodiments, the test operation generating module 403 may include:

[0120] The operation forwarding unit is used to forward the operation generated on the screen of the shooting device to the test device, and generate a test operation on the test device.

[0121] The test operation determination unit is used to display the operation process corresponding to the test operation on the screen of the test device based on the response result of the test device to the test operation.

[0122] As an optional implementation, the above device may further include:

[0123] The position acquisition module is used to acquire the first current position of the shooting device and the second current position of the testing device.

[0124] The detection module is used to detect whether the test device screen can completely appear on the shooting device screen.

[0125] The position adjustment module is used to adjust the first current position and / or the second current position when the test device screen does not appear completely on the shooting device screen.

[0126] As an optional implementation, the above device may further include:

[0127] The shooting adjustment module is used to respond to a shooting adjustment operation on the shooting device and adjust the shooting display range of the shooting device based on the shooting adjustment operation.

[0128] The further functional description of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0129] The remote data testing device based on device mutual shooting in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0130] The remote data testing device based on mutual shooting of devices provided in this embodiment shoots the screen of the test device through the shooting device, converts the screen of the test device to the screen of the shooting device, and then operates on the screen of the shooting device to correspond to the screen of the test device, thereby realizing the test operation of the test device through the shooting device, and recording the test process of the test device through the shooting device, realizing the test effect that can be achieved by the screen projection stream of the test device. Moreover, the test process does not need to call the screen projection stream of the test device, which reduces the impact of the screen projection stream on the test device, ensures the output of remote test data and the unbiased local test, and improves the accuracy of remote test results.

[0131] The present disclosure also provides a computer device having the above Figure 8 The remote data testing device based on mutual shooting of devices is shown.

[0132] See also Fig. 9 , Fig. 9 is a schematic diagram of a computer device provided by an optional embodiment of the present disclosure, such as Fig. 9 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Fig. 9 A processor 10 is taken as an example.

[0133] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.

[0134] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.

[0135] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0136] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.

[0137] The computer device also includes an input device 30 and an output device 40. The processor 10, the memory 20, the input device 30 and the output device 40 may be connected via a bus or other means. Fig. 9 The example of connecting through bus is taken in the following.

[0138] The input device 30 can receive input digital or character information, and generate key signal input related to the user settings and function control of the computer device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick, etc. The output device 40 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The above-mentioned display device includes but is not limited to a liquid crystal display, a light emitting diode, a display and a plasma display. In some optional embodiments, the display device can be a touch screen.

[0139] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.

[0140] The embodiments of the present disclosure also provide a computer-readable storage medium. The above-mentioned method according to the embodiments of the present disclosure can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium and downloaded through a network, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state drive, etc.; further, the storage medium can also include a combination of the above-mentioned types of memory. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0141] Although the embodiments of the present disclosure have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present disclosure, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A remote data testing method based on mutual shooting of devices, characterized in that: Used for a visualization platform, the visualization platform is remotely connected to a shooting device and a test device respectively, the shooting device is used to shoot the test device, and the method includes: Acquire a picture captured by the shooting device on the test device; Performing transformation processing on the shooting picture, triggering display of a test device screen corresponding to the shooting picture on the shooting device screen; Generating a test operation for the test device based on the operation generated on the screen of the shooting device, mapping the test operation to the test device, and displaying the operation process of the test device on the screen of the test device; The shooting device is controlled to record the operation process to obtain remote test data for the test device.

2. The method according to claim 1, characterized in that The transforming process of the shooting picture to trigger the display of the test device screen corresponding to the shooting picture on the shooting device screen includes: Obtaining screen display parameters of the test device; Based on the screen contour corresponding to the captured image, determining point information of the screen contour; Based on the point information and the screen display parameters, the captured image is perspective transformed to generate a target projection stream for the captured image; The test device screen is displayed on the shooting device screen based on the target screen projection stream.

3. The method according to claim 2, characterized in that The determining, based on the screen contour corresponding to the captured image, point information of the screen contour includes: Displaying a screen outline corresponding to the captured image in a visualization interface of the visualization platform; In response to a point calibration operation on the screen contour, point information of the screen contour is determined based on the point calibration operation.

4. The method according to claim 2, characterized in that: The performing perspective transformation on the captured image based on the point information and the screen display parameters to generate a projection stream for the captured image includes: Based on the point information and the screen display parameters, generating an initial screen projection stream corresponding to the captured image on the shooting device; The perspective transformation is used to convert the initial screen projection stream into the target screen projection stream.

5. The method according to claim 1, characterized in that The step of generating a test operation for the test device based on the operation generated on the screen of the shooting device, mapping the test operation to the test device, and displaying the operation process of the test device on the screen of the test device includes: forwarding the operation generated on the screen of the shooting device to the testing device, and generating the test operation on the testing device; Based on the response result of the test device to the test operation, the operation process corresponding to the test operation is displayed on the screen of the test device.

6. The method according to claim 1, characterized in that Before obtaining the captured image of the test device by the capturing device, the method further includes: Acquire a first current position of the photographing device and a second current position of the testing device; Detecting whether the test device screen can completely appear on the shooting device screen; When the test device screen does not completely appear on the shooting device screen, the first current position and / or the second current position is adjusted.

7. The method according to claim 1, characterized in that Also includes: In response to a photographing adjustment operation for the photographing device, a photographing display range of the photographing device is adjusted based on the photographing adjustment operation.

8. A test equipment bracket, characterized in that: The remote data testing method based on mutual shooting of devices as described in any one of claims 1 to 7 above comprises: Slide rail assembly; At least one pair of equipment brackets are slidably mounted on the slide rail assembly. Under the action of external force, the pair of equipment brackets have a first position close to each other and a second position away from each other when sliding on the slide rail assembly.

9. The test equipment stand according to claim 8, characterized in that: The equipment support comprises: A slide seat, adapted to slide on the slide rail assembly, the slide seat being provided with a fixing position for mounting a photographing device or a testing device; The driving device is arranged on the slide seat. Under the driving action of the driving device, the slide seat has a first position close to each other and a second position away from each other when sliding on the slide rail assembly.

10. The test equipment stand according to claim 9, characterized in that: The driving device is communicatively connected to the visualization platform and is suitable for receiving a position adjustment instruction for the slide issued by the visualization platform.

11. A remote data testing device based on mutual shooting of devices, characterized in that: Used for a visualization platform, the visualization platform is remotely connected to a shooting device and a test device respectively, the shooting device is used to shoot the test device, and the device comprises: An acquisition module, used for acquiring a picture captured by the shooting device on the screen of the test device; A transformation module, used for transforming the captured image to trigger the display of a test device screen corresponding to the captured image on a capture device screen; A test operation generating module, used for generating a test operation for the test device based on the operation generated for the shooting device screen, mapping the test operation to the test device, and displaying the operation process of the test device on the test device screen; The screen recording control module is used to control the shooting device to record the operation process and obtain remote test data for the test device.

12. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the remote data testing method based on mutual shooting of devices as described in any one of claims 1 to 7 by executing the computer instructions.

13. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the remote data testing method based on mutual shooting of devices as described in any one of claims 1 to 7.

Images