A testing method, apparatus, device, and medium

By controlling the robotic arm to interact with the device and acquire page images, the problem of inaccurate device recognition rate in existing technologies is solved, and efficient and accurate recognition rate testing and abnormal state analysis are achieved.

CN122490143APending Publication Date: 2026-07-31ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
ALIPAY (HANGZHOU) INFORMATION TECH CO LTD
Filing Date
2025-01-24
Publication Date
2026-07-31

AI Technical Summary

Technical Problem

In existing technologies, when using the tracking point monitoring method to test the device wake-up recognition rate, there is a problem of inaccurate recognition rate, especially when the device is not successfully woken up, the tracking point code cannot capture relevant data.

Method used

The control arm is used to carry the device to a preset position, interact with the second device, and use the screen projection program to obtain the page image. The device is then activated based on the image similarity to determine the recognition rate and abnormal status.

Benefits of technology

It improves the accuracy and efficiency of device recognition, accurately determines the device recognition rate and identifies abnormal states, and provides directions for improvement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122490143A_ABST
    Figure CN122490143A_ABST
Patent Text Reader

Abstract

This specification discloses a testing method, apparatus, device, and medium. In this scheme, a control terminal controls a robotic arm to carry at least one first device to at least one first preset position multiple times to facilitate interaction with a second device near the first preset position. A screen projection program installed on the control terminal acquires the page image displayed on the first device at each first preset position. Based on the similarity between the page image and a preset standard image, it is determined whether the first device has been successfully invoked by the second device, obtaining judgment result data. Based on the first judgment result data indicating that the first device has been successfully invoked by the second device in each obtained judgment result data, the recognition rate of the second device is determined. Based on the second judgment result data indicating that the first device has not been successfully invoked by the second device in each obtained judgment result data, the abnormal state classification corresponding to the second judgment result data is determined.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a testing method, apparatus, device, and medium. Background Technology

[0002] With the continuous development of computer technology, terminal devices can communicate with other terminal devices using different communication methods to meet business needs. For example, two terminal devices can complete operations such as payment and data transmission through short-range wireless communication, or they can be activated by voice. To ensure that users can process business smoothly, testing is an essential step before putting the equipment or components used for business processing online.

[0003] Therefore, how to perform wake-up detection efficiently and accurately has become an urgent technical problem to be solved. Summary of the Invention

[0004] This specification provides a testing method, apparatus, device, and medium for efficient and accurate call-end testing.

[0005] To solve the above-mentioned technical problems, the embodiments in this specification are implemented as follows:

[0006] This specification provides a test method in its embodiments, including:

[0007] The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device;

[0008] The screen projection program installed in the control terminal is used to obtain the page image displayed on the first device at the first preset position each time.

[0009] Based on the similarity between the page image and the preset standard image, it is determined whether the first device has been successfully woken up by the second device, and the determination result data is obtained; the preset standard page image is the page image displayed after the first device is successfully woken up;

[0010] Based on the first judgment result data indicating that the first device was successfully awakened by the second device in each of the judgment result data obtained, the recognition rate of the second device is determined;

[0011] Based on the second judgment result data in each judgment result that indicates that the first device was not successfully woken up by the second device, the abnormal state category corresponding to the second judgment result data is determined.

[0012] This specification provides a testing apparatus, comprising:

[0013] The control module is used to control the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device;

[0014] The acquisition module is used to acquire the page image displayed on the first device at the first preset position each time using the screen projection program installed in the control terminal;

[0015] The judgment module is used to determine whether the first device has been successfully woken up by the second device based on the similarity between the page image and the preset standard image, and to obtain judgment result data; the preset standard page image is the page image displayed after the first device is successfully woken up;

[0016] The recognition rate determination module is used to determine the recognition rate of the second device based on the first judgment result data indicating that the first device was successfully awakened by the second device in the judgment result data obtained in each instance.

[0017] An abnormal state classification module is used to determine the abnormal state classification corresponding to the second judgment result data based on the second judgment result data in each judgment result that indicates that the first device was not successfully woken up by the second device.

[0018] This specification provides an embodiment of a testing device, comprising:

[0019] At least one processor; and,

[0020] A memory communicatively connected to the at least one processor; wherein,

[0021] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to:

[0022] The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device;

[0023] The screen projection program installed in the control terminal is used to obtain the page image displayed on the first device at the first preset position each time.

[0024] Based on the similarity between the page image and the preset standard image, it is determined whether the first device has been successfully woken up by the second device, and the determination result data is obtained; the preset standard page image is the page image displayed after the first device is successfully woken up;

[0025] Based on the first judgment result data indicating that the first device was successfully awakened by the second device in each of the judgment result data obtained, the recognition rate of the second device is determined;

[0026] Based on the second judgment result data in each judgment result that indicates that the first device was not successfully woken up by the second device, the abnormal state category corresponding to the second judgment result data is determined.

[0027] This specification provides an embodiment of a computer-readable medium storing computer-readable instructions that can be executed by a processor to implement a test method.

[0028] One embodiment of this specification achieves the following beneficial effects:

[0029] By using a control terminal to control a robotic arm to carry a first device to a first preset position, data interaction can be achieved with a second device near the first preset position. The page image displayed on the first device at the first preset position can be acquired each time. Based on the similarity between the page image and a preset standard image, it can be determined whether the first device has been successfully activated by the second device, and the judgment result data can be obtained. Based on the first judgment result data indicating that the first device has been successfully activated by the second device in each judgment result data, the recognition rate of the second device can be accurately determined, thereby improving the accuracy and efficiency of testing the recognition rate of the second device.

[0030] On the other hand, in the embodiments of this specification, the abnormality type of the first device can also be determined based on the judgment result data that the first device is not successfully woken up by the second device, which is also helpful in providing direction for the improvement of the second device. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments or prior art of this specification, the drawings used in the description of the embodiments or prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 This is a schematic diagram illustrating an application scenario of a testing method provided in the embodiments of this specification;

[0033] Figure 2 This is a flowchart of a test method provided in an embodiment of this specification;

[0034] Figure 3 This is a swimlane diagram of a test method provided in the embodiments of this specification;

[0035] Figure 4 This is a schematic diagram of the structure of a testing device provided in the embodiments of this specification;

[0036] Figure 5 This is a schematic diagram of the structure of a testing device provided in the embodiments of this specification. Detailed Implementation

[0037] To make the objectives, technical solutions, and advantages of one or more embodiments of this specification clearer, the technical solutions of one or more embodiments of this specification will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this specification, and not all of them. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort are within the protection scope of one or more embodiments of this specification.

[0038] To facilitate understanding of the embodiments in this specification, some terms are explained below.

[0039] Control terminal: This refers to the control terminal for automated testing. The control terminal can be an industrial control computer, an integrated industrial control unit, etc. It can be used to control equipment to perform testing tasks and to collect test data.

[0040] Near Field Communication (NFC) is a short-range, high-frequency wireless communication technology that allows contactless point-to-point data transmission and exchange between electronic devices. It can be applied to mobile payments, electronic ticketing, access control, mobile identity verification, and anti-counterfeiting.

[0041] NFC Tags: An NFC tag is a wireless communication device based on NFC technology, enabling short-range wireless communication and data exchange with other NFC-enabled devices (such as smartphones and tablets). NFC tags can be active, with an internal battery or other power source. Alternatively, they can be passive, such as a Proximity Integrated Circuit Card (PICC), a passive communication mode radio frequency identification (RFID) card. PICCs require power from the radio frequency signals transmitted by the reader to power their internal circuitry and chips. In NFC communication scenarios, PICCs can act as passive devices (i.e., transponders) communicating with active devices (such as smartphones).

[0042] NFC reader: An NFC reader is a device that uses electromagnetic fields for short-range wireless communication, primarily used to read information stored in NFC tags or cards. An NFC reader may include a Proximity Coupling Device (PCD), which generates a radio frequency field to activate nearby smart cards or tags, enabling data exchange between the NFC reader and the smart card or tag. In scenarios where mobile terminals are used for transactions, such as payments and access control, NFC-enabled mobile terminals can act as NFC readers. Specifically, the NFC reader function on the mobile terminal can be activated; this function can also be called a reader / writer function.

[0043] Tap-to-use products: These can be used to interact with user terminal devices to achieve specific functions, such as payment, ordering food, and mini-program redirection.

[0044] Event tracking, also known as event monitoring, refers to the process of adding code to a target application to collect user actions and data. This code, often called event tracking code, captures relevant events (such as clicks, scrolling, searching, and app launches) and attributes (such as time, location, and device) of the target application and sends this data to a data platform for analysis.

[0045] In existing technologies, the recognition rate of a device wake-up device is typically tested using a tracking method. This involves setting tracking codes on the wake-up device to obtain test data. However, this method has a limitation: the tracking codes can only capture data when the first device is successfully woken up; otherwise, they fail to capture any data. This results in inaccurate recognition rate test results obtained using tracking methods.

[0046] The technical solutions provided in the various embodiments of this specification are described in detail below with reference to the accompanying drawings.

[0047] To address the shortcomings of existing technologies, this solution provides the following embodiments:

[0048] Figure 1 This is a schematic diagram illustrating an application scenario of a testing method provided in an embodiment of this specification. For example... Figure 1 As shown, the solution may include a control terminal 101, a robotic arm 102, a first device 103, and a second device 104. Under normal circumstances, if the first device 103 and the second device 104 are within the interaction range, the first device 103 can be invoked by the second device 104.

[0049] In practical applications, the control terminal 101 can control the robotic arm 102 to carry the first device 103 to approach or contact the second device 104 once or multiple times, so that the first device 103 and the second device 104 can interact. The control terminal 101 can also acquire the page images displayed on the first device 103, generate test results based on the page images displayed by the first device 103 during multiple tests, and obtain the recognition rate of the second device 104 based on the test results.

[0050] Next, a test method provided in the embodiments of the specification will be described in detail with reference to the accompanying drawings:

[0051] Figure 2 This is a flowchart illustrating a testing method provided in an embodiment of this specification. From a programming perspective, the entity executing the process can be a testing platform, which may include at least a control terminal and a robotic arm communicatively connected to the control terminal.

[0052] like Figure 2 As shown, the process may include the following steps.

[0053] Step 202: The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device.

[0054] In the embodiments of this specification, the control terminal can be a control terminal for automated testing. Specifically, the control terminal can be a terminal device with control functions, such as a mobile terminal or a computer terminal; it can also be industrial control equipment, such as an industrial control computer or an industrial control all-in-one machine.

[0055] The second device can act as an initiating device, providing initiating information to wake up the first device, with the first device acting as the initiated device. Interaction between the second and first devices can refer to data exchange between them. If the initiating information provided by the second device can be recognized by the first device, the first device can be woken up.

[0056] In practical applications, the first device can be a smartphone, wearable device, tablet, etc. There can be one or more first devices. The second device can be at least one of various public transport card readers, subway card readers, POS machines, order boards, Bluetooth devices, image display devices, voice devices, and infrared devices. The specific types of the first and second devices are not specifically limited here and can be set based on actual testing needs.

[0057] The control unit can control the robotic arm to carry the first device to a first preset position to test whether the first device can be woken up by the second device. For ease of testing, the position of the second device can be fixed during one or more tests. Of course, the position of the second device can also be changed for different tests, and these can be set according to actual testing needs, without specific limitations here.

[0058] In practical applications, the control unit can communicate with the robotic arm to directly control its movement; alternatively, it can communicate with the robotic arm's control unit to indirectly control its movement. The robotic arm's control unit is the core of the control system, primarily responsible for controlling its movement and posture. This control unit can communicate with the control unit, receive commands from it, and control the robotic arm's movement based on those commands.

[0059] The robotic arm can be a multi-axis robotic arm. Specifically, it can be a six-axis robotic arm, a seven-axis robotic arm, or a spider-like robotic arm. The end effector of the robotic arm can be equipped with an end effector for securing the first device. The end effector can be a gripper, a suction cup, or a combination of gripper and suction cup. The gripper can be a pneumatic gripper or an electric gripper. The suction cup can be a pneumatic vacuum suction cup or an electromagnetic suction cup. In specific applications, different end effectors can be selected based on the shape, size, and material of the first device.

[0060] The control unit can control the speed at which the robotic arm carries the first device to a first preset position, simulating the interaction between a human holding the first device and the second device. Additionally, after the robotic arm reaches the first preset position, the control unit can also control the robotic arm to move back and forth a short distance along a preset direction, or to swing back and forth at a small angle in a preset direction, simulating the interaction between a human holding the first device and the second device.

[0061] In practical applications, the number of times the same first device is tested can be set. Specifically, the number of tests for the same first device can be once or multiple times. If multiple tests are required for the same first device, a robotic arm can be used to carry the first device to a first preset position multiple times. The first preset position reached by the robotic arm carrying the first device each time can be the same or different. The number of tests for each first device can be set according to the testing requirements.

[0062] The first preset position can be a location near the second device, where the first device can be in close contact with the second device. Alternatively, the distance between the first device and the second device at the first preset position can be less than or equal to the distance required for short-range communication. For example, the first preset position can be within the scanning and recognition range of the first device or within the near-field communication range of the second device. This ensures that the first device can interact with the second device under normal circumstances, and the specific location of the first preset position can be set according to actual testing requirements.

[0063] Step 204: Use the screen mirroring program installed in the control terminal to obtain the page image displayed on the first device at the first preset position each time.

[0064] In the embodiments of this specification, the page image may be the page image displayed by the first device when the first device is in the first preset position, and the page image may be one or multiple images.

[0065] In the embodiments described in this specification, the control terminal may be equipped with a display screen or associated with a display screen. The control terminal is equipped with a screen projection program. After the first device establishes a communication connection with the control terminal, the display page of the first device can be displayed on the display screen of the control terminal or on a screen associated with the control terminal. The detection platform can obtain the page image displayed on the first device from the control terminal.

[0066] In practical applications, screen mirroring programs allow various operating systems' primary devices to share their display pages with the control terminal. This enables the control terminal to access the display pages of devices from different systems, such as Android, iOS, and HarmonyOS. By using screen mirroring programs to obtain the display pages of primary devices from various systems, the same testing platform can test devices from different systems. This improves the testing platform's compatibility with various system devices, eliminating the need to build separate testing platforms for different devices, thus reducing testing costs and increasing testing efficiency.

[0067] In the embodiments of this specification, a screen mirroring program can be used to obtain the page image displayed on the first device at a first preset position. For example, a screen recording or screenshot program can be started on the control terminal, and the page image projected from the first device to the control terminal can be captured from the control terminal. The screen recording or screenshot program can be part of the screen mirroring program, or it can be a program other than the screen mirroring program; no specific limitation is made here.

[0068] In the embodiments of this specification, at least one of the image acquisition tool and image capture tool installed in the control terminal can be used to acquire images of the display page of the first device displayed on the control terminal, thereby obtaining the page image displayed on the first device.

[0069] In the embodiments of this specification, a screen recording tool in the control terminal can also be used to record the screen of the first device's display page displayed on the control terminal, thereby obtaining a screen recording video of the first device's display page, and the page image displayed on the first device can be obtained from the screen recording video.

[0070] As one implementation method, an external image acquisition device can also be used to acquire the page image displayed on the first device. For example, the external image acquisition device can be placed on the first device, or it can be placed at other locations where it can acquire the page image displayed on the first device. The external image acquisition device can then send the acquired page image displayed on the first device to the control terminal.

[0071] In the embodiments described in this specification, the acquisition of the page image of the first device can begin when the first device reaches the first preset position; alternatively, the acquisition of the page image of the first device can begin before the first device reaches the first preset position.

[0072] Step 206: Based on the similarity between the page image and the preset standard image, determine whether the first device has been successfully woken up by the second device, and obtain the judgment result data; the preset standard image is the page image displayed after the first device is successfully woken up.

[0073] In the embodiments of this specification, the preset standard image can be a page image that should be displayed after the invoked device is successfully invoked, as set according to business requirements. For example, if the second device contains information for invoking Payment Application A, and it is necessary to test whether the first device can invoke Payment Application A based on the invoked terminal information or whether the information contained in the second device can invoke Payment Application A, then the preset standard image can be an interface image related to Payment Application A. For example, the preset standard image can be the login interface image of Payment Application A, or the payment confirmation interface image, or the payment amount input interface image, etc.

[0074] The judgment result data can be the result of each test for each first device. Specifically, it can include information indicating whether the first device was successfully woken up. For example, it can use words such as "yes" or "no" to indicate whether the wake-up was successful; or it can use characters such as "1" or "0" to indicate whether the wake-up was successful. If the first device is successfully woken up by the second device, the judgment result data can be data indicating that the first device was successfully woken up. Specifically, if the first device is successfully woken up, the judgment result data can be the first character, which can be a text, letter, or string. If the first device is not successfully woken up by the second device, the judgment result data can be data indicating that the first device was not successfully woken up. Specifically, if the first device is not successfully woken up, the judgment result data can be a second character different from the first character, which can be a text, letter, or string.

[0075] In practical applications, "the first device being woken up by the second device" can mean that the first device is actually woken up by the second device. For example, the first device changes from a screen-off state to a screen-on state. "The first device being woken up by the second device" can also mean that a target application within the first device is woken up by the second device, or it could mean that a business page within the target application is woken up. Specifically, this could be an app, a mini-program within an app, a browser page, an H5 page, etc., on the first device being woken up.

[0076] The second device may contain call-to-end information for waking up the first device. The second device can be used in any call-to-end scenario. Specifically, the second device can be a device for near-field communication (NFC), and the call-to-end information carried in the second device can be NFC communication information. For example, the second device can be a unit used for call-to-end in terminals such as bus card readers, subway card readers, and POS machines, or the second device can be a simulated terminal module containing data used for call-to-end in terminals such as bus card readers, subway card readers, and POS machines. The second device can also be a card-type device, such as a menu card or payment tag. Near-field communication can include NFC communication, Bluetooth communication, UWB ultra-wideband communication, ZigBee communication, etc.

[0077] Alternatively, the second device can also be a device carrying a terminal image, such as displaying a QR code or barcode. The first device can be a device with a camera. The first device can capture image information from the second device using the camera and make a terminal call based on the acquired image information.

[0078] In one implementation, the second device can also be a device carrying a wake-up voice, for example, the second device can output specified voice information. The first device can be a device with a microphone. The first device can collect voice information from the second device based on the microphone and use the voice information to wake up the device.

[0079] In NFC communication scenarios, the first device can be an electronic device with near-field communication (NFC) functionality. Examples include smartphones, wearable devices, tablets, public transport card readers, subway card readers, POS machines, and vending machines. The first device, with NFC functionality, can act as an NFC reader to read NFC data provided by the second device. The second device can be at least one of the following: a card with NFC functionality or an electronic device with NFC functionality. Specifically, the second device can be a tap-to-pay product, an access card, a public transport card, a subway card, or an NFC tag. The second device, with NFC functionality, can act as an NFC tag.

[0080] Based on the test task, the call terminal information carried by the second device can be determined, as well as the target application invoked based on the call terminal information. Understandably, different target applications invoked based on the call terminal information usually correspond to different preset standard images.

[0081] In practical applications, the similarity between the page image and a preset standard image can be used to determine whether the first device has been successfully activated by the second device. If the similarity between the page image and the preset standard image is high, it can be determined that the first device has been successfully activated by the second device. If the similarity between the page image and the preset standard image is low, it can be determined that the first device has not been successfully activated by the second device.

[0082] The first preset location reached by the first device can be determined based on the test task. Alternatively, the first preset location can be determined based on the caller information carried by the second device, and the caller information can be used to determine the first preset location reached by the first device. For example, if the test task is to test whether the first device can wake up the target application based on preset voice information or to test whether the voice information set in the second device can wake up the first device, the first preset location can be a location determined according to the decibel level of the voice to be tested. If the test task is to test whether the first device can wake up the target application based on near-field information, the first preset location can be a location determined according to the near-field communication distance of the second device.

[0083] Step 208: Based on the first judgment result data indicating that the first device was successfully awakened by the second device in each judgment result data obtained, determine the recognition rate of the second device.

[0084] In the embodiments of this specification, the first judgment result data may be the data showing that the first device was successfully woken up by the second device. Based on the first judgment result data, the number of times the first device was successfully woken up by the second device can be counted. A pre-set number of tests can be obtained to determine the total number of tests conducted on the first device; alternatively, the total number of tests conducted on the first device can be counted based on the judgment result data. The recognition rate of the second device can be determined based on the ratio of the number of times the first device was successfully woken up by the second device to the total number of tests conducted on the first device.

[0085] In practical applications, the wake-up rate of the first device can also be determined based on the first judgment result data indicating that the first device was successfully woken up by the second device in each judgment result data obtained.

[0086] Based on the total number of tests conducted on the same first device and the number of times the first device was successfully activated in the judgment result data, the activation rate of the first device can be determined.

[0087] Step 210: Based on the second judgment result data in the judgment result data obtained in each step, which indicates that the first device was not successfully woken up by the second device, determine the abnormal state category corresponding to the second judgment result data.

[0088] In the embodiments of this specification, the second judgment result data may be the data in the judgment result data where the first device was not successfully woken up by the second device.

[0089] The exception classification status can be the exception type when the first device is not successfully woken up by the second device, such as wake-up error, no response, etc.

[0090] Understandably, if the wake-up test measures whether the first device can be woken up by the second device, then successfully waking up the first device means that the first device is successfully woken up by the second device, for example, the first device changes from a screen-off state to a screen-on state. Failing to successfully wake up the first device means that the first device is not successfully woken up by the second device, for example, the first device does not change from a screen-off state to a screen-on state.

[0091] If the first device is successfully launched by the second device, it means that the target application or its business page on the first device is launched by the second device. For example, the app or its mini-program on the first device is launched. If the first device is not successfully launched by the second device, it could mean that the target application on the first device is not launched. Specifically, this could mean that no application on the first device is launched; or that an application other than the target application on the first device is launched incorrectly; or that the target application is launched but its interface cannot be fully displayed. Alternatively, it could mean that the app is successfully launched, but the mini-program is not.

[0092] The following are all exception types when the first device is not successfully woken up by the second device: the first device is not woken up by any application; other applications besides the target application are woken up; the target application is launched but the target application interface cannot be fully displayed; the APP is successfully woken up but the mini program is not successfully woken up.

[0093] It should be understood that the order of some steps in the methods described in one or more embodiments of this specification may be interchanged according to actual needs, or some steps may be omitted or deleted.

[0094] Figure 2 The method described herein involves using a control terminal to control a robotic arm to carry a first device to a first preset position, facilitating data interaction with a second device near the first preset position. It acquires the page image displayed on the first device at each preset position. Based on the similarity between the page image and a preset standard image, it determines whether the first device has been successfully activated by the second device, obtaining judgment result data. Based on the first judgment result data indicating successful activation of the first device by the second device, the recognition rate of the second device can be accurately determined, improving the accuracy of testing the recognition rate of the second device.

[0095] In addition, the anomaly type of the first device can be determined based on the judgment result data that the first device was not successfully woken up by the second device, so as to provide direction for the improvement of the second device.

[0096] based on Figure 2 In addition to the method described herein, this specification also provides some specific implementation schemes of the method, which will be described below.

[0097] The testing platform provided in this specification can test various types of devices. Optionally, the first device may include different types of terminal devices; the type may include at least one of system type, material type, size type, and brand type.

[0098] The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times, specifically including:

[0099] For any terminal device, the control terminal controls the robotic arm to carry the terminal device to at least one first preset position multiple times.

[0100] In the embodiments of this specification, the first device may include various different types of terminal devices. Different types can refer to different system types; for example, the first device may be one of several different operating system types, including Android, iOS, HarmonyOS, HyperOS, ColorOS, OriginOS, and MagicOS. Different types can also refer to different material types; for example, the first device may be made of various different materials, such as plastic, metal, glass, ceramic, and vegan leather. Furthermore, different types can also refer to different size types or different brand types.

[0101] In the embodiments of this specification, if there are multiple first devices, the robotic arm can carry one first device for testing at a time and repeat this process multiple times. After testing one first device is completed, the next first device can be replaced, and the above testing process can continue. In practical applications, one or more test points can be set. The first preset position can represent the location of the test point or the location where the first device arrives at the test point. The robotic arm can carry the same first device for multiple tests. In these multiple tests, the same test point can be tested, or multiple tests can be performed on multiple different test points.

[0102] In one implementation, if there are multiple first devices, there can be multiple end effectors for fixing the first devices, and the robotic arm can carry multiple first devices for testing at once. If there is only one second device, each of the multiple first devices carried by the robotic arm can be tested sequentially once, and then the testing can be repeated multiple times. Alternatively, one of the multiple first devices carried by the robotic arm can be tested multiple times first, and then this first device can be put down and replaced with the next first device, and the next first device can be tested multiple times.

[0103] If there are multiple second devices, the number of first devices carried by the robotic arm at one time can be the same as the number of second devices. The detection positions of each first device carried by the robotic arm at one time can correspond to the positions of each second device, so that each first device has a corresponding second device for testing. At the test position, the relative positional relationship between each first device and its corresponding second device can be the same. Of course, different test positions can be set for different first devices, which is not specifically limited here.

[0104] In practical applications, users may use various types of first devices to interact with the second device. By using different types of first devices to test the second device, the overall recognition rate of the second device can be determined, and the performance of the second device can be tested more comprehensively and accurately.

[0105] In the embodiments of this specification, the recognition rate of the second device for different types of first devices can also be obtained, so as to provide guidance for subsequent improvement of the recognition and wake-up function of the second device.

[0106] Optionally, the judgment result data includes result data of interactions between different types of terminal devices and the second device.

[0107] The determination of the recognition rate of the second device based on the first judgment result data obtained in each judgment result data, which represents the first judgment result data indicating that the first device was successfully awakened by the second device, may specifically include:

[0108] The judgment result data obtained in each instance are classified according to the type of terminal device.

[0109] Based on the judgment result data corresponding to the same type of terminal device, the recognition rate of the second device for the same type of terminal device is determined.

[0110] In the embodiments of this specification, different types of first devices can be placed on a robotic arm, and the robotic arm can carry different types of first devices to interact with the second device. The control terminal can collect the page images of each test of various types of first devices, and then determine the judgment results corresponding to various types of first devices.

[0111] In the embodiments of this specification, a correspondence between the type of terminal device and the result of each judgment can be established. Based on the correspondence between the type of terminal device and the result of each judgment, the judgment result of the same type of terminal can be obtained.

[0112] Different types of first devices can be terminal devices with different operating systems, such as terminal devices running Android and terminal devices running iOS. They can also be terminal devices made of different materials, such as terminal devices made of plastic and terminal devices made of metal. Alternatively, they can be terminal devices from different brands, such as terminal devices from brand A and terminal devices from brand B.

[0113] The recognition rate of the second device for that type of terminal device can be determined based on the judgment results corresponding to the same type of terminal device in the judgment result data. Specifically, the correspondence between the obtained judgment results and the terminal device types can be recorded, and then judgment results for the same type of terminal device can be filtered out from each judgment result. The total number of tests for that type of terminal device and the number of times that type of terminal device was successfully activated in the judgment results can be counted. Based on the number of times that type of terminal device was successfully activated and the total number of tests for that type of terminal device, the recognition rate of the second device for that type of terminal device can be determined.

[0114] For example, if the first device contains m Android devices, n iOS devices, and k HarmonyOS devices, testing the first device yields the recognition results for each device. Using the recognition results for the iOS devices, the recognition rate of the second device for iOS devices can be determined.

[0115] Specifically, the judgment result data for iOS operating system terminal devices can be filtered out from the judgment result data, and the total number of tests for iOS operating system terminal devices and the number of times the terminal device was successfully woken up during the test can be counted. Based on the number of times the terminal device was successfully woken up and the total number of tests for iOS operating system terminal devices, the recognition rate of the second device for iOS operating system terminal devices can be determined.

[0116] In the embodiments of this specification, the method for determining the recognition rate of the second device for other operating systems or other terminal devices of the same type can be similar to the method for determining the recognition rate of the second device for terminal devices with the iOS operating system, and will not be repeated here.

[0117] In practical applications, the recognition rate of the second device for different types of the first device can be tested separately according to testing needs.

[0118] For example, to test the recognition rate of a second device against a first device operating a preset operating system, multiple terminal devices operating preset operating systems can be selected for testing. Following the above method, the recognition rate of a second device against a first device operating various operating systems can be tested.

[0119] For example, to test the recognition rate of the second device on the first device for a preset material, multiple terminal devices with preset materials can be selected for testing. Following the above method, the recognition rate of the second device on the first device for various different materials can be tested.

[0120] For example, to test the recognition rate of a second device against a first device of a preset brand, a terminal device of the preset brand can be selected for testing. In practical applications, to improve the accuracy of the test, the terminal devices of the preset brand can include various different models or batches of products. Understandably, the recognition rate of a second device against a first device of various different brands can be tested using the above method.

[0121] In the embodiments of this specification, determining the recognition rate of the second device for different types of first devices can provide guidance for improving the recognition and wake-up function of the second device, thereby facilitating user operation. For example, if the recognition rate for type A first devices is low among multiple types of first devices, the type information of each first device can be compared to help developers improve the second device. Specifically, if tests are conducted on first devices made of various materials, the recognition rate for plastic first devices is 98%, for metal first devices is 30%, and for glass first devices is 92%. Analysis shows that material has a significant impact on the recognition rate of the second device. To address this issue, developers can improve the second device by enhancing its signal strength.

[0122] In the embodiments of this specification, if the test results include information about abnormal call terminals, the abnormal information can be classified to provide a basis for further improvement of the second device.

[0123] Optionally, the step of determining the abnormal state classification corresponding to the second judgment result data, which indicates that the first device was not successfully woken up by the second device, based on the judgment result data obtained in each iteration, may specifically include:

[0124] Based on the page image displayed on the first device at the first preset position corresponding to each of the second judgment result data, the abnormal state type of the second judgment result data is determined; the abnormal state type includes at least one of no response and response error.

[0125] In the embodiments of this specification, a correspondence can be established between the judgment result data obtained each time and the page image displayed by the first device at the first preset position, or a correspondence can be established between the judgment result data indicating that the first device has not been invoked each time and the page image displayed by the first device at the first preset position, so as to facilitate subsequent applications.

[0126] The page image displayed on the first device at the first preset position can intuitively reflect the interaction result between the first device and the second device. Based on the page image displayed on the first device at the first preset position, the type of exception when the first device is not successfully invoked can be determined.

[0127] In practical applications, abnormal status types can include no response and response error.

[0128] In this context, "no response" can refer to a situation where the first device does not respond after interacting with the second device. Specifically, it can mean that multiple page images captured by the first device do not change. For example, the page images captured while the first device is stationary at a first preset position are all in a screen-off state.

[0129] A response error can refer to a situation where the first device responds after interacting with the second device, but the content of the response is incorrect. Specifically, it could mean that multiple page images captured by the first device are inconsistent, and each page image differs from a preset standard image. For example, after the first device interacts with the second device, other applications besides the target application are launched on the first device. During the time the first device remains at a first preset position, multiple page images are different, and these multiple page images also differ from the preset standard image corresponding to the target application.

[0130] In the embodiments of this specification, the types of anomalies when the first device is not successfully woken up can be statistically analyzed to facilitate subsequent analysis of the recognition rate of the second device.

[0131] In the embodiments described in this specification, the result data in response to errors can also be further analyzed.

[0132] Optionally, if the second judgment result data includes result data indicating a response error, the method may further include:

[0133] Image analysis is performed on the page image corresponding to the result data indicating a response error to determine the terminal application to which the page image belongs.

[0134] The abnormal state type of the result data indicating a response error is determined to be the abnormal state type that triggers the terminal application.

[0135] In practical applications, error-response page images typically include the application's logo, identifier, and text. OCR technology can be used to extract this text and match it with the logos or identifiers of various terminal applications to determine the terminal application to which the page image belongs. Alternatively, the error-response page image can be compared with pre-stored page images from multiple terminal applications to determine the terminal application to which the page image belongs. These pre-stored page images can be from commonly used terminal applications, such as payment, chat, and shopping applications.

[0136] In addition, each terminal application typically has its own unique page layout, color scheme, and logo elements. The terminal application to which a page image belongs can also be determined by comprehensively analyzing features such as page layout, color, font, and logo in the page image.

[0137] In the embodiments of this specification, the name of the terminal application to which the page image belongs can be determined based on the page image. If a test report is generated, the name of the terminal application that was erroneously launched can also be displayed in the generated test report to record the erroneously launched terminal application. For example, if a terminal device of brand A erroneously launches the first terminal application, the recorded content can be, "A brand terminal device erroneously launched the first terminal application"; if a terminal device of brand B erroneously launches the second terminal application, the recorded content can be, "B brand terminal device erroneously launched the second terminal application"; or if a terminal device of iOS operating system erroneously launches the third terminal application, the recorded content can be, "iOS operating system terminal device erroneously launched the third terminal application"; if a terminal device of Android operating system erroneously launches the fourth terminal application, the recorded content can be, "Android operating system terminal device erroneously launched the fourth terminal application".

[0138] In the embodiments of this specification, a correspondence between the terminal application to which the determined page image belongs and the second judgment result data can also be established to facilitate subsequent applications.

[0139] In practical applications, in order to achieve the testing objective, the control section can also control the robotic arm to keep the first device at the first preset position for a preset time.

[0140] Optionally, the method may further include:

[0141] The control terminal controls the robotic arm to carry the first device and stay at the first preset position for a preset time.

[0142] After a preset time, the control unit can control the robotic arm to carry the first device away from the second device.

[0143] In the embodiments of this specification, the preset duration refers to the duration during which the first device remains at the first preset position. The preset duration can be a fixed duration or a duration set according to test requirements. For example, if it is desired to test whether the first device can successfully call the terminal within a specified duration when the first device and the second device are located at the terminal call position, the preset duration can be a specified duration. The specified duration can be set according to the duration required for near-field communication. Specifically, it can be set based on expert experience, calculated based on communication principles, or determined through experimental data or historical service data; however, no specific limitations are imposed here. For example, if it is desired to test whether the first device can call the terminal within 2 seconds after contacting or approaching the second device, the preset duration can be 2 seconds. Furthermore, if it is desired to test whether the first device will falsely call the terminal, assuming that the terminal call requirement set in the second device or the first device is that the first device and the second device must be in contact or approaching each other for 2 to 3 seconds before calling the terminal, and for service security, it is not allowed for the first device to call the terminal when contacting or approaching the second device for less than a specified duration, for example, it is not allowed to call the terminal within 0.5 seconds, then for this test requirement, the preset duration can be set to 0.5 seconds, thereby testing whether the first device can call the terminal within 0.5 seconds.

[0144] In practical applications, different devices may have different response times to terminal information. The preset duration for which the first device stays at the first preset position in this specification can also be set based on the page displayed on the first device. As one implementation, optionally, the control terminal controls the robotic arm to carry the first device and stay at the first preset position for the preset duration, which may specifically include:

[0145] The control terminal controls the robotic arm to hold the first device at the first preset position;

[0146] If a page change image is captured on the first device, the robotic arm is controlled to carry the first device away from the first preset position; the page change image is a page image different from the page displayed by the first device at the initial test position.

[0147] In the embodiments of this specification, the page change image can be used to represent the page image displayed after the first device interacts with the second device, indicating a change in the display page of the first device. The initial test position can be the position where the robotic arm grasps the first device, or it can represent the position of the first device before the robotic arm moves the first device closer to the second device.

[0148] The aforementioned preset duration can be the actual duration for the first device to execute the call-up program.

[0149] In practical applications, a timer associated with the control terminal can be used to time the actual duration of the first device executing the wake-up program, thereby obtaining the duration the first device stays at the first preset position. Specifically, the control terminal can start the timer when the first device arrives at the first preset position, and stop the timer when the control terminal captures the image change displayed on the first device's screen, thus obtaining the preset duration based on the timer's timing. For example, if the timing duration when the millisecond timer stops is 500 milliseconds, it can indicate that the preset duration the first device stays at the first preset position is 500 milliseconds. The timer can be a built-in clock in the control terminal or an external clock connected to the control terminal.

[0150] In practical applications, to prevent the test process from entering an infinite loop and failing to execute when the first device cannot be woken up, the control terminal can also set a maximum waiting time during the test. If the control terminal captures an image of the page change displayed on the first device within the maximum waiting time, it can control the robotic arm to carry the first device away from the first preset position and stop the timer when the image is captured. If the control terminal does not capture an image of the page change displayed on the first device within the maximum waiting time, it can control the robotic arm to carry the first device away from the first preset position and stop the timer when the timer reaches the maximum waiting time. For example, assuming the maximum waiting time set by the control terminal is 5 seconds, and the first device displays an image of the page change after 3 seconds of the timer, the control terminal can control the robotic arm to carry the first device away from the first preset position and stop the timer. As another example, assuming the maximum waiting time is set to 5 seconds, and the first device still has not displayed an image of the page change after 5 seconds of the timer, the control terminal can control the robotic arm to carry the first device away from the first preset position and stop the timer.

[0151] In the embodiments of this specification, the maximum waiting time can be set according to actual testing needs. For example, if the first device and the second device interact via NFC, the NFC communication establishment time is approximately 3 seconds, so the maximum waiting time can be set to 5 seconds. As another example, if the first device and the second device interact via Bluetooth, during the Bluetooth communication establishment process, the first device needs to perform a scanning operation to find the second device; or the second device needs to perform a scanning operation to find the first device. Under unobstructed and close proximity conditions, the scanning time is typically several seconds, so the maximum waiting time can be set to 10 seconds.

[0152] In the embodiments of this specification, the duration of the first device's stay at the first preset position each time can be statistically analyzed to determine the actual duration of the first device's execution of the call-up program. This actual duration can then be recorded in the generated test report. This provides developers with a basis for improving the second or first device. For example, among multiple first devices, some may have longer call-up times. Developers can compare the first devices with longer call-up times, or compare each first device with a shorter call-up time, and then make improvements to the second or first device.

[0153] The embodiments in this specification provide further explanation regarding the acquisition of page images.

[0154] Optionally, obtaining the page image displayed on the first device at the first preset position each time may specifically include:

[0155] The page image displayed on the first device is acquired during the process of the first device staying at the first preset position for a preset time.

[0156] In the embodiments of this specification, the acquired page image can be an image displayed on the first device within a preset time period during which the first device stays at the first preset position. For example, if the first device stays at the first preset position for 3 seconds, the acquired page image can be an image displayed during the 3 seconds the first device stays at the first preset position.

[0157] In the embodiments of this specification, a screen mirroring program or other screen recording tool in the control terminal can also be used to record the screen of the page displayed on the control terminal. It is understood that the page displayed on the control terminal includes the page image displayed by the first device, thereby obtaining a screen recording video of the first device staying at a first preset position. The duration of the first device staying at the first preset position is a preset duration. In practical applications, all video frames in the acquired screen recording video can be used as page images, or a portion of the video frames can be selected as page images. Specifically, all video frames can be divided according to similarity to obtain multiple groups of video frames, with higher similarity among video frames in the same group. A preset number of video frames with higher clarity can be selected from each group of video frames as page images.

[0158] In one implementation, when the first device reaches the first preset position, a screen mirroring program or other screen recording tool in the control terminal can be activated to record the screen of the first device displayed on the control terminal. Alternatively, the screen recording tool can be deactivated after a preset duration, thereby obtaining the screen recording video of the first device remaining at the first preset position for the preset duration. Based on this screen recording video, the page image displayed on the first device during the preset duration of the first device remaining at the first preset position can be obtained.

[0159] In the embodiments of this specification, at least one of the image acquisition tool and image capture tool installed in the control terminal can be used to capture the page image displayed on the first device during the preset time period when the first device stays at the first preset position. Specifically, the control terminal can use the aforementioned tool installed in the control terminal to capture the page image of the first device displayed on the control terminal while the first device stays at the first preset position. Alternatively, the control terminal can also use the aforementioned tool installed in the control terminal to capture the video of the first device's display page during the preset time period when the first device stays at the first preset position, which is recorded and saved by the control terminal, after the first device leaves the first preset position, to obtain the page image displayed on the first device during the preset time period when the first device stays at the first preset position. The video of the first device's display page during the preset time period when the first device stays at the first preset position, which is recorded and saved by the control terminal, can be recorded by a screen mirroring program or by other screen recording tools in the control terminal.

[0160] In practical applications, image acquisition tools and image capture tools can capture images from the display page of the first device shown on the control terminal at a preset frequency.

[0161] In one implementation, when the first device reaches the first preset position, at least one of the image acquisition tool and image capture tool installed in the control terminal can be turned on to capture the display page of the first device displayed on the control terminal. Alternatively, the image acquisition tool or image capture tool can be turned off after a first preset time period to obtain the page image displayed on the first device during the preset time period when the first device stays at the first preset position.

[0162] In the embodiments of this specification, acquiring the page image displayed on the first device within a preset time period while the first device remains at a first preset position ensures that the actual response result of the first device after interacting with the second device can be obtained. This avoids situations where the first device is activated after interacting with the second device but the page image of the activated first device is not captured.

[0163] To further improve the authenticity of the response results of the first device after interacting with the second device, in the embodiments of this specification, page images can be further obtained before the first device is located at the first preset position and / or after the first device stays at the first preset position for a preset time.

[0164] Optionally, the method may further include:

[0165] Collect page images displayed on the first device within a first preset time period before the first device is located at the first preset position.

[0166] Alternatively, the page image displayed on the first device can be captured within a second preset time period after the first device has stayed at the first preset position for a preset time period.

[0167] In the embodiments described in this specification, the control terminal may also collect page images displayed on the first device during a period of time before the first device is located at the first preset position. In practical applications, the page images displayed on the first device during a period of time before the first device is located at the first preset position, collected by the control terminal, may be page images displayed on the first device during the process of the first device approaching the second device but not yet reaching the first preset position.

[0168] In addition, the control terminal can also capture the page images displayed on the first device for a period of time after the first device has stayed at the first preset position for a preset duration. For example, if the first device stays at the first preset position for 2 seconds, the page images captured by the control terminal can be the page images within 5 seconds after the first device reaches the first preset position.

[0169] In practical applications, the page image displayed on the first device during a period of time after the first device stays at the first preset position for a preset duration can be the page image displayed on the first device during the process of the first device leaving the second device after staying at the first preset position for a preset duration.

[0170] In the embodiments described in this specification, the first preset duration and the second preset duration can be set according to actual needs, and are not specifically limited here.

[0171] In practical applications, while the first device is approaching the second device but has not yet reached the first preset position, there may be instances where the first device has already interacted with the second device and generated a response. By capturing the page images displayed on the first device within a first preset time period before the first device reaches the first preset position, the control terminal can improve the completeness of recording the first device's response content.

[0172] Furthermore, after the first device has remained at the first preset position for a preset duration, there may be situations where the first device has engaged in data interaction with the second device but has not yet responded, or is still responding, due to network or other reasons. By capturing the page images displayed on the first device within a second preset duration after the first device has remained at the first preset position for the preset duration, the control terminal can improve the accuracy of recording the first device's response content.

[0173] The embodiments in this specification also provide specific details on determining whether the first device has been successfully invoked by the second device.

[0174] Optionally, determining whether the first device has been successfully invoked by the second device based on the similarity between the page image and a preset standard image may specifically include:

[0175] Calculate the similarity between the page image and a preset standard image.

[0176] Determine whether the similarity is greater than or equal to a preset threshold.

[0177] If the similarity is greater than or equal to a preset threshold, then it is determined that the first device was successfully woken up by the second device.

[0178] If the similarity is less than the preset threshold, it is determined that the first device was not successfully woken up by the second device.

[0179] In the embodiments described in this specification, the preset standard image may be the page image expected to be displayed after the first device is successfully woken up by the second device. In practical applications, different test tasks may result in different target applications being woken up based on the wake-up information, and the corresponding preset standard images will usually be different.

[0180] In the embodiments of this specification, the similarity between a page image and a preset standard image can be calculated based on the text content contained in the page image and the text content contained in a preset standard image. And / or, the similarity between the page image and the preset standard image can also be calculated based on the page structure of the page image and the page structure of the preset standard image. And / or, the similarity between the page image and the preset standard image can also be calculated based on the image content of the page image and the image content of the preset standard image.

[0181] If the similarity is greater than or equal to a preset threshold, it indicates that the first device has been successfully activated by the second device. If the similarity is less than the preset threshold, it indicates that the first device has not been successfully activated by the second device.

[0182] If the page image includes multiple page images, it can be determined whether the first device has been successfully woken up by the second device based on the multiple page images.

[0183] Optionally, the acquired page images may include multiple page images.

[0184] The step of determining whether the first device has been successfully woken up by the second device based on the similarity between the page image and a preset standard image may specifically include:

[0185] Calculate the similarity between each page image in the multiple page images and a preset standard image.

[0186] If any of the page images has a similarity to the preset standard image greater than or equal to a preset threshold, then it is determined that the first device has been successfully woken up by the second device.

[0187] If none of the page images has a similarity to the preset standard image greater than or equal to a preset threshold, then it is determined that the first device has not been successfully woken up by the second device.

[0188] In the embodiments of this specification, if multiple page images are collected, the similarity between each page image and a preset standard page can be calculated separately.

[0189] As one implementation method, if the number of page images whose similarity to a preset standard image is greater than or equal to a preset threshold is greater than or equal to a preset number, it can be determined that the first device has been successfully invoked by the second device. The preset number can be 1 or other values ​​greater than 1; no specific limitation is made here.

[0190] As one implementation, if the number of page images in each page that have a similarity to a preset standard image greater than or equal to a preset threshold is 0, it can be said that there are no page images in each page that have a similarity to a preset standard image greater than or equal to a preset threshold, and it can be determined that the first device has not been successfully woken up by the second device.

[0191] In the embodiments of this specification, specific details are also provided for calculating the similarity between the page image and the preset standard image.

[0192] Optionally, the similarity between the page image and a preset standard image can be calculated, which may specifically include:

[0193] The similarity between the page image and the preset standard image is calculated using the hash mean algorithm.

[0194] In the embodiments of this specification, the mean hash algorithm is a general term for a class of comparative hashing methods. It achieves fast image comparison by converting images into binary hash codes. Its principle is to convert images into fixed-length binary hash codes and determine the similarity of images by comparing the differences in the hash codes. The mean hash algorithm can efficiently and quickly calculate the similarity between a page image and a preset standard image.

[0195] In practical applications, algorithms such as histogram similarity and feature vector similarity can also be used to calculate the similarity between the page image and the preset standard image, without making specific limitations here.

[0196] In practical applications, the target application on the first device can be closed before testing the first device to avoid being unable to confirm whether the target application that is invoked is invoked during the test or has been opened in advance.

[0197] Optionally, the invocation may refer to invoking a target application in the first device.

[0198] The method may further include:

[0199] The control terminal controls the first device to shut down the target application.

[0200] In the embodiments described in this specification, the target application in the first device can be shut down using a control terminal.

[0201] In practical applications, when testing a first device for the first time, the target application on the first device can be closed in advance to avoid being unable to confirm whether the target application that is invoked is invoked during the test or opened in advance.

[0202] In addition, multiple tests can be performed on the same first device. To ensure the accuracy of the test, the target application or other applications that are invoked on the first device can be closed after a test is completed, so as to avoid not knowing whether the target application or other applications were invoked in the current test or the previous test in the next test.

[0203] In the embodiments described in this specification, the control terminal can control the target application or other applications to close after capturing the page image of the first device. It is understood that if the target application is successfully launched during the test, the control terminal can control the target application to close after capturing the page image of the first device. Conversely, if the target application is not successfully launched during the test, but other applications are launched, the control terminal can control the other applications to close after capturing the page image of the first device. These other applications can be applications other than the target application.

[0204] If the page image captured by the control terminal is the page image displayed on the first device during the process of the first device staying at the first preset position for a preset time, the control terminal can control the target application or other applications to close after the first device has stayed at the first preset position for a preset time.

[0205] If the page image collected by the control terminal also includes the page image displayed on the first device within a second preset time period after the first device stays at the first preset position for a preset time period, the control terminal can control the target application or other applications to close after the total time period of the first device arriving at the first preset position plus the second preset time period.

[0206] In the embodiments described in this specification, the control terminal may use one or more methods to control the first device to shut down the target application.

[0207] Optionally, the control terminal controls the first device to close the target application, which may specifically include:

[0208] The control terminal uses ADB commands to control the first device to shut down the target application.

[0209] Alternatively, the control terminal can control the first device to close the target application by projecting a screen to simulate touch.

[0210] ADB (Android Debug Bridge) is a command-line tool for communication between a PC and an Android device. It allows developers to connect their computer to an emulator or Android device for debugging, enabling various operations on the phone, such as opening or closing applications, installing or uninstalling APKs, copying push notification files, tapping and swiping the screen, viewing device hardware information, checking application resource usage, and executing shell commands on the device.

[0211] In the embodiments described in this specification, the control terminal can use ADB commands to control the first device of the Android system to close the target application and other applications.

[0212] In practical applications, the control terminal can communicate with the first device via wired or wireless means. For example, the control terminal can connect to the first device via a USB interface, or the control terminal and the first device can be located on the same network, thereby using ADB commands to control the first device running the Android system to close the target application and other applications.

[0213] In the embodiments of this specification, the control terminal can use a screen casting program to control the first device to close the target application by simulating touch through screen casting. The screen casting program can be at least one of AirDroid Cast, LaiXi Android Screen Casting Program, ApowerScreen Screen Casting, LeBao Screen Casting, and KuaiScreen Screen Casting.

[0214] AirDroid Cast is a screen casting and control application. You can set up a screen casting program in the control terminal. After the first device communicates and connects with the control terminal, the display page of the first device can be projected onto the control terminal. You can then operate the first device through the control terminal to close the target application.

[0215] In the embodiments described in this specification, the control terminal can use AirDroid Cast to control the first device of the Android system to close the target application and other applications, or it can use AirDroid Cast to control the first device of the iOS system to close the target application and other applications.

[0216] To more clearly illustrate a test method provided in the embodiments of this specification, this explanation uses a test for near-field communication as an example. Figure 3 This is a swimlane diagram of a test method provided in an embodiment of this specification. Figure 3 As shown, the testing method can involve execution entities such as a first device, a second device, and a testing platform. The testing platform can include at least a control terminal and a robotic arm. The testing process can include a testing phase and a test result generation phase.

[0217] During the testing phase, the executing entities may include a control terminal, a first device, and a second device, and may specifically include the following steps:

[0218] Step 302: The control terminal controls the robotic arm to carry the first device to the near-field communication range of the second device and stay there for a preset time.

[0219] The control terminal can be a control terminal for automated control. Specifically, the control terminal can be industrial control equipment, such as industrial control computers, industrial control all-in-one machines, etc.

[0220] In the embodiments described in this specification, the preset duration refers to the duration during which the first device remains at the first preset position. The preset duration can be determined based on the time required for the first device and the second device to complete data or information interaction.

[0221] Step 304: The first device obtains near-field information from the second device via near-field communication.

[0222] When the first device is within the near-field communication range of the second device, it can send a trigger signal to the second device to cause the second device to send near-field information, which the first device can then receive. The first device can be an electronic device with near-field communication (NFC) functionality, such as a smartphone, wearable device, tablet, public transport card reader, subway card reader, or POS machine. The first device, having NFC functionality, can act as an NFC reader to read the NFC data provided by the second device. The second device can be at least one of the following: a card with NFC functionality or an electronic device with NFC functionality. Specifically, the second device can be a contactless product, an access card, a public transport card, a subway card, an NFC tag, etc. The second device, having NFC functionality, can act as an NFC tag.

[0223] In the embodiments of this specification, if the test task is to test whether the target application in the terminal device can be invoked based on the invocation information, the near-field information may include at least the identification information of the target application. The identification information may be information in the form of links, such as URLs, HTML links, etc.; or it may be other forms of string information, such as JavaScript functions, redirection strings, etc.

[0224] Step 306: The first device displays the relevant page based on the acquired near-field information.

[0225] In the embodiments described in this specification, the first device can launch a target application based on the identification information of the target application in the near-field information. The relevant page can be a page displayed by the first device related to launching the target application. For example, if the target application is a payment application, the relevant page could be the login page of the target application, a payment confirmation page, or a page for entering the payment amount, etc.

[0226] In practical applications, there may be situations where the first device cannot acquire near-field information or cannot parse it, resulting in the first device being unable to display any application pages. Alternatively, there may be situations where the first device can acquire near-field data but displays incorrect page information.

[0227] Step 308: The control terminal acquires the page image displayed on the first device.

[0228] In the embodiments described in this specification, a screen mirroring program installed on the control terminal can be used to obtain the page image displayed by the first device at the first preset position. If multiple tests are required, the page image of the first device at the first preset position can be obtained for each test.

[0229] In practical applications, it is possible to acquire the page images displayed on the first device during the period when the first device remains at the first preset position for a preset duration. Furthermore, it is also possible to acquire the page images displayed on the first device during the first preset duration before the first device is positioned at the first preset position. Alternatively, it is possible to acquire the page images displayed on the first device during the second preset duration after the first device has remained at the first preset position for a preset duration.

[0230] In practical applications, the control terminal can communicate with the first device wirelessly or via a wired connection to obtain the page images displayed on the first device. For example, the control terminal can be connected to the first device via a USB interface. Alternatively, the control terminal and the first device can be located in the same wired or wireless network and communicate with the first device via a network. The specific connection method between the control terminal and the first device is not limited here.

[0231] In one implementation, the control terminal and the first device can be connected via a wired communication cable, such as a communication cable with a USB interface. After the control terminal is connected to the first device, it can acquire the page image of the first device through installed screen mirroring software. For example, the control terminal can control the screen mirroring software to acquire the page image of the first device without requiring any operation on the first device. A wired connection between the control terminal and the first device simplifies the operation of the first device and improves the stability of screen mirroring and data acquisition.

[0232] As another implementation, if the control terminal and the first device are connected wirelessly, the first device can obtain information for establishing a connection with the screen mirroring software installed in the control terminal through short-range communication methods such as scanning a code, NFC near-field communication, and Bluetooth. Based on this information, the first device can communicate and connect with the control terminal, and the control terminal can obtain the page image of the first device through the screen mirroring software.

[0233] For example, if the screen mirroring software can be used by scanning a QR code, after the control terminal installs or starts the screen mirroring software, the control terminal can display a QR code for connecting to the screen mirroring software. The first device can scan the QR code to connect to the screen mirroring software, and the control terminal can obtain the page image displayed on the first device through the screen mirroring software.

[0234] In practical applications, the control terminal can also perform some control or operation on the first device based on the screen projection software.

[0235] Step 310: The control terminal determines whether the first device has been successfully woken up by the second device based on the similarity between the page image and the preset standard image, and obtains the judgment result data.

[0236] In the embodiments described in this specification, the preset standard image may be the page image displayed after the target application in the first device is successfully invoked.

[0237] If the similarity between the page image and the preset standard image is greater than or equal to a preset threshold, it can be determined that the first device has been successfully woken up by the second device.

[0238] If the similarity between the page image and the preset standard image is less than a preset threshold, it can be determined that the first device has not been successfully woken up by the second device.

[0239] Step 312: The control terminal closes the application terminal corresponding to the page image displayed on the first device.

[0240] If the target application is successfully launched during the test, the control terminal can close it after capturing the page image of the first device. If the target application is not successfully launched, but another application is launched instead, the control terminal can close that other application after capturing the page image of the first device. This other application can be any application other than the target application. This is to avoid confusion about whether the launched target application or other application was launched during the current test or a previous test.

[0241] Step 314: The control terminal determines whether the first number of tests has been completed; if yes, proceed to step 316; if no, proceed to step 302.

[0242] The first test count can be the number of tests performed on the same first device. For example, if the test count for the same first device is set to 5, after steps 302 to 312 are completed, it can be determined whether the test count for the first device has reached the set test count, i.e., whether it has reached 5 times. If the test count for the first device has not reached the set test count, steps 302 to 312 can continue to be executed. If the test count for the first device has reached the set test count, step 316 can continue to be executed.

[0243] Step 316: The control terminal determines whether all tests have been completed; if not, proceed to step 318; if yes, proceed to step 320.

[0244] In practical applications, multiple first devices can be used for testing. After testing a first device is completed, the control terminal can also determine whether all tests have been completed, such as whether a preset number of first devices have been captured. If not, the control terminal can continue to capture other first devices. If a preset number of first devices have been captured, it can stop capturing other first devices.

[0245] Step 318: The control terminal controls the robotic arm to unload the material, grab the next first device, and jump to step 302;

[0246] In this embodiment of the specification, the robotic arm can place the first device that has completed testing in the unloading area. After unloading, it can go to the retrieval area to grab the next first device that needs to be tested.

[0247] During the test result generation phase, the executing entities may include a control terminal, a first device, and a second device, and may specifically include the following steps:

[0248] Step 320: The control terminal determines the recognition rate of the second device based on the first judgment result data indicating that the first device was successfully awakened by the second device in each judgment result data obtained.

[0249] In practical applications, the judgment result can be obtained in real time after the page image of the first device is acquired; or it can be obtained by unified analysis after the robotic arm has completed multiple tests. No specific limitation is made here.

[0250] Step 322: Based on the second judgment result data indicating that the first device was not successfully woken up by the second device in each judgment result obtained, the control terminal determines the abnormal state category corresponding to the second judgment result data.

[0251] For any content not described in detail in this embodiment, please refer to the description in any of the above embodiments.

[0252] Based on the same idea, embodiments of this specification also provide apparatus corresponding to the above methods. Figure 4 This is a schematic diagram of a testing device provided in an embodiment of this specification. Figure 4 As shown, the device may include:

[0253] The control module 402 controls the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device.

[0254] The acquisition module 404 uses a screen mirroring program installed in the control terminal to acquire the page image displayed on the first device at the first preset position each time.

[0255] The judgment module 406 determines whether the first device has been successfully woken up by the second device based on the similarity between the page image and the preset standard image, and obtains judgment result data; the preset standard image is the page image displayed after the first device is successfully woken up.

[0256] The recognition rate determination module 408 determines the recognition rate of the second device based on the first judgment result data indicating that the first device was successfully awakened by the second device in each judgment result data obtained.

[0257] The abnormal state classification module 410 determines the abnormal state classification corresponding to the second judgment result data based on the second judgment result data in each judgment result data that indicates that the first device was not successfully woken up by the second device.

[0258] based on Figure 4 The embodiments of this specification also provide some specific implementation schemes of the method, which are described below.

[0259] Optionally, the first device includes different types of terminal devices; the type includes at least one of system type, material type, size type, and brand type.

[0260] The control module 402 can be specifically used for:

[0261] For any terminal device, the control terminal controls the robotic arm to carry the terminal device to at least one first preset position multiple times.

[0262] Optionally, the judgment result data includes result data of interactions between different types of terminal devices and the second device;

[0263] The recognition rate determination module 408 can be specifically used for:

[0264] The judgment result data obtained in each instance are classified according to the type of terminal device.

[0265] Based on the judgment result data corresponding to the same type of terminal device, the recognition rate of the second device for the same type of terminal device is determined.

[0266] Optional, the abnormal state classification module 410 specifically includes:

[0267] Based on the page image displayed on the first device at the first preset position corresponding to each of the second judgment result data, the abnormal state type of the second judgment result data is determined; the abnormal state type includes at least one of no response and response error.

[0268] Optionally, if the second judgment result data includes result data indicating a response error, Figure 4 The device may further include:

[0269] The first determining module is used to perform image analysis on the page image corresponding to the result data indicating a response error, and determine the terminal application to which the page image belongs;

[0270] The second determining module is used to determine that the abnormal state type of the result data representing the response error is the abnormal state type that triggers the terminal application.

[0271] Optional, Figure 4 The device may further include:

[0272] The duration control module is used by the control terminal to control the robotic arm to stay at the first preset position for a preset duration while carrying the first device.

[0273] Optionally, the acquisition module 404 can be specifically used for:

[0274] The page image displayed on the first device is acquired during the process of the first device staying at the first preset position for a preset time.

[0275] Optional, Figure 4 The device may further include:

[0276] The first acquisition module is used to acquire page images displayed on the first device within a first preset time period before the first device is located at the first preset position.

[0277] Alternatively, the second acquisition module is used to acquire the page image displayed on the first device within a second preset time period after the first device stays at the first preset position for a preset time period.

[0278] Optionally, the determination module 406 may specifically include:

[0279] The first calculation unit is used to calculate the similarity between the page image and a preset standard image.

[0280] The first judgment unit is used to determine whether the similarity is greater than or equal to a preset threshold.

[0281] The first result unit is used to determine that the first device has been successfully woken up by the second device if the similarity is greater than or equal to a preset threshold.

[0282] The second result unit is used to determine that the first device has not been successfully woken up by the second device if the similarity is less than the preset threshold.

[0283] Optionally, if the acquired page image includes multiple page images;

[0284] The judgment module 406 may specifically include:

[0285] The second calculation unit is used to calculate the similarity between each page image in the multiple page images and a preset standard image.

[0286] The third result unit is used to determine that the first device has been successfully woken up by the second device if there is a page image in each page image that has a similarity to the preset standard image that is greater than or equal to a preset threshold.

[0287] The fourth result unit is used to determine that the first device has not been successfully woken up by the second device if there is no page image among the page images that has a similarity to the preset standard image greater than or equal to a preset threshold.

[0288] Optionally, the first computing unit or the second computing unit may be specifically used for:

[0289] The similarity between the page image and the preset standard image is calculated using the hash mean algorithm.

[0290] Optionally, if the "wake-up" refers to waking up a target application in the first device, Figure 4 The device may further include:

[0291] The shutdown module is used by the control terminal to control the first device to shut down the target application.

[0292] Optionally, the shutdown module can be specifically used for:

[0293] The control terminal uses ADB commands to control the first device to shut down the target application.

[0294] Alternatively, the control terminal can control the first device to close the target application by projecting a screen to simulate touch.

[0295] Optionally, the first device is an electronic device with near-field communication functionality.

[0296] Alternatively, the second device may be at least one of a card with near-field communication (NFC) functionality or an electronic device with NFC functionality.

[0297] Optional, Figure 4 The device may further include:

[0298] The wake-up rate determination module is used to determine the wake-up rate of the first device based on the first judgment result data in each judgment result data that indicates that the first device was successfully woken up by the second device.

[0299] Based on the same idea, this specification also provides devices corresponding to the above methods in its embodiments.

[0300] Figure 5 This is a schematic diagram of the structure of a testing device provided in an embodiment of this specification. Figure 5 As shown, device 500 may include:

[0301] At least one processor 510; and,

[0302] Memory 530 communicatively connected to the at least one processor; wherein,

[0303] The memory 530 stores instructions 520 that can be executed by the at least one processor 510, the instructions being executed by the at least one processor 510 to enable the at least one processor 510 to:

[0304] The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device.

[0305] The screen mirroring program installed in the control terminal is used to obtain the page image displayed on the first device at the first preset position each time.

[0306] Based on the similarity between the page image and the preset standard image, it is determined whether the first device has been successfully woken up by the second device, and the determination result data is obtained; the preset standard image is the page image displayed after the first device is successfully woken up.

[0307] Based on the first judgment result data indicating that the first device was successfully awakened by the second device in each judgment result data obtained, the recognition rate of the second device is determined.

[0308] Based on the second judgment result data in each judgment result data that indicates that the first device was not successfully woken up by the second device, the abnormal state category corresponding to the second judgment result data is determined.

[0309] Following the same approach, embodiments of this specification also provide a computer-readable medium corresponding to the above-described method. The computer-readable medium stores computer-readable instructions, which can be executed by a processor to implement the above-described test method:

[0310] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on its differences from other embodiments. In particular, for... Figure 5 As the device shown is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment.

[0311] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with the relevant laws, regulations and standards of the relevant regions, and corresponding operation entry points are provided for users to choose to authorize or refuse.

[0312] In the 1990s, improvements to a technology could be clearly distinguished as either hardware improvements (e.g., improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the methodology). However, with technological advancements, many methodological improvements today can be considered direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved methodology into the hardware circuit. Therefore, it cannot be said that a methodological improvement cannot be implemented using hardware physical modules. For example, a Programmable Logic Device (PLD) (such as a Field Programmable Gate Array (FPGA)) is such an integrated circuit whose logic function is determined by the user programming the device. Designers can program and "integrate" a digital system onto a PLD themselves, without needing chip manufacturers to design and manufacture dedicated integrated circuit chips. Furthermore, nowadays, instead of manually manufacturing integrated circuit chips, this programming is mostly implemented using "logic compiler" software. Similar to the software compiler used in program development, the original code before compilation must be written in a specific programming language, called a Hardware Description Language (HDL). There are many HDLs, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, and RHDL (Ruby Hardware Description Language). Currently, the most commonly used are VHDL (Very-High-Speed ​​Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should understand that by simply performing some logic programming on the method flow using one of these hardware description languages ​​and programming it into an integrated circuit, the hardware circuit implementing the logical method flow can be easily obtained.

[0313] The controller can be implemented in any suitable manner. For example, it can take the form of a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro)processor, logic gates, switches, application-specific integrated circuits (ASICs), programmable logic controllers, and embedded microcontrollers. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicon Labs C8051F320. A memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art will also recognize that, in addition to implementing the controller in purely computer-readable program code form, the same functionality can be achieved by logically programming the method steps to make the controller take the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers. Therefore, such a controller can be considered a hardware component, and the means included therein for implementing various functions can also be considered as structures within the hardware component. Alternatively, the means for implementing various functions can be considered as both software modules implementing the method and structures within the hardware component.

[0314] The systems, devices, modules, or units described in the above embodiments can be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, a computer can be, for example, a personal computer, laptop computer, cellular phone, camera phone, smartphone, personal digital assistant, media player, navigation device, email device, game console, tablet computer, wearable device, or any combination of these devices.

[0315] For ease of description, the above devices are described separately by function as various units. Of course, in implementing this application, the functions of each unit can be implemented in one or more software and / or hardware.

[0316] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0317] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0318] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0319] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0320] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0321] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0322] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0323] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0324] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0325] This application can be described in the general context of computer-executable instructions, such as program modules, that are executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc., that perform a specific task or implement a specific abstract data type. This application can also be practiced in distributed computing environments where tasks are performed by remote processing devices connected via a communication network. In distributed computing environments, program modules can reside in local and remote computer storage media, including storage devices.

[0326] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A testing method, comprising: The control unit controls the robotic arm to carry at least one first device to at least one first preset position multiple times; A second device that interacts with the first device is located near the first device at the first preset location; The screen projection program installed in the control terminal is used to obtain the page image displayed on the first device at the first preset position each time. Based on the similarity between the page image and the preset standard image, it is determined whether the first device has been successfully woken up by the second device, and the determination result data is obtained. The preset standard image is the page image displayed after the first device is successfully woken up; Based on the first judgment result data indicating that the first device was successfully awakened by the second device in each of the judgment result data obtained, the recognition rate of the second device is determined; Based on the second judgment result data in each judgment result data that indicates that the first device was not successfully woken up by the second device, the abnormal state category corresponding to the second judgment result data is determined.

2. The method of claim 1, wherein the first device includes different types of terminal devices; the type includes at least one of system type, material type, size type, and brand type; The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times, specifically including: For any terminal device, the control terminal controls the robotic arm to carry the terminal device to at least one first preset position multiple times.

3. The method as described in claim 2, wherein the judgment result data includes result data of interactions between different types of terminal devices and the second device; The determination of the recognition rate of the second device is based on the first judgment result data obtained in each judgment result, which represents the first judgment result data indicating that the first device was successfully awakened by the second device. Specifically, this includes: The judgment result data obtained in each instance are classified according to the type of the terminal device; Based on the judgment result data corresponding to the same type of terminal device, the recognition rate of the second device for the same type of terminal device is determined.

4. The method as described in claim 1, wherein determining the abnormal state classification corresponding to the second judgment result data based on the second judgment result data indicating that the first device was not successfully woken up by the second device in each obtained judgment result data specifically includes: Based on the page image displayed on the first device at the first preset position corresponding to each of the second judgment result data, the abnormal state type of the second judgment result data is determined; the abnormal state type includes at least one of no response and response error.

5. The method of claim 4, wherein if the second judgment result data includes result data indicating a response error, the method further comprises: Image analysis is performed on the page image corresponding to the result data indicating a response error to determine the terminal application to which the page image belongs; The abnormal state type of the result data indicating a response error is determined to be the abnormal state type that triggers the terminal application.

6. The method of claim 1, further comprising: The control terminal controls the robotic arm to carry the first device and stay at the first preset position for a preset time.

7. The method according to claim 6, wherein the control terminal controls the robotic arm to hold the first device at the first preset position for a preset time, specifically including: The control terminal controls the robotic arm to hold the first device at the first preset position; If a page change image is captured on the first device, the robotic arm is controlled to carry the first device away from the first preset position; the page change image is a page image different from the page displayed by the first device at the initial test position.

8. The method as described in claim 6, wherein obtaining the page image displayed on the first device at the first preset position each time specifically includes: The page image displayed on the first device is acquired during the process of the first device staying at the first preset position for a preset time.

9. The method of claim 8, further comprising: Collect page images displayed on the first device within a first preset time period before the first device is located at the first preset position; Alternatively, the page image displayed on the first device can be captured within a second preset time period after the first device has stayed at the first preset position for a preset time period.

10. The method as described in claim 1, wherein determining whether the first device has been successfully invoked by the second device based on the similarity between the page image and a preset standard image specifically includes: Calculate the similarity between the page image and a preset standard image; Determine whether the similarity is greater than or equal to a preset threshold; If the similarity is greater than or equal to a preset threshold, then it is determined that the first device was successfully woken up by the second device; If the similarity is less than the preset threshold, it is determined that the first device was not successfully woken up by the second device.

11. The method as described in claim 1, wherein the acquired page image comprises multiple page images; The step of determining whether the first device has been successfully woken up by the second device based on the similarity between the page image and a preset standard image specifically includes: Calculate the similarity between each page image in the multiple page images and a preset standard image; If any of the page images has a similarity to the preset standard image greater than or equal to a preset threshold, then it is determined that the first device has been successfully woken up by the second device. If none of the page images has a similarity to the preset standard image greater than or equal to a preset threshold, then it is determined that the first device has not been successfully woken up by the second device.

12. The method as described in claim 10 or 11, calculating the similarity between the page image and a preset standard image, specifically includes: The similarity between the page image and the preset standard image is calculated using the hash mean algorithm.

13. The method of claim 1, wherein the invocation refers to invoking a target application in the first device; the method further comprises: The control terminal controls the first device to shut down the target application.

14. The method of claim 13, wherein the control terminal controls the first device to close the target application, specifically including: The control terminal controls the first device to close the target application via ADB commands; Alternatively, the control terminal can control the first device to close the target application by simulating touch via screen projection.

15. The method of claim 14, wherein the first device is an electronic device having near-field communication functionality; Alternatively, the second device may be at least one of a card with near-field communication (NFC) functionality or an electronic device with NFC functionality.

16. The method of claim 1, further comprising: Based on the first judgment result data indicating that the first device was successfully woken up by the second device in each judgment result data obtained, the wake-up rate of the first device is determined.

17. A testing apparatus, comprising: The control module controls the robotic arm to carry at least one first device to at least one first preset position multiple times. A second device that interacts with the first device is located near the first device at the first preset location; The acquisition module uses a screen mirroring program installed in the control terminal to acquire the page image displayed on the first device at the first preset position each time. The judgment module determines whether the first device has been successfully woken up by the second device based on the similarity between the page image and the preset standard image, and obtains the judgment result data. The preset standard image is the page image displayed after the first device is successfully woken up; The recognition rate determination module determines the recognition rate of the second device based on the first judgment result data indicating that the first device was successfully woken up by the second device in each judgment result data obtained; The abnormal state classification module determines the abnormal state classification corresponding to the second judgment result data based on the second judgment result data in each judgment result data that indicates that the first device was not successfully woken up by the second device.

18. A testing device, comprising: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enable the at least one processor to: The control terminal controls the robotic arm to carry at least one first device to at least one first preset position multiple times; at the first preset position, there is a second device near the first device that interacts with the first device; The screen projection program installed in the control terminal is used to obtain the page image displayed on the first device at the first preset position each time. Based on the similarity between the page image and the preset standard image, it is determined whether the first device has been successfully woken up by the second device, and the determination result data is obtained; the preset standard page image is the page image displayed after the first device is successfully woken up; Based on the first judgment result data indicating that the first device was successfully awakened by the second device in each of the judgment result data obtained, the recognition rate of the second device is determined; Based on the second judgment result data in each judgment result that indicates that the first device was not successfully woken up by the second device, the abnormal state category corresponding to the second judgment result data is determined.

19. A computer-readable medium having stored thereon computer-readable instructions that can be executed by a processor to implement the test method of any one of claims 1 to 16.