A roaming test method and device, a terminal device, and a storage medium

Abstract

Embodiments of the present application provide a roaming test method and device, terminal equipment and storage medium. The method is applied to terminal equipment and includes: performing AR positioning at a trajectory point of the terminal equipment to obtain an AR coordinate of the trajectory point; determining detection data corresponding to the trajectory point; the AR coordinate is a coordinate in an AR coordinate system of the terminal equipment; the trajectory point is a position of the terminal equipment in roaming test of a detection area; generating a movement trajectory of the terminal equipment based on the AR coordinate of the trajectory point, and displaying the movement trajectory and the detection data. By obtaining the detection data and the corresponding AR coordinate of each trajectory point in real time in the roaming test, the subsequent evaluation of the deployment of the AP is more accurate. The movement trajectory of the terminal equipment is generated based on the AR coordinate of the trajectory point. By displaying the movement trajectory, the detection data and a real scene corresponding to the detection area, the user can plan the subsequent detection route more reasonably in combination with the information, and effectively perform the roaming test.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a roaming test method, apparatus, terminal device, and storage medium. Background Technology

[0002] A wireless access point (AP) is an access point for a wireless network, serving as the point through which wireless devices connect to a wired network. In implementation, multiple APs need to be deployed in certain areas, and roaming tests are required after deployment to evaluate the AP's performance.

[0003] In related technologies, roaming tests are conducted by having testers carry mobile phones and move around the deployment area, interacting with the APs to obtain roaming test results; then, the rationality of the AP deployment is evaluated based on the roaming test results.

[0004] However, in the above methods, testers can only rely on experience to move their mobile phones around the deployment area, which may result in blind spots in detection. In addition, the above methods can only obtain the changes in roaming test data over time, but cannot determine the location corresponding to the roaming test data, making it difficult to accurately evaluate the deployment of APs. Summary of the Invention

[0005] This application provides a roaming test method, apparatus, terminal device, and storage medium for acquiring the movement trajectory during roaming testing.

[0006] In a first aspect, embodiments of this application provide a roaming testing method applied to a terminal device, the method comprising:

[0007] Augmented Reality (AR) positioning is performed on the trajectory points of the terminal device to obtain the AR coordinates of the trajectory points; and detection data corresponding to the trajectory points is determined; wherein, the AR coordinates are coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device in the roaming test of the detection area;

[0008] Based on the AR coordinates of the trajectory points, the movement trajectory of the terminal device is generated, and the movement trajectory and the detection data are displayed.

[0009] The above solution, during roaming testing, not only acquires the detection data corresponding to the trajectory points (the location of the terminal device) in real time, but also acquires the AR coordinates of the trajectory points in the AR coordinate system in real time through AR positioning. That is, it acquires the detection data and corresponding AR coordinates (location information) of each trajectory point in real time during roaming testing. In this way, after the roaming test, the deployment of APs can be more accurately evaluated based on the detection data and corresponding AR coordinates of the trajectory points. In addition, the solution generates the movement trajectory of the terminal device based on the AR coordinates of the trajectory points (which will be updated in real time as the terminal device moves). By displaying the movement trajectory, detection data, and the real-world map corresponding to the detection area, users can know the detection results of the detected trajectory points based on the movement trajectory and detection data. Combining this information, users can plan subsequent detection routes more rationally and conduct roaming tests more effectively.

[0010] In some optional implementations, before generating the movement trajectory of the terminal device, the method further includes:

[0011] In response to the floor plan of the detection area, the image coordinates and the first AR coordinates of a first positioning point in the detection area are determined; wherein, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device.

[0012] Based on the image coordinates and the first AR coordinates of the first positioning point, a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined.

[0013] Based on the AR coordinates of the trajectory points, the movement trajectory of the terminal device is generated, including:

[0014] If the AR coordinate system corresponding to the terminal device has not shifted, then based on the first adjustment ratio, the first AR coordinate of the trajectory point is converted into the image coordinate of the trajectory point;

[0015] Based on the image coordinates of the trajectory points, the movement trajectory of the terminal device is generated in the floor plan.

[0016] The above scheme uses an AR coordinate system for terminal device positioning; the floor plan is an image and uses an image coordinate system; at least two first positioning points are used, and the image coordinates and first AR coordinates of the first positioning points are determined; then a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined, and the first AR coordinates of the trajectory points are transformed based on the first adjustment ratio to obtain the coordinates in the image coordinate system of the floor plan, thereby generating a movement trajectory in the floor plan. The floor plan has an indoor distribution structure of the detection area, which can more effectively guide the user to plan the subsequent detection route.

[0017] Some optional implementations also include:

[0018] If the AR coordinate system corresponding to the terminal device is offset, the image coordinates of the second positioning point and the second AR coordinates are determined; wherein, the second positioning point includes at least two positioning points; the second AR coordinates are the coordinates in the offset AR coordinate system of the terminal device;

[0019] Based on the image coordinates and the second AR coordinates of the second positioning point, a second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined.

[0020] Generating the movement trajectory of the terminal device based on the AR coordinates of the trajectory points further includes:

[0021] If the AR coordinate system corresponding to the terminal device is offset, the second AR coordinates of the offset trajectory point are converted into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0022] Based on the image coordinates of the offset trajectory points, the movement trajectory of the terminal device after offset is generated in the floor plan.

[0023] In the above scheme, after the AR coordinate system corresponding to the terminal device is offset, the transformation relationship between the AR coordinate system and the image coordinate system will also change, and the previous first adjustment ratio will no longer be applicable. After the offset, at least two second positioning points are used, and the image coordinates and second AR coordinates (coordinates under the offset AR coordinate system) of the second positioning points are determined. Then, the second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined. Based on the second adjustment ratio, the second AR coordinates of the offset trajectory points are transformed to obtain the coordinates under the image coordinate system of the floor plan, and then the movement trajectory is generated in the floor plan, so that the movement trajectory can be accurately generated even in the AR offset scene.

[0024] In some optional implementations, if the AR coordinate system corresponding to the terminal device is offset, the method further includes:

[0025] Based on the first adjustment ratio and the second adjustment ratio, the second AR coordinates of the offset trajectory points are transformed into the first AR coordinates in the initial AR coordinate system;

[0026] After the roaming test is completed, the roaming trajectory corresponding to the roaming test is generated based on the first AR coordinates of all trajectory points.

[0027] In the above scheme, if the AR coordinate system corresponding to the terminal device shifts during the roaming test, the AR coordinates of the trajectory points are not AR coordinates under the unified AR coordinate system. By converting the second AR coordinates of the shifted trajectory points into the first AR coordinates in the initial AR coordinate system, the first AR coordinates of all trajectory points under the unified coordinate standard during the roaming test are obtained, thereby generating the roaming trajectory of the entire roaming test under the unified coordinate system.

[0028] Some optional implementations also include:

[0029] The target trajectory points are marked in the movement trajectory.

[0030] The above scheme marks the target trajectory points in the movement trajectory, thereby recording some locations that need special attention in the trajectory.

[0031] In some optional implementations, displaying the movement trajectory and the detection data further includes:

[0032] The collected real-world image of the detection area is displayed.

[0033] The above solution displays the real-world image of the detected area, making it easier for users to plan routes more rationally based on the actual scene ahead, such as obstacle avoidance and going to specific areas.

[0034] Some optional implementations also include:

[0035] If the real-scene image contains target trajectory points, then the annotation information corresponding to the target trajectory points is rendered in the real-scene image.

[0036] The above solution uses AR real-world marking to render the annotation information corresponding to the target trajectory points in the real-world image, thereby displaying the locations that need to be focused on more intuitively.

[0037] In some alternative implementations, the target trajectory point is determined in the following manner:

[0038] In response to a user annotation instruction, the trajectory point corresponding to the user annotation instruction is determined as the target trajectory point; wherein the annotation type of the target trajectory point is user annotation; and / or

[0039] The trajectory point representing the AP switching is determined as the target trajectory point; wherein, the annotation type of the target trajectory point is roaming.

[0040] Some optional implementations also include:

[0041] If the real-view image contains a target area, then the AP information corresponding to the target area is rendered in the real-view image; wherein, the target area is the location of the AP currently connected to by the terminal device.

[0042] The above solution renders the AP information corresponding to the location of the AP currently connected to the terminal device in the real-world image, prompting the user to indicate the location of the AP and further guiding the user to plan the roaming route reasonably.

[0043] Some optional implementations also include:

[0044] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming trajectory, number of roamings, signal strength change curve, and delay change curve corresponding to the roaming test.

[0045] The above solution generates roaming reports, which can then be used to infer where roaming anomalies, network anomalies, and fluctuations occur, thereby providing better signal coverage.

[0046] Secondly, embodiments of this application provide a roaming testing device applied to a terminal device, the device comprising:

[0047] An AR positioning module is used to perform AR positioning on the trajectory points of the terminal device to obtain the AR coordinates of the trajectory points; wherein, the AR coordinates are coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device during the roaming test in the detection area.

[0048] The detection module is used to determine the detection data corresponding to the trajectory points;

[0049] A movement trajectory generation module is used to generate the movement trajectory of the terminal device based on the AR coordinates of the trajectory points;

[0050] The display module is used to display the movement trajectory and the detection data.

[0051] In some optional implementations, before generating the movement trajectory of the terminal device, the movement trajectory generation module is further configured to:

[0052] In response to the floor plan of the detection area, the image coordinates and the first AR coordinates of a first positioning point in the detection area are determined; wherein, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device.

[0053] Based on the image coordinates and the first AR coordinates of the first positioning point, a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined.

[0054] The movement trajectory generation module is specifically used for:

[0055] If the AR coordinate system corresponding to the terminal device has not shifted, then based on the first adjustment ratio, the first AR coordinate of the trajectory point is converted into the image coordinate of the trajectory point;

[0056] Based on the image coordinates of the trajectory points, the movement trajectory of the terminal device is generated in the floor plan.

[0057] In some optional implementations, the movement trajectory generation module is further configured to:

[0058] If the AR coordinate system corresponding to the terminal device is offset, the image coordinates of the second positioning point and the second AR coordinates are determined; wherein, the second positioning point includes at least two positioning points; the second AR coordinates are the coordinates in the offset AR coordinate system of the terminal device;

[0059] Based on the image coordinates and the second AR coordinates of the second positioning point, a second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined.

[0060] In some optional implementations, the movement trajectory generation module is further configured to:

[0061] If the AR coordinate system corresponding to the terminal device is offset, the second AR coordinates of the offset trajectory point are converted into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0062] Based on the image coordinates of the offset trajectory points, the movement trajectory of the terminal device after offset is generated in the floor plan.

[0063] In some optional implementations, a coordinate transformation module is also included for:

[0064] If the AR coordinate system corresponding to the terminal device is offset, based on the first adjustment ratio and the second adjustment ratio, the second AR coordinate of the offset trajectory point is converted into the first AR coordinate in the initial AR coordinate system;

[0065] After the roaming test is completed, the roaming trajectory corresponding to the roaming test is generated based on the first AR coordinates of all trajectory points.

[0066] In some optional implementations, the movement trajectory generation module is further configured to:

[0067] The target trajectory points are marked in the movement trajectory.

[0068] In some alternative implementations, the display module is further configured to:

[0069] The collected real-world image of the detection area is displayed.

[0070] In some alternative implementations, the display module is further configured to:

[0071] If the real-scene image contains target trajectory points, then the annotation information corresponding to the target trajectory points is rendered in the real-scene image.

[0072] In some alternative implementations, the target trajectory point is determined in the following manner:

[0073] In response to a user annotation instruction, the trajectory point corresponding to the user annotation instruction is determined as the target trajectory point; wherein the annotation type of the target trajectory point is user annotation; and / or

[0074] The trajectory point representing the AP switching is determined as the target trajectory point; wherein, the annotation type of the target trajectory point is roaming.

[0075] In some alternative implementations, the display module is further configured to:

[0076] If the real-view image contains a target area, then the AP information corresponding to the target area is rendered in the real-view image; wherein, the target area is the location of the AP currently connected to by the terminal device.

[0077] Some optional implementations also include a report generation module for:

[0078] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming trajectory, number of roamings, signal strength change curve, and delay change curve corresponding to the roaming test.

[0079] Thirdly, embodiments of this application provide a terminal device, including at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor performs any of the roaming test methods described in the first aspect above.

[0080] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program executable by a processor, which, when run on the processor, causes the processor to perform any of the roaming test methods described in the first aspect above. Attached Figure Description

[0081] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0082] Figure 1 A flowchart illustrating the first roaming test method provided in this application embodiment;

[0083] Figure 2 A schematic diagram of a first user interface provided for an embodiment of this application;

[0084] Figure 3 A flowchart illustrating the second roaming test method provided in this application embodiment;

[0085] Figure 4 A schematic diagram of a second user interface provided in an embodiment of this application;

[0086] Figure 5 A flowchart illustrating the third roaming test method provided in this application embodiment;

[0087] Figure 6 A schematic diagram of a third user interface provided in the embodiments of this application;

[0088] Figure 7 This is a schematic diagram of the movement trajectory provided in the embodiments of this application;

[0089] Figure 8 This is a schematic diagram of a first real-world scene provided in an embodiment of this application;

[0090] Figure 9 This is a schematic diagram of a second real-world scene provided in an embodiment of this application;

[0091] Figure 10 This is a schematic diagram of a third real-world scene provided in the embodiments of this application;

[0092] Figure 11 This is a schematic diagram of the roaming test device provided in the embodiments of this application;

[0093] Figure 12 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0094] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0095] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0096] The term "and / or" describes the relationship between related objects, indicating that there can be three relationships. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.

[0097] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the term "connection" should be interpreted broadly. For example, it can refer to a direct connection, an indirect connection through an intermediate medium, or a connection within two devices. Those skilled in the art can understand the specific meaning of the above term in this application based on the specific circumstances.

[0098] In this embodiment, "terminal device" refers to the device carried by the user during the roaming test, which can be a handheld device, such as a mobile phone.

[0099] During implementation, multiple APs need to be deployed in some areas, and roaming tests are required after deployment to evaluate the deployment status of the APs.

[0100] In related technologies, roaming tests are conducted by having testers carry mobile phones and move around the deployment area, interacting with the APs to obtain roaming test results; then, the rationality of the AP deployment is evaluated based on the roaming test results.

[0101] However, in the above methods, testers can only rely on experience to move their mobile phones around the deployment area, which may result in blind spots in detection. In addition, the above methods can only obtain the changes in roaming test data over time, but cannot determine the location corresponding to the roaming test data, making it difficult to accurately evaluate the deployment of APs.

[0102] In some embodiments, by controlling a programmable test vehicle to run within a test scenario along a preset trajectory, the programmable test vehicle establishes wireless connections with multiple roaming test APs within the test scenario through a test wireless network card, thereby determining the test data along the preset trajectory.

[0103] However, the above control method is complex and requires an additional programmed test vehicle to implement.

[0104] In view of this, embodiments of this application propose a roaming test method, apparatus, terminal device, and storage medium. The method is applied to a terminal device and includes: performing AR positioning on a trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; and determining the detection data corresponding to the trajectory point; wherein the AR coordinates are coordinates in the AR coordinate system of the terminal device; the trajectory point is the location of the terminal device in the roaming test of the detection area; generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory point; and displaying the movement trajectory and the detection data.

[0105] The above solution, during roaming testing, not only acquires the detection data corresponding to the trajectory points (the location of the terminal device) in real time, but also acquires the AR coordinates of the trajectory points in the AR coordinate system in real time through AR positioning. That is, it acquires the detection data and corresponding AR coordinates (location information) of each trajectory point in real time during roaming testing. In this way, after the roaming test, the deployment of APs can be more accurately evaluated based on the detection data and corresponding AR coordinates of the trajectory points. In addition, the solution generates the movement trajectory of the terminal device based on the AR coordinates of the trajectory points (which will be updated in real time as the terminal device moves). By displaying the movement trajectory, detection data, and the real-world map corresponding to the detection area, users can know the detection results of the detected trajectory points based on the movement trajectory and detection data. Combining this information, users can plan subsequent detection routes more rationally and conduct roaming tests more effectively.

[0106] The technical solution of this application and how it solves the above-mentioned technical problems will be described in detail below with reference to the accompanying drawings and specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0107] Figure 1 A flowchart illustrating the first roaming test method provided in this application embodiment is shown below. Figure 1 As shown, it includes the following steps:

[0108] Step S101: Perform AR positioning on the trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; and determine the detection data corresponding to the trajectory point.

[0109] Wherein, the AR coordinates are the coordinates in the AR coordinate system of the terminal device; the trajectory point is the location of the terminal device during the roaming test in the detection area.

[0110] During implementation, in order to more accurately evaluate the deployment of APs, not only test data is acquired in real time, but also location information is acquired in real time.

[0111] Since APs are typically deployed indoors to provide wireless networks for indoor areas, and roaming tests are usually conducted indoors, this embodiment uses terminal devices for AR positioning, which is more suitable for indoor positioning.

[0112] By acquiring the detection data and corresponding AR coordinates (location information) of each trajectory point in real time during the roaming test, the deployment of the AP can be more accurately evaluated based on the detection data and corresponding AR coordinates of the trajectory points after the roaming test is completed.

[0113] Step S102: Generate the movement trajectory of the terminal device based on the AR coordinates of the trajectory points.

[0114] During roaming tests, if testers rely solely on experience to move the terminal device, there may be blind spots in the detection. In other words, there may be an area that the terminal device has not traversed, and the trajectory points may be far away from that area, which will also affect the test results.

[0115] Based on this, this embodiment also generates the movement trajectory of the terminal device based on the AR coordinates of the trajectory points (which will be updated in real time as the terminal device moves), so that users can know the trajectory points that have been detected in a timely manner, and can also know the undetected areas by combining the movement trajectory with the overall layout of the area to be tested.

[0116] Step S103: Display the movement trajectory and the detection data.

[0117] In this embodiment, after determining the current movement trajectory, the movement trajectory and detection data are displayed. Based on the movement trajectory and detection data, the user can know the detection results corresponding to the detected trajectory points. Combining this information, the user can more rationally plan the subsequent detection route and conduct roaming tests more effectively.

[0118] It is understandable that the terminal device is moving, and new trajectory points will be added continuously during roaming testing. Therefore, a movement trajectory will be generated in real time (adding new trajectory points on the previous movement trajectory), so that users can know the route they have taken in a timely manner.

[0119] This embodiment does not specifically limit the detection data, such as one or more of the following: signal strength, currently connected AP, latency, packet loss rate, negotiation rate, roaming related information, etc. All of this information can be determined based on the interaction messages between the terminal device and the AP.

[0120] See Figure 2 As shown, this is a user interface provided in this embodiment. The upper left corner of the user interface displays the signal strength change curve, and the upper right corner displays the current network parameters. Below the signal strength change curve and the current network parameters, roaming-related information is displayed; these are all detection data.

[0121] Below the roaming-related information in this user interface is the current movement trajectory.

[0122] It is understandable that the above Figure 2 The user interface shown is merely an illustrative example. In practice, the positions of different detection data can be swapped, or the movement trajectory can be set at the top and the detection data displayed at the bottom, etc. This embodiment does not impose any specific limitations on this.

[0123] In practice, the terminal device can rotate its movement trajectory based on its current orientation information (its own orientation) (the trajectory itself does not change), providing a more intuitive user experience. For example, if the terminal device turns left, the movement trajectory will also turn left, remaining forward from the user's perspective. This orientation information is calculated from the terminal device's current forward vector and rotation angle.

[0124] This embodiment does not limit the specific implementation of the movement trajectory. The movement trajectory can use a uniform line; or, different lines can be used according to different signal strengths, such as green lines for strong signals, yellow lines for average signals, and red lines for weak signals.

[0125] The above solution, during roaming testing, not only acquires the detection data corresponding to the trajectory points (the location of the terminal device) in real time, but also acquires the AR coordinates of the trajectory points in the AR coordinate system in real time through AR positioning. That is, it acquires the detection data and corresponding AR coordinates (location information) of each trajectory point in real time during roaming testing. In this way, after the roaming test, the deployment of APs can be more accurately evaluated based on the detection data and corresponding AR coordinates of the trajectory points. In addition, the solution generates the movement trajectory of the terminal device based on the AR coordinates of the trajectory points (which will be updated in real time as the terminal device moves). By displaying the movement trajectory, detection data, and the real-world map corresponding to the detection area, users can know the detection results of the detected trajectory points based on the movement trajectory and detection data. Combining this information, users can plan subsequent detection routes more rationally and conduct roaming tests more effectively.

[0126] This application provides a flowchart illustrating the second roaming test method, as shown in the embodiments below. Figure 3 As shown, it includes the following steps:

[0127] Step S301: In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area.

[0128] Wherein, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device.

[0129] During implementation, floor plans of the detection area can be uploaded to the terminal device, or multiple floor plans can be pre-configured in the terminal device for users to choose from. The floor plan shows the indoor distribution structure of the detection area. Therefore, generating a movement trajectory in the floor plan can more effectively guide users to plan the subsequent detection route.

[0130] However, the AR coordinate system used for terminal device positioning is the initial AR coordinate system if the AR coordinate system corresponding to the terminal device has not shifted; the floor plan is an image and uses the image coordinate system; only by determining the image coordinates of the trajectory points in the image coordinate system can a movement trajectory be generated in the floor plan.

[0131] Based on this, this embodiment uses at least two first positioning points and determines the image coordinates and first AR coordinates of the first positioning points; then it determines the adjustment ratio between the image coordinate system and the initial AR coordinate system, and coordinate transformation can be performed based on the adjustment ratio.

[0132] Step S302: Based on the image coordinates of the first positioning point and the first AR coordinates, determine the first adjustment ratio between the image coordinate system and the initial AR coordinate system.

[0133] As described above, by determining the image coordinates and the first AR coordinates of the first positioning point, and then determining the adjustment ratio between the image coordinate system and the initial AR coordinate system, coordinate transformation can be performed based on the adjustment ratio.

[0134] For example, the first adjustment ratio may include a first horizontal adjustment ratio and a first vertical adjustment ratio; the first horizontal adjustment ratio is determined based on the difference between the image horizontal coordinates of different first positioning points and the difference between the first AR horizontal coordinates; the first vertical adjustment ratio is determined based on the difference between the image vertical coordinates of different first positioning points and the difference between the first AR vertical coordinates.

[0135] The following specific example will illustrate this:

[0136] The coordinates of the first positioning point 11 in the image coordinate system are (a_11, b_11), and the coordinates in the initial AR coordinate system are (X_11, Y_11); the coordinates of the second positioning point 12 in the image coordinate system are (a_12, b_12), and the coordinates in the initial AR coordinate system are (X_12, Y_12).

[0137] The first horizontal adjustment ratio K_x = (a_12-a_11) / (X_12-X_11); the first vertical adjustment ratio K_y = (b_12-b_11) / (Y_12-Y_11).

[0138] The above example uses two first positioning points for illustration. In implementation, more first positioning points can be used. For example, the first lateral adjustment ratio and the first longitudinal adjustment ratio can be determined based on different first positioning points. Alternatively, the first lateral adjustment ratio and the first longitudinal adjustment ratio corresponding to each pair of first positioning points can be determined, and the final first lateral adjustment ratio and the first longitudinal adjustment ratio can be obtained by combining them. For example, the final first lateral adjustment ratio can be obtained by averaging the first lateral adjustment ratios corresponding to each pair of first positioning points, and the final first longitudinal adjustment ratio can be obtained by averaging the first longitudinal adjustment ratios corresponding to each pair of first positioning points.

[0139] Step S303: Perform AR positioning on the trajectory point of the terminal device to obtain the first AR coordinate of the trajectory point; and determine the detection data corresponding to the trajectory point.

[0140] The specific implementation of step S303 can be found in the above embodiments, and will not be repeated here.

[0141] Step S304: Based on the first adjustment ratio, convert the first AR coordinates of the trajectory point into the image coordinates of the trajectory point.

[0142] Since the first adjustment ratio represents the transformation relationship between the AR coordinate system and the image coordinate system, the first AR coordinates of the trajectory point can be transformed into the image coordinates of the trajectory point in the above floor plan based on the first adjustment ratio.

[0143] For example, the first adjustment ratio may include a first horizontal adjustment ratio and a first vertical adjustment ratio;

[0144] Based on the difference between the first AR abscissa of the trajectory point and the first AR abscissa of any first positioning point, the change in the first AR abscissa is determined. Based on the change in the first AR abscissa and the first horizontal adjustment ratio, the change in the first image abscissa is determined. By adding the change in the first image abscissa to the image abscissa of the first positioning point, the image abscissa of the trajectory point can be obtained.

[0145] Based on the difference between the first AR ordinate of the trajectory point and the first AR ordinate of any first positioning point, the change in the first AR ordinate is determined. Based on the change in the first AR ordinate and the first vertical adjustment ratio, the change in the first image ordinate is determined. By adding this change in the first image ordinate to the image ordinate of the first positioning point, the image ordinate of the trajectory point can be obtained.

[0146] Taking the coordinates of the first positioning point 11 in the image coordinate system as (a_11, b_11) and its coordinates in the initial AR coordinate system as (X_11, Y_11) as an example:

[0147] The image ax-coordinate of trajectory point m is a_m = K_x(X_m-X_11)+a_11; where K_x is the first horizontal adjustment ratio, X_m is the first AR ax-coordinate of trajectory point m, X_11 is the first AR ax-coordinate of the first positioning point 11, and a_11 is the image ax-coordinate of the first positioning point 11.

[0148] The image ordinate b_m of trajectory point m is given by K_y(Y_m-Y_11)+b_11; where K_y is the first vertical adjustment ratio, Y_m is the first AR ordinate of trajectory point m, Y_11 is the first AR ordinate of the first positioning point 11, and b_11 is the image ordinate of the first positioning point 11.

[0149] Step S305: Based on the image coordinates of the trajectory points, generate the movement trajectory of the terminal device in the floor plan.

[0150] Since the image coordinates of the trajectory points are the same as those in the image coordinate system of the floor plan, the movement trajectory of the terminal device can be generated by plotting points on the floor plan based on the image coordinates of the trajectory points.

[0151] Step S306: Display the movement trajectory and the detection data.

[0152] In this embodiment, the movement trajectory is formed in the floor plan. Therefore, displaying the movement trajectory means displaying the floor plan containing the movement trajectory.

[0153] See Figure 4 As shown, this embodiment provides a user interface in which the movement trajectory is generated from the floor plan.

[0154] The above Figure 4 The user interface shown is also an illustrative example. The positions of the floor plan and the detection data can be changed. In addition, the user interface can display the entire floor plan or a part of the floor plan (for example, when the floor plan is large, only a part of the floor plan can be displayed). This embodiment does not make specific limitations in this regard.

[0155] The above scheme uses an AR coordinate system for terminal device positioning; the floor plan is an image and uses an image coordinate system; at least two first positioning points are used, and the image coordinates and first AR coordinates of the first positioning points are determined; then a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined, and the first AR coordinates of the trajectory points are transformed based on the first adjustment ratio to obtain the coordinates in the image coordinate system of the floor plan, thereby generating a movement trajectory in the floor plan. The floor plan has an indoor distribution structure of the detection area, which can more effectively guide the user to plan the subsequent detection route.

[0156] This application provides a flowchart illustrating a third roaming test method, as shown in the embodiments below. Figure 5 As shown, it includes the following steps:

[0157] Step S501: If the AR coordinate system corresponding to the terminal device is offset, determine the image coordinates and the second AR coordinates of the second positioning point.

[0158] The second positioning point includes at least two positioning points; the second AR coordinate is the coordinate in the offset AR coordinate system of the terminal device.

[0159] During implementation, if the AR coordinate system corresponding to the terminal device shifts, the transformation relationship between the AR coordinate system and the image coordinate system will also change.

[0160] Based on this, this embodiment uses at least two second positioning points and determines the image coordinates and second AR coordinates of the second positioning points; then it determines the adjustment ratio between the image coordinate system and the offset AR coordinate system, and coordinate transformation can be performed based on the adjustment ratio.

[0161] This embodiment does not specifically limit the method by which the terminal device determines the shift in the AR coordinate system, for example:

[0162] 1. The terminal device will acquire images during the AR positioning process. If the image acquired by the terminal device does not have relevant feature points, it is determined that the AR coordinate system has shifted.

[0163] 2. When the user's current position in the perceived movement trajectory does not match their actual location, a command representing the offset is triggered. The terminal device responds to this command and determines that the AR coordinate system has shifted.

[0164] Step S502: Based on the image coordinates of the second positioning point and the second AR coordinates, determine the second adjustment ratio between the image coordinate system and the offset AR coordinate system.

[0165] As described above, by determining the image coordinates and the second AR coordinates of the second positioning point, and then determining the adjustment ratio between the image coordinate system and the offset AR coordinate system, the coordinate transformation of the offset trajectory points can be performed based on the adjustment ratio.

[0166] For example, the second adjustment ratio may include a second horizontal adjustment ratio and a second vertical adjustment ratio; the second horizontal adjustment ratio is determined based on the difference between the image horizontal coordinates of different second positioning points and the difference between the second AR horizontal coordinates; the second vertical adjustment ratio is determined based on the difference between the image vertical coordinates of different second positioning points and the difference between the second AR vertical coordinates. The determination method is similar to that of the first adjustment ratio described above, and will not be repeated here.

[0167] Step S503: Perform AR positioning on the trajectory point of the terminal device to obtain the second AR coordinates of the trajectory point; and determine the detection data corresponding to the trajectory point.

[0168] The specific implementation of step S503 can be found in the above embodiments, and will not be repeated here.

[0169] Step S504: Based on the second adjustment ratio, convert the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point.

[0170] Since the second adjustment ratio represents the transformation relationship between the offset AR coordinate system and the image coordinate system, the second AR coordinates of the offset trajectory points can be transformed into image coordinates in the above floor plan based on the second adjustment ratio.

[0171] For example, the second adjustment ratio may include a second horizontal adjustment ratio and a second vertical adjustment ratio; the change in the second AR horizontal coordinate is determined based on the difference between the second AR horizontal coordinate of the trajectory point and the second AR horizontal coordinate of any second positioning point; the change in the second image horizontal coordinate is determined based on the change in the second AR horizontal coordinate and the second horizontal adjustment ratio; by adding the change in the second image horizontal coordinate to the image horizontal coordinate of the second positioning point, the image horizontal coordinate of the trajectory point can be obtained.

[0172] The change in the second AR ordinate is determined based on the difference between the second AR ordinate of the trajectory point and the second AR ordinate of any second positioning point. The change in the second AR ordinate is then determined based on the change in the second AR ordinate and the second vertical adjustment ratio. By adding this change in the second image ordinate to the image ordinate of the aforementioned second positioning point, the image ordinate of the trajectory point can be obtained.

[0173] Taking the second positioning point 21 with coordinates (a_21, b_21) in the image coordinate system and (X_21, Y_21) in the offset AR coordinate system as an example:

[0174] The image abscissa of trajectory point n is a_n = K′_x(X′_n-X_21)+a_21; where K′_x is the second horizontal adjustment ratio, X′_n is the second AR abscissa of trajectory point n, X_21 is the first AR abscissa of the second positioning point 21, and a_21 is the image abscissa of the second positioning point 21.

[0175] The image ordinate b_n of trajectory point n is given by K′_y(Y′_n-Y_21)+b_21; where K′_y is the second vertical adjustment ratio, Y′_n is the second AR ordinate of trajectory point n, Y_21 is the first AR ordinate of the second positioning point 21, and b_21 is the image ordinate of the second positioning point 21.

[0176] Step S505: Based on the image coordinates of the offset trajectory points, generate the offset movement trajectory of the terminal device in the floor plan.

[0177] Since the image coordinates of the trajectory points are the same as those in the image coordinate system of the floor plan, the movement trajectory of the terminal device can be generated by plotting points on the floor plan based on the image coordinates of the trajectory points.

[0178] As mentioned above, the terminal device is in motion, and new trajectory points will be continuously added during the roaming test to generate a movement trajectory in real time (adding new trajectory points on the previous movement trajectory). Therefore, this embodiment also includes a movement trajectory generation process and a display process before the offset, which can be referred to in the above embodiment and will not be repeated here.

[0179] Step S506: Display the movement trajectory and the detection data.

[0180] The specific implementation of step S506 can be found in the above embodiments, and will not be repeated here.

[0181] In the above scheme, after the AR coordinate system corresponding to the terminal device is offset, the transformation relationship between the AR coordinate system and the image coordinate system will also change, and the previous first adjustment ratio will no longer be applicable. After the offset, at least two second positioning points are used, and the image coordinates and second AR coordinates (coordinates under the offset AR coordinate system) of the second positioning points are determined. Then, the second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined. Based on the second adjustment ratio, the second AR coordinates of the offset trajectory points are transformed to obtain the coordinates under the image coordinate system of the floor plan, and then the movement trajectory is generated in the floor plan, so that the movement trajectory can be accurately generated even in the AR offset scene.

[0182] In some optional implementations, if the AR coordinate system corresponding to the terminal device is offset, the following steps are also performed:

[0183] Based on the first adjustment ratio and the second adjustment ratio, the second AR coordinates of the offset trajectory points are transformed into the first AR coordinates in the initial AR coordinate system;

[0184] After the roaming test is completed, the roaming trajectory corresponding to the roaming test is generated based on the first AR coordinates of all trajectory points.

[0185] In practice, if the AR coordinate system corresponding to the terminal device shifts during the roaming test, the AR coordinates of the trajectory points are not AR coordinates in the AR coordinate system. It is necessary to convert the second AR coordinates of the shifted trajectory points into the first AR coordinates in the initial AR coordinate system in order to obtain AR coordinates of all trajectory points with a unified coordinate standard during the roaming test.

[0186] For example, for trajectory point n, the image coordinates determined based on the first adjustment ratio and the first AR coordinates are theoretically the same as the image coordinates determined based on the second adjustment ratio and the second AR coordinates. Therefore, the corresponding first AR coordinates can be determined based on the first adjustment ratio, the second adjustment ratio, and the second AR coordinates.

[0187] The methods for determining the first adjustment ratio and the second adjustment ratio can be found in the above embodiments, and will not be repeated here.

[0188] The following is a specific example illustrating AR coordinate system transformation:

[0189] a_n=K_x(X_n-X_11)+a_11=K′_x(X′_n-X_21)+a_21;

[0190] b_n=K_y(Y_n-Y_11)+b_11=K′_y(Y_n-Y_21)+b_21;

[0191] From the above two formulas, we can deduce that X_n=(X′_n-X_21)K′_x / K_x+(a_21-a_11) / K_x+X_11;

[0192] Y_n=(Y′_n-Y_21)K′_y / K_y+(b_21-b_11) / K_y+Y_11;

[0193] Wherein, the coordinates of the first positioning point 11 in the image coordinate system are (a_11, b_11), and the coordinates in the initial AR coordinate system are (X_11, Y_11); the coordinates of the second positioning point 21 in the image coordinate system are (a_21, b_21), and the coordinates in the offset AR coordinate system are (X_21, Y_21); K_x is the first horizontal adjustment ratio, K_y is the first vertical adjustment ratio, K′_x is the second horizontal adjustment ratio, K′_y is the second vertical adjustment ratio, and the coordinates of the trajectory point n in the offset AR coordinate system are (X′_n, Y′_n), and the coordinates in the initial AR coordinate system are (X_n, Y_n).

[0194] After the roaming test is completed, a roaming trajectory in a unified coordinate system is generated based on the first AR coordinates of all trajectory points in the initial AR coordinate system.

[0195] It is understandable that the above-mentioned movement trajectory is a real-time trajectory, while the roaming trajectory is the overall trajectory.

[0196] Since the roaming trajectory is generated based on AR coordinates of a unified coordinate standard, the entire roaming test trajectory can be roamed; therefore, a roaming report can be generated based on the roaming trajectory, and anomaly identification can be performed based on the roaming report.

[0197] In the above scheme, if the AR coordinate system corresponding to the terminal device shifts during the roaming test, the AR coordinates of the trajectory points are not AR coordinates under the unified AR coordinate system. By converting the second AR coordinates of the shifted trajectory points into the first AR coordinates in the initial AR coordinate system, the first AR coordinates of all trajectory points under the unified coordinate standard during the roaming test are obtained, thereby generating the roaming trajectory of the entire roaming test under the unified coordinate system.

[0198] In some optional implementations, displaying the movement trajectory and the detection data further includes:

[0199] The collected real-world image of the detection area is displayed.

[0200] In other words, this embodiment not only displays the movement trajectory and detection data, but also displays a real-scene image of the detection area collected by the terminal device, such as a real-scene image of the area in front of the terminal device obtained by image acquisition through the terminal device's camera.

[0201] See Figure 6 As shown, a real-world image is displayed below the detection data and above the movement trajectory.

[0202] It is understandable that the above Figure 6The user interface shown is merely an illustrative example. In practice, the positions of different detection data can be swapped, as can the positions of detection data, movement trajectory, and real-world image. Alternatively, these three pieces of information can be displayed separately, such as covering the real-world image with the movement trajectory, occupying part of the real-world image area. This embodiment does not impose any specific limitations on this.

[0203] The above solution displays the real-world image of the detected area, making it easier for users to plan routes more rationally based on the actual scene ahead, such as obstacle avoidance and going to specific areas.

[0204] In some optional implementations, some trajectory points can be marked to obtain the target trajectory point, which can be determined in, but is not limited to, the following ways:

[0205] In response to a user annotation instruction, the trajectory point corresponding to the user annotation instruction is determined as the target trajectory point; wherein the annotation type of the target trajectory point is user annotation; and / or

[0206] The trajectory point representing the AP switching is determined as the target trajectory point; wherein, the annotation type of the target trajectory point is roaming.

[0207] For example, if a user wants to mark a specific trajectory point, such as a trajectory point with a poor signal or a trajectory point with an abnormal signal, a user marking instruction can be triggered. For example, the user can click on the corresponding location of the target trajectory point in the user interface of the terminal device and enter the content to be marked. The terminal device will determine the trajectory point corresponding to the user marking instruction as the target trajectory point, and the marking type of the target trajectory point will be user marking.

[0208] If the terminal device determines that an AP switch has occurred at a certain trajectory point, it designates that trajectory point as the target trajectory point, and the labeling type of the target trajectory point is roaming.

[0209] In some optional implementations, the following steps are further performed in addition to the above embodiments:

[0210] The target trajectory points are marked in the movement trajectory.

[0211] As mentioned above, there are various types of target trajectory points, such as user-annotated target trajectory points and roaming target trajectory points. Target trajectory points are marked with special symbols in the movement trajectory, and corresponding types can also be added.

[0212] See Figure 7 As shown, the target trajectory points are marked with dots in the movement trajectory, and the corresponding types are added in the form of dialog boxes.

[0213] The above scheme marks the target trajectory points in the movement trajectory, thereby recording some locations that need special attention in the trajectory.

[0214] In some optional implementations, the following steps are further performed in addition to the above embodiments:

[0215] If the real-scene image contains target trajectory points, then the annotation information corresponding to the target trajectory points is rendered in the real-scene image.

[0216] This embodiment displays a real-world image. If the real-world image contains target trajectory points, the annotation information corresponding to the target trajectory points can be rendered in the real-world image to perform AR real-world marking.

[0217] This embodiment does not specifically limit the annotation information. Since there are multiple types of target trajectory points, such as user-annotated target trajectory points and roaming target trajectory points, the annotation information may include the corresponding type. In addition, for user-annotated target trajectory points, the annotation information may also include the annotation content; for roaming target trajectory points, the annotation information may also include roaming-related information, such as the original AP, the AP after the handover, the handover parameters, etc.

[0218] During implementation, the movement path can also be rendered in the real-world image.

[0219] See Figure 8 As shown, for user-annotated target trajectory points, the system renders the type of the target trajectory point, its network parameters, and the content of the annotation in the real-world image. Figure 8 Taking "the signal at the stairwell entrance is not very good" as an example, in practice, users can enter other annotations.

[0220] See Figure 9 As shown, for the target trajectory point during roaming, the type of the target trajectory point is rendered in the real-world image, switching from AP1 to AP2, the AP1 address, the AP2 address, and the switching parameters, etc. Figure 9 Taking switching parameters including signal strength changes, roaming time, and roaming packet loss as an example.

[0221] The above solution uses AR real-world marking to render the annotation information corresponding to the target trajectory points in the real-world image, thereby displaying the locations that need to be focused on more intuitively.

[0222] In some optional implementations, in addition to the above embodiments, the following steps are also performed:

[0223] If the real-view image contains a target area, then the AP information corresponding to the target area is rendered in the real-view image; wherein, the target area is the location of the AP currently connected to by the terminal device.

[0224] In practice, users may not be clear about the specific location of the AP deployment. Therefore, this embodiment renders the location of the AP currently connected to the terminal device in the real-world image.

[0225] See Figure 10 As shown, the terminal device is currently connected to AP2. The corresponding AP information is rendered at the location of AP2 in the real-world image. Figure 10 For example, AP information includes the AP currently connected to the terminal device and the symbol corresponding to the AP.

[0226] The above solution renders the AP information corresponding to the location of the AP currently connected to the terminal device in the real-world image, prompting the user to indicate the location of the AP and further guiding the user to plan the roaming route reasonably.

[0227] In some optional implementations, in addition to the above embodiments, the following steps are also performed:

[0228] Generate a roaming report for the detected area;

[0229] The roaming report includes some or all of the roaming trajectory, number of roaming trips, signal strength change curve, and delay change curve corresponding to the roaming test.

[0230] The roaming trajectory can be generated in the same way as the above embodiment. The number of roaming times is the number of times the AP connected to the AR switches during the roaming test. The signal strength change curve is the change of signal strength over time, and the delay change curve is the change of delay over time.

[0231] In this embodiment, by generating a roaming report, it is possible to infer where roaming anomalies, network anomalies, and fluctuations occur, thereby providing better signal coverage.

[0232] like Figure 11 As shown, this application embodiment provides a roaming test device 1100, applied to a terminal device, the device comprising:

[0233] AR positioning module 1101 is used to perform AR positioning on the trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; wherein, the AR coordinates are coordinates in the AR coordinate system of the terminal device; the trajectory point is the location of the terminal device in the roaming test of the detection area;

[0234] Detection module 1102 is used to determine the detection data corresponding to the trajectory point;

[0235] The movement trajectory generation module 1103 is used to generate the movement trajectory of the terminal device based on the AR coordinates of the trajectory points;

[0236] Display module 1104 is used to display the movement trajectory and the detection data.

[0237] In some optional implementations, before generating the movement trajectory of the terminal device, the movement trajectory generation module 1103 is further configured to:

[0238] In response to the floor plan of the detection area, the image coordinates and the first AR coordinates of a first positioning point in the detection area are determined; wherein, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device.

[0239] Based on the image coordinates and the first AR coordinates of the first positioning point, a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined.

[0240] The movement trajectory generation module 1103 is specifically used for:

[0241] If the AR coordinate system corresponding to the terminal device has not shifted, then based on the first adjustment ratio, the first AR coordinate of the trajectory point is converted into the image coordinate of the trajectory point;

[0242] Based on the image coordinates of the trajectory points, the movement trajectory of the terminal device is generated in the floor plan.

[0243] In some optional implementations, the movement trajectory generation module 1103 is further configured to:

[0244] If the AR coordinate system corresponding to the terminal device is offset, the image coordinates of the second positioning point and the second AR coordinates are determined; wherein, the second positioning point includes at least two positioning points; the second AR coordinates are the coordinates in the offset AR coordinate system of the terminal device;

[0245] Based on the image coordinates and the second AR coordinates of the second positioning point, a second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined.

[0246] In some optional implementations, the movement trajectory generation module 1103 is further configured to:

[0247] If the AR coordinate system corresponding to the terminal device is offset, the second AR coordinates of the offset trajectory point are converted into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0248] Based on the image coordinates of the offset trajectory points, the movement trajectory of the terminal device after offset is generated in the floor plan.

[0249] In some optional implementations, a coordinate transformation module 1105 is also included, for:

[0250] If the AR coordinate system corresponding to the terminal device is offset, based on the first adjustment ratio and the second adjustment ratio, the second AR coordinate of the offset trajectory point is converted into the first AR coordinate in the initial AR coordinate system;

[0251] After the roaming test is completed, the roaming trajectory corresponding to the roaming test is generated based on the first AR coordinates of all trajectory points.

[0252] In some optional implementations, the movement trajectory generation module 1103 is further configured to:

[0253] The target trajectory points are marked in the movement trajectory.

[0254] In some alternative implementations, the display module 1104 is further configured to:

[0255] The collected real-world image of the detection area is displayed.

[0256] In some alternative implementations, the display module 1104 is further configured to:

[0257] If the real-scene image contains target trajectory points, then the annotation information corresponding to the target trajectory points is rendered in the real-scene image.

[0258] In some alternative implementations, the target trajectory point is determined in the following manner:

[0259] In response to a user annotation instruction, the trajectory point corresponding to the user annotation instruction is determined as the target trajectory point; wherein the annotation type of the target trajectory point is user annotation; and / or

[0260] The trajectory point representing the AP switching is determined as the target trajectory point; wherein, the annotation type of the target trajectory point is roaming.

[0261] In some alternative implementations, the display module 1104 is further configured to:

[0262] If the real-view image contains a target area, then the AP information corresponding to the target area is rendered in the real-view image; wherein, the target area is the location of the AP currently connected to by the terminal device.

[0263] In some optional implementations, a report generation module 1106 is also included, for:

[0264] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming trajectory, number of roamings, signal strength change curve, and delay change curve corresponding to the roaming test.

[0265] Based on the same technical concept, this application also provides a terminal device 1200, such as... Figure 12 As shown, it includes at least one processor 1201 and a memory 1202 connected to at least one processor. In this embodiment, the specific connection medium between the processor 1201 and the memory 1202 is not limited. Figure 12 Taking the connection between processor 1201 and memory 1202 via bus 1203 as an example. The bus can be divided into address bus, data bus, control bus, etc. For ease of illustration, Figure 12 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0266] The processor 1201 serves as the control center of the terminal device, connecting to various parts of the device via various interfaces and lines. It performs data processing by running or executing instructions stored in the memory 1202 and accessing data stored in the memory 1202. Optionally, the processor 1201 may include one or more processing units. The processor 1201 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and applications, while the modem processor primarily handles issuing instructions. It is understood that the modem processor may not be integrated into the processor 1201. In some embodiments, the processor 1201 and the memory 1202 may be implemented on the same chip; in other embodiments, they may be implemented on separate chips.

[0267] Processor 1201 can be a general-purpose processor, such as a central processing unit (CPU), digital signal processor, application-specific integrated circuit (ASIC), field-programmable gate array or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, capable of implementing or executing the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the roaming test method can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0268] Memory 1202, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs, and modules. Memory 1202 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (RAM), static random access memory (SRAM), programmable read-only memory (PROM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic memory, magnetic disk, optical disk, etc. Memory 1202 can be any other medium capable of carrying or storing desired program code in the form of instructions or data structures that can be accessed by a computer, but is not limited thereto. In the embodiments of this application, memory 1202 can also be a circuit or any other device capable of implementing storage functions for storing program instructions and / or data.

[0269] In this embodiment, the memory 1202 stores a computer program, which, when executed by the processor 1201, causes the processor 1201 to perform the following:

[0270] AR positioning is performed on the trajectory points of the terminal device to obtain the AR coordinates of the trajectory points; and the detection data corresponding to the trajectory points is determined; wherein, the AR coordinates are the coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device in the roaming test of the detection area;

[0271] Based on the AR coordinates of the trajectory points, the movement trajectory of the terminal device is generated, and the movement trajectory and the detection data are displayed.

[0272] In some alternative implementations, before generating the movement trajectory of the terminal device, the processor 1201 also performs:

[0273] In response to the floor plan of the detection area, the image coordinates and the first AR coordinates of a first positioning point in the detection area are determined; wherein, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device.

[0274] Based on the image coordinates and the first AR coordinates of the first positioning point, a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined.

[0275] Processor 1201 executes the following:

[0276] If the AR coordinate system corresponding to the terminal device has not shifted, then based on the first adjustment ratio, the first AR coordinate of the trajectory point is converted into the image coordinate of the trajectory point;

[0277] Based on the image coordinates of the trajectory points, the movement trajectory of the terminal device is generated in the floor plan.

[0278] In some alternative implementations, processor 1201 also performs:

[0279] If the AR coordinate system corresponding to the terminal device is offset, the image coordinates of the second positioning point and the second AR coordinates are determined; wherein, the second positioning point includes at least two positioning points; the second AR coordinates are the coordinates in the offset AR coordinate system of the terminal device;

[0280] Based on the image coordinates and the second AR coordinates of the second positioning point, a second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined.

[0281] Processor 1201 also performs:

[0282] If the AR coordinate system corresponding to the terminal device is offset, the second AR coordinates of the offset trajectory point are converted into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0283] Based on the image coordinates of the offset trajectory points, the movement trajectory of the terminal device after offset is generated in the floor plan.

[0284] In some optional implementations, if the AR coordinate system corresponding to the terminal device shifts, the processor 1201 further executes:

[0285] Based on the first adjustment ratio and the second adjustment ratio, the second AR coordinates of the offset trajectory points are transformed into the first AR coordinates in the initial AR coordinate system;

[0286] After the roaming test is completed, the roaming trajectory corresponding to the roaming test is generated based on the first AR coordinates of all trajectory points.

[0287] In some alternative implementations, processor 1201 also performs:

[0288] The target trajectory points are marked in the movement trajectory.

[0289] In some alternative implementations, processor 1201 also performs:

[0290] The collected real-world image of the detection area is displayed.

[0291] In some alternative implementations, processor 1201 also performs:

[0292] If the real-scene image contains target trajectory points, then the annotation information corresponding to the target trajectory points is rendered in the real-scene image.

[0293] In some alternative implementations, the target trajectory point is determined in the following manner:

[0294] In response to a user annotation instruction, the trajectory point corresponding to the user annotation instruction is determined as the target trajectory point; wherein the annotation type of the target trajectory point is user annotation; and / or

[0295] The trajectory point representing the AP switching is determined as the target trajectory point; wherein, the annotation type of the target trajectory point is roaming.

[0296] In some alternative implementations, processor 1201 also performs:

[0297] If the real-view image contains a target area, then the AP information corresponding to the target area is rendered in the real-view image; wherein, the target area is the location of the AP currently connected to by the terminal device.

[0298] In some alternative implementations, processor 1201 also performs:

[0299] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming trajectory, number of roamings, signal strength change curve, and delay change curve corresponding to the roaming test.

[0300] Based on the same technical concept, embodiments of this application also provide a computer-readable storage medium storing a computer program executable by a processor, which, when run on the processor, causes the processor to perform the steps of the above-described roaming test method.

[0301] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0302] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0303] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0304] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0305] Although embodiments of this application have been described, those skilled in the art, upon learning the basic inventive concept, can make further changes and modifications to these embodiments. Therefore, the appended claims are intended to be interpreted as including the embodiments as well as all changes and modifications falling within the scope of this application.

[0306] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A roaming test method, characterized in that, Applied to terminal devices, the method includes: Augmented reality (AR) positioning is performed on the trajectory points of the terminal device to obtain the AR coordinates of the trajectory points; and detection data corresponding to the trajectory points is determined; wherein, the AR coordinates are coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device in the roaming test of the detection area; In response to the floor plan of the detection area, based on the first positioning point in the detection area, the coordinate transformation relationship between the AR coordinate system and the image coordinate system of the floor plan is determined; Based on the AR coordinates of the trajectory points and the coordinate transformation relationship, the movement trajectory of the terminal device is generated in the floor plan, and the movement trajectory and the detection data are displayed in the floor plan; wherein, the movement trajectory is used to represent the movement path of the terminal device in the detection area.

2. The method as described in claim 1, characterized in that, The method, in response to the floor plan of the detection area, determines the coordinate transformation relationship between the AR coordinate system and the image coordinate system of the floor plan based on a first positioning point in the detection area, including: In response to the floor plan of the detection area, the image coordinates and the first AR coordinates of a first positioning point in the detection area are determined; wherein, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device. Based on the image coordinates and the first AR coordinates of the first positioning point, a first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined. The process of generating the movement trajectory of the terminal device in the floor plan based on the AR coordinates of the trajectory points and the coordinate transformation relationship includes: If the AR coordinate system corresponding to the terminal device has not shifted, then based on the first adjustment ratio, the first AR coordinate of the trajectory point is converted into the image coordinate of the trajectory point; Based on the image coordinates of the trajectory points, the movement trajectory of the terminal device is generated in the floor plan.

3. The method as described in claim 2, characterized in that, Also includes: If the AR coordinate system corresponding to the terminal device is offset, the image coordinates of the second positioning point and the second AR coordinates are determined; wherein, the second positioning point includes at least two positioning points; the second AR coordinates are the coordinates in the offset AR coordinate system of the terminal device; Based on the image coordinates and the second AR coordinates of the second positioning point, a second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined. Based on the AR coordinates of the trajectory points, generating the movement trajectory of the terminal device in the floor plan further includes: If the AR coordinate system corresponding to the terminal device is offset, the second AR coordinates of the offset trajectory point are converted into the image coordinates of the offset trajectory point based on the second adjustment ratio; Based on the image coordinates of the offset trajectory points, the movement trajectory of the terminal device after offset is generated in the floor plan.

4. The method as described in claim 3, characterized in that, If the AR coordinate system corresponding to the terminal device is shifted, the method further includes: Based on the first adjustment ratio and the second adjustment ratio, the second AR coordinates of the offset trajectory points are transformed into the first AR coordinates in the initial AR coordinate system; After the roaming test is completed, the roaming trajectory corresponding to the roaming test is generated based on the first AR coordinates of all trajectory points.

5. The method as described in claim 1, characterized in that, Also includes: The target trajectory points are marked in the movement trajectory.

6. The method as described in claim 1, characterized in that, Displaying the movement trajectory and the detection data in the floor plan also includes: The collected real-world image of the detection area is displayed.

7. The method as described in claim 6, characterized in that, Also includes: If the real-scene image contains target trajectory points, then the annotation information corresponding to the target trajectory points is rendered in the real-scene image.

8. The method as described in claim 5 or 7, characterized in that, The target trajectory point is determined in the following manner: In response to a user annotation instruction, the trajectory point corresponding to the user annotation instruction is determined as the target trajectory point; wherein the annotation type of the target trajectory point is user annotation; and / or The trajectory point representing the AP switching is determined as the target trajectory point; wherein, the annotation type of the target trajectory point is roaming.

9. The method as described in claim 6, characterized in that, Also includes: If the real-view image contains a target area, then the AP information corresponding to the target area is rendered in the real-view image; wherein, the target area is the location of the AP currently connected to by the terminal device.

10. The method as described in claim 1, characterized in that, Also includes: Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming trajectory, number of roamings, signal strength change curve, and delay change curve corresponding to the roaming test.

11. A roaming testing device, characterized in that, Applied to augmented reality terminal devices, the device includes: An augmented reality (AR) positioning module is used to perform AR positioning on the trajectory points of the terminal device to obtain the AR coordinates of the trajectory points; wherein, the AR coordinates are coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device during a roaming test in the detection area. The detection module is used to determine the detection data corresponding to the trajectory points; A movement trajectory generation module is used to respond to the floor plan of the detection area, determine the coordinate transformation relationship between the AR coordinate system and the image coordinate system of the floor plan based on a first positioning point in the detection area; and generate the movement trajectory of the terminal device in the floor plan based on the AR coordinates of the trajectory point and the coordinate transformation relationship; wherein the movement trajectory is used to represent the movement path of the terminal device in the detection area; The display module is used to display the movement trajectory and the detection data in the floor plan.

12. An augmented reality terminal device, characterized in that, It includes at least one processor and at least one memory, wherein the memory stores a computer program that, when executed by the processor, causes the processor to perform the method as described in any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, It stores a computer program executable by a computer, which, when run on the computer, causes the computer to perform the method as described in any one of claims 1 to 10.

Images