Roaming test method and device, terminal equipment and storage medium

Through the combination of AR positioning technology and floor plan, the problem of detecting blind spots and uncertain positions in roaming tests is solved, and more accurate AP deployment evaluation and detection route planning is achieved, which improves the efficiency and accuracy of roaming tests.

CN119233301AActive Publication Date: 2024-12-31RUIJIE NETWORKS CO LTD

Patent Information

Application Number
CN202310797641.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-06-30
Publication Date
2024-12-31
Estimated Expiration
2043-06-30

AI Technical Summary

Technical Problem

Existing roaming testing methods are difficult to accurately evaluate the deployment of wireless access point (AP). Testers rely on experience movement and cannot determine the corresponding location of the detection data, resulting in detection blind spots and inaccurate deployment evaluation.

Method used

Augmented reality (AR) positioning technology is used to obtain the position and detection data of terminal devices in real time, generate mobile trajectories, and combine floor plans and real scenes to provide more accurate AP deployment evaluation and subsequent detection route planning.

Benefits of technology

By obtaining AR coordinates and detection data of trajectory points in real time, accurately evaluate AP deployment, reduce detection blind spots, improve roaming testing efficiency and accuracy, and reasonably plan detection routes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119233301A_ABST
    Figure CN119233301A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a roaming test method and device, terminal equipment and a storage medium, and the method is applied to the terminal equipment, and comprises the steps: carrying out the AR positioning of a track point of the terminal equipment, and obtaining the AR coordinate of the track point; determining detection data corresponding to the track points; the AR coordinates are coordinates in an AR coordinate system of the terminal equipment; the track point is the position of the terminal device in the roaming test of the detection area; and generating a moving track of the terminal equipment based on the AR coordinates of the track points, and displaying the moving track and the detection data. The detection data of each track point and the corresponding AR coordinates are acquired in real time in the roaming test, so that the deployment of the AP is evaluated more accurately subsequently; generating a moving track of the terminal equipment based on the AR coordinates of the track points; by displaying the moving track, the detection data and the realistic picture corresponding to the detection area, a user can plan a subsequent detection route more reasonably by combining the information, and roaming testing is effectively carried out.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of communication technology, and in particular to a roaming test method, apparatus, terminal device, and storage medium. Background Art

[0002] A wireless access point (AP) is an access point for wireless devices to access a wired network. In implementation, multiple APs need to be deployed in some areas, and after deployment, roaming tests are required to evaluate the deployment of APs.

[0003] In the related art, a tester carries a mobile phone and moves around a deployment area, interacts with an AP, performs a roaming test, and obtains a roaming test result; and then evaluates whether the deployment of the AP is reasonable based on the roaming test result.

[0004] However, in the above method, testers can only rely on experience to carry mobile phones and move around the deployment area, which may result in detection blind spots. In addition, the above method can only obtain the changes in roaming test data over time, but cannot determine the location corresponding to the roaming test data, making it difficult to accurately evaluate the deployment of APs. Summary of the invention

[0005] Embodiments of the present application provide a roaming test method, apparatus, terminal device, and storage medium for obtaining a moving track in a roaming test.

[0006] In a first aspect, an embodiment of the present application provides a roaming test method, which is applied to a terminal device. The method includes:

[0007] Performing augmented reality (AR) positioning at the trajectory point of the terminal device to obtain AR coordinates of the trajectory point; and determining detection data corresponding to the trajectory point; wherein the AR coordinates are coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device in a roaming test in a detection area;

[0008] Based on the AR coordinates of the trajectory points, a movement trajectory of the terminal device is generated, and the movement trajectory and the detection data are displayed.

[0009] In the above scheme, during the roaming test, not only the detection data corresponding to the track point (the location of the terminal device) is obtained in real time, but also the AR coordinates of the track point in the AR coordinate system are obtained in real time through AR positioning, that is, the detection data of each track point and the corresponding AR coordinates (position information) are obtained in real time during the roaming test. In this way, after the roaming test is completed, the deployment of the AP can be evaluated more accurately based on the detection data of the track point and the corresponding AR coordinates; in addition, the movement trajectory of the terminal device is generated based on the AR coordinates of the track point (which will be updated in real time as the terminal device moves); by displaying the movement trajectory, detection data and the real-life picture corresponding to the detection area, the user can obtain the corresponding detection results of the track points that have been detected based on the movement trajectory and detection data, and plan the subsequent detection routes more reasonably based on this information, and conduct roaming tests more effectively.

[0010] In some optional implementation manners, before generating the movement trajectory of the terminal device, the method further includes:

[0011] In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area; wherein the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device;

[0012] Determining a first adjustment ratio between the image coordinate system and the initial AR coordinate system based on the image coordinates of the first positioning point and the first AR coordinates;

[0013] Generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory point includes:

[0014] If the AR coordinate system corresponding to the terminal device is not offset, converting the first AR coordinate of the track point into the image coordinate of the track point based on the first adjustment ratio;

[0015] Based on the image coordinates of the trajectory points, a movement trajectory of the terminal device is generated in the floor plan.

[0016] In the above scheme, the AR coordinate system is used for terminal device positioning; the floor plan is an image, and the image coordinate system is used; at least two first positioning points are used, and the image coordinates and the first AR coordinates of the first positioning points are determined; then the first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined, and the first AR coordinates of the trajectory point are transformed based on the first adjustment ratio to obtain the coordinates in the image coordinate system of the floor plan, and then the moving trajectory is generated in the floor plan. The floor plan has the indoor distribution structure of the detection area, which can more effectively guide the user to plan subsequent detection routes.

[0017] Some optional implementations also include:

[0018] If the AR coordinate system corresponding to the terminal device is offset, determine the image coordinates and the second AR coordinates of the second positioning point; wherein the second positioning point includes at least two positioning points; and the second AR coordinates are coordinates in the offset AR coordinate system of the terminal device;

[0019] determining a second adjustment ratio between the image coordinate system and the offset AR coordinate system based on the image coordinates and the second AR coordinates of the second positioning point;

[0020] Generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory point also includes:

[0021] If the AR coordinate system corresponding to the terminal device is offset, converting the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0022] Based on the image coordinates of the trajectory points after the shift, a moving trajectory of the terminal device after the shift is generated in the floor plan.

[0023] In the above scheme, after the AR coordinate system corresponding to the terminal device is offset, the conversion relationship between the AR coordinate system and the image coordinate system will also change, and the previous first adjustment ratio will no longer apply; after the offset, at least two second positioning points are used, and the image coordinates of the second positioning points and the second AR coordinates (the coordinates in the offset AR coordinate system) are determined; then the second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined, and the second AR coordinates of the offset trajectory points are converted based on the second adjustment ratio, so that the coordinates in the image coordinate system of the floor plan can be obtained, and then the moving trajectory can be generated in the floor plan, so that the moving trajectory can be accurately generated in the AR offset scene.

[0024] In some optional implementation manners, if the AR coordinate system corresponding to the terminal device is offset, the method further includes:

[0025] Based on the first adjustment ratio and the second adjustment ratio, converting the second AR coordinate of the offset trajectory point into the first AR coordinate in the initial AR coordinate system;

[0026] After the roaming test is completed, a roaming track corresponding to the roaming test is generated based on the first AR coordinates of all track points.

[0027] In the above scheme, if the AR coordinate system corresponding to the terminal device is offset during the roaming test, the AR coordinates of the trajectory point are not the AR coordinates in the unified AR coordinate system. By converting the second AR coordinates of the offset trajectory point into the first AR coordinates in the initial AR coordinate system, the first AR coordinates of the unified coordinate standard of all trajectory points in the roaming test are obtained, thereby generating the roaming trajectory of the entire roaming test in the unified coordinate system.

[0028] Some optional implementations also include:

[0029] The target track point is marked in the moving track.

[0030] The above solution records some locations that need to be focused on in the trajectory by marking the target trajectory points in the moving trajectory.

[0031] In some optional implementations, displaying the movement trajectory and the detection data further includes:

[0032] The collected real-life image of the detection area is displayed.

[0033] The above solution, by displaying the collected real-life image of the detection area, facilitates the user to plan the route more reasonably based on the real scene ahead, such as avoiding obstacles, going to a specific area, etc.

[0034] Some optional implementations also include:

[0035] If the real scene image includes a target track point, the annotation information corresponding to the target track point is rendered in the real scene image.

[0036] The above scheme performs AR real scene marking by rendering the annotation information corresponding to the target trajectory point in the real scene image, thereby more intuitively displaying the locations that need to be focused on.

[0037] In some optional implementations, the target trajectory point is determined by:

[0038] In response to a user marking instruction, determining the trajectory point corresponding to the user marking instruction as the target trajectory point; wherein the marking type of the target trajectory point is user marking; and / or

[0039] A trajectory point representing AP switching is determined as the target trajectory point; wherein the annotation type of the target trajectory point is roaming.

[0040] Some optional implementations also include:

[0041] If the real scene image includes a target area, the AP information corresponding to the target area is rendered in the real scene image; wherein the target area is the location of the AP to which the terminal device is currently connected.

[0042] The above solution prompts the user the location of the AP by rendering the AP information corresponding to the location of the AP currently connected to the terminal device in the real-life image, thereby further guiding the user to reasonably plan the roaming route.

[0043] Some optional implementations also include:

[0044] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming track, roaming times, signal strength change curve and delay change curve corresponding to the roaming test.

[0045] The above solution generates a roaming report, which can be used to infer where roaming anomalies occur and where network anomalies and fluctuations occur, thereby providing better signal coverage.

[0046] In a second aspect, an embodiment of the present application provides a roaming test device, which is applied to a terminal device, and the device includes:

[0047] An AR positioning module is used to perform AR positioning at a track point of the terminal device to obtain AR coordinates of the track point; wherein the AR coordinates are coordinates in an AR coordinate system of the terminal device; and the track point is a location of the terminal device in a roaming test in a detection area;

[0048] A detection module, used to determine the detection data corresponding to the trajectory point;

[0049] A movement trajectory generating module, used for generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory points;

[0050] A display module is used to display the movement trajectory and the detection data.

[0051] In some optional implementation manners, before generating the movement trajectory of the terminal device, the movement trajectory generating module is further used to:

[0052] In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area; wherein the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device;

[0053] Determining a first adjustment ratio between the image coordinate system and the initial AR coordinate system based on the image coordinates of the first positioning point and the first AR coordinates;

[0054] The mobile trajectory generation module is specifically used for:

[0055] If the AR coordinate system corresponding to the terminal device is not offset, converting the first AR coordinate of the track point into the image coordinate of the track point based on the first adjustment ratio;

[0056] Based on the image coordinates of the trajectory points, a movement trajectory of the terminal device is generated in the floor plan.

[0057] In some optional implementation manners, the movement trajectory generating module is further used to:

[0058] If the AR coordinate system corresponding to the terminal device is offset, determine the image coordinates and the second AR coordinates of the second positioning point; wherein the second positioning point includes at least two positioning points; and the second AR coordinates are coordinates in the offset AR coordinate system of the terminal device;

[0059] determining a second adjustment ratio between the image coordinate system and the offset AR coordinate system based on the image coordinates and the second AR coordinates of the second positioning point;

[0060] In some optional implementation manners, the movement trajectory generating module is further used to:

[0061] If the AR coordinate system corresponding to the terminal device is offset, converting the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0062] Based on the image coordinates of the trajectory points after the shift, a moving trajectory of the terminal device after the shift is generated in the floor plan.

[0063] Some optional implementations further include a coordinate conversion module for:

[0064] If the AR coordinate system corresponding to the terminal device is offset, converting the second AR coordinate of the offset trajectory point into the first AR coordinate in the initial AR coordinate system based on the first adjustment ratio and the second adjustment ratio;

[0065] After the roaming test is completed, a roaming track corresponding to the roaming test is generated based on the first AR coordinates of all track points.

[0066] In some optional implementation manners, the movement trajectory generating module is further used to:

[0067] The target track point is marked in the moving track.

[0068] In some optional implementation manners, the display module is further used for:

[0069] The collected real-life image of the detection area is displayed.

[0070] In some optional implementation manners, the display module is further used for:

[0071] If the real scene image includes a target track point, the annotation information corresponding to the target track point is rendered in the real scene image.

[0072] In some optional implementations, the target trajectory point is determined by:

[0073] In response to a user marking instruction, determining the trajectory point corresponding to the user marking instruction as the target trajectory point; wherein the marking type of the target trajectory point is user marking; and / or

[0074] A trajectory point representing AP switching is determined as the target trajectory point; wherein the annotation type of the target trajectory point is roaming.

[0075] In some optional implementation manners, the display module is further used for:

[0076] If the real scene image includes a target area, the AP information corresponding to the target area is rendered in the real scene image; wherein the target area is the location of the AP to which the terminal device is currently connected.

[0077] Some optional implementations further include a report generation module for:

[0078] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming track, roaming times, signal strength change curve and delay change curve corresponding to the roaming test.

[0079] In a third aspect, an embodiment of the present application provides a terminal device, comprising at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes any roaming test method described in the first aspect above.

[0080] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium storing a computer program executable by a processor. When the program runs on the processor, the processor executes any roaming test method described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0081] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0082] Figure 1 A flowchart of a first roaming test method provided in an embodiment of the present application;

[0083] Figure 2 A schematic diagram of a first user interface provided in an embodiment of the present application;

[0084] Figure 3 A flowchart of a second roaming test method provided in an embodiment of the present application;

[0085] Figure 4 A schematic diagram of a second user interface provided in an embodiment of the present application;

[0086] Figure 5 A flowchart of a third roaming test method provided in an embodiment of the present application;

[0087] Figure 6 A third user interface schematic diagram provided in an embodiment of the present application;

[0088] Figure 7 A schematic diagram of a movement trajectory provided in an embodiment of the present application;

[0089] Figure 8 A first schematic diagram of a real scene provided in an embodiment of the present application;

[0090] Fig. 9 A second schematic diagram of a real scene provided in an embodiment of the present application;

[0091] Fig.10 A third schematic diagram of a real scene provided in an embodiment of the present application;

[0092] Fig.11 A schematic diagram of the structure of a roaming test device provided in an embodiment of the present application;

[0093] Fig.12 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0094] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0095] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this application, unless otherwise specified, "plurality" means two or more.

[0096] The term "and / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects are in an "or" relationship.

[0097] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the term "connection" should be understood in a broad sense, for example, it can be directly connected, or indirectly connected through an intermediate medium, or it can be the internal connection of two devices. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0098] In this embodiment, the "terminal device" is a device carried by a user for roaming testing, and may be a handheld device such as a mobile phone.

[0099] During implementation, multiple APs need to be deployed in some areas, and after deployment, roaming tests are required to evaluate the deployment of the APs.

[0100] In the related art, a tester carries a mobile phone and moves around a deployment area, interacts with an AP, performs a roaming test, and obtains a roaming test result; and then evaluates whether the deployment of the AP is reasonable based on the roaming test result.

[0101] However, in the above method, testers can only rely on experience to carry mobile phones and move around the deployment area, which may result in detection blind spots. In addition, the above method can only obtain the changes in roaming test data over time, but cannot determine the location corresponding to the roaming test data, making it difficult to accurately evaluate the deployment of APs.

[0102] In some embodiments, the program-controlled test vehicle is controlled to run in a test scenario according to a preset trajectory, so that the program-controlled test vehicle successively establishes wireless connections with multiple roaming test APs in the test scenario through a test wireless network card, thereby determining test data on the preset trajectory.

[0103] However, the control process of the above method is complicated and requires an additional program-controlled test vehicle to implement.

[0104] In view of this, an embodiment of the present application proposes a roaming test method, apparatus, terminal device and storage medium. The method is applied to the terminal device, including: performing AR positioning at the trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; and determining the detection data corresponding to the trajectory point; wherein the AR coordinates are the coordinates in the AR coordinate system of the terminal device; the trajectory point is the position of the terminal device in the roaming test of the detection area; based on the AR coordinates of the trajectory point, generating a movement trajectory of the terminal device; and displaying the movement trajectory and the detection data.

[0105] In the above scheme, during the roaming test, not only the detection data corresponding to the track point (the location of the terminal device) is obtained in real time, but also the AR coordinates of the track point in the AR coordinate system are obtained in real time through AR positioning, that is, the detection data of each track point and the corresponding AR coordinates (position information) are obtained in real time during the roaming test. In this way, after the roaming test is completed, the deployment of the AP can be evaluated more accurately based on the detection data of the track point and the corresponding AR coordinates; in addition, the movement trajectory of the terminal device is generated based on the AR coordinates of the track point (which will be updated in real time as the terminal device moves); by displaying the movement trajectory, detection data and the real-life picture corresponding to the detection area, the user can obtain the corresponding detection results of the track points that have been detected based on the movement trajectory and detection data, and plan the subsequent detection routes more reasonably based on this information, and conduct roaming tests more effectively.

[0106] The following will be combined with the accompanying drawings and specific embodiments to describe in detail the technical solution of the present application and how the technical solution of the present application solves the above technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0107] Figure 1 A flowchart of the first roaming test method provided in the embodiment of the present application is shown as follows: Figure 1 As shown, the following steps are included:

[0108] Step S101: performing AR positioning at the trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; and determining the detection data corresponding to the trajectory point.

[0109] Among them, the AR coordinates are coordinates in the AR coordinate system of the terminal device; the trajectory point is the location of the terminal device in the roaming test in the detection area.

[0110] During implementation, in order to more accurately evaluate the deployment of APs, not only test data but also location information is obtained in real time.

[0111] Since APs are usually deployed indoors to provide wireless networks for indoor areas, roaming tests are usually performed indoors. Based on this, this embodiment uses terminal devices for AR positioning, which is more suitable for indoor positioning.

[0112] By acquiring the detection data of each track point and the corresponding AR coordinates (location information) in real time during the roaming test, the deployment of the AP can be evaluated more accurately based on the detection data of the track point and the corresponding AR coordinates after the roaming test.

[0113] Step S102: Generate a movement trajectory of the terminal device based on the AR coordinates of the trajectory points.

[0114] During the roaming test, if the tester only relies on experience to move the terminal device, there may be a detection blind spot, that is, there may be an area that the terminal device has not passed through, and the track point is far away from the area, which will also affect the test results;

[0115] Based on this, this embodiment also generates the movement trajectory of the terminal device based on the AR coordinates of the trajectory points (which will be updated in real time as the terminal device moves), so that the user can promptly know the trajectory points that have been detected, and can also combine the movement trajectory with the overall layout of the area to be tested to know the undetected areas.

[0116] Step S103: displaying the movement trajectory and the detection data.

[0117] In this embodiment, after determining the current movement trajectory, the movement trajectory and detection data are displayed. Based on the movement trajectory and detection data, the user can obtain the detection results corresponding to the trajectory points that have been detected. Combined with this information, the subsequent detection route can be planned more reasonably and the roaming test can be performed more effectively.

[0118] It is understandable that the terminal device is mobile and new track points are constantly added during the roaming test. Therefore, a mobile track is generated in real time (new track points are added to the previous mobile track), so that the user can know the route traveled in time.

[0119] This embodiment does not specifically limit the detection data, such as one or more of the data including signal strength, currently connected AP, delay, packet loss rate, negotiation rate, roaming related information, etc., which can be determined based on the interaction message between the terminal device and the AP.

[0120] See also Figure 2 As shown, a user interface provided by this embodiment, the upper left of the user interface is a signal strength change curve, and the upper right is the current network parameters; below the signal strength change curve and the current network parameters, roaming related information is displayed; these are all detection data;

[0121] Below the roaming related information on this user interface is the current movement track.

[0122] It is understandable that the above Figure 2 The user interface shown is only an example. In practice, the positions of different detection data may be swapped, or the movement track may be set at the top and the detection data may be displayed at the bottom, etc. This embodiment does not specifically limit this.

[0123] In implementation, the terminal device can rotate the moving track according to the current direction information (its own direction) (the moving track itself does not change), so that the user has a more intuitive experience. For example, if the terminal device turns left, the moving track will also turn left and keep moving forward from the user's perspective. The above direction information is calculated by the current forward vector and rotation angle of the terminal device.

[0124] The present embodiment does not limit the specific implementation method of the moving trajectory. The moving trajectory can use a uniform line; or use different lines according to different signal strengths, such as a green line for a strong signal, a yellow line for a normal signal, and a red line for a poor signal.

[0125] In the above scheme, during the roaming test, not only the detection data corresponding to the track point (the location of the terminal device) is obtained in real time, but also the AR coordinates of the track point in the AR coordinate system are obtained in real time through AR positioning, that is, the detection data of each track point and the corresponding AR coordinates (position information) are obtained in real time during the roaming test. In this way, after the roaming test is completed, the deployment of the AP can be evaluated more accurately based on the detection data of the track point and the corresponding AR coordinates; in addition, the movement trajectory of the terminal device is generated based on the AR coordinates of the track point (which will be updated in real time as the terminal device moves); by displaying the movement trajectory, detection data and the real-life picture corresponding to the detection area, the user can obtain the corresponding detection results of the track points that have been detected based on the movement trajectory and detection data, and plan the subsequent detection routes more reasonably based on this information, and conduct roaming tests more effectively.

[0126] The present application embodiment provides a flow chart of a second roaming test method, such as Figure 3 As shown, the following steps are included:

[0127] Step S301: In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area.

[0128] Among them, the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device.

[0129] In implementation, a floor plan of the detection area can be uploaded to the terminal device, or multiple floor plans can be pre-configured in the terminal device for the user to choose. The floor plan has the indoor distribution structure of the detection area. Therefore, generating a moving trajectory in the floor plan can more effectively guide the user to plan the subsequent detection route;

[0130] However, the AR coordinate system used for terminal device positioning, if the AR coordinate system corresponding to the terminal device has not shifted, uses the initial AR coordinate system; the floor plan is an image, and the image coordinate system is used; only by determining the image coordinates of the trajectory point in the image coordinate system can the movement trajectory be generated in the floor plan;

[0131] Based on this, this embodiment adopts at least two first positioning points, and determines the image coordinates and the first AR coordinates of the first positioning points; then determines the adjustment ratio between the image coordinate system and the initial AR coordinate system, and coordinate transformation can be performed based on the adjustment ratio.

[0132] Step S302: determining a first adjustment ratio between the image coordinate system and the initial AR coordinate system based on the image coordinates of the first positioning point and the first AR coordinates.

[0133] As described above, by determining the image coordinates of the first positioning point and the first AR coordinates, and then determining the adjustment ratio between the image coordinate system and the initial AR coordinate system, coordinate transformation can be performed based on the adjustment ratio.

[0134] Exemplarily, the first adjustment ratio may include a first horizontal adjustment ratio and a first vertical adjustment ratio; the first horizontal adjustment ratio is determined based on the difference between the image horizontal coordinates of different first positioning points and the difference between the first AR horizontal coordinates; the first vertical adjustment ratio is determined based on the difference between the image vertical coordinates of different first positioning points and the difference between the first AR vertical coordinates.

[0135] The following is a specific example to illustrate:

[0136] The coordinates of the first positioning point 11 in the image coordinate system are (a_11, b_11), and the coordinates in the initial AR coordinate system are (X_11, Y_11); the coordinates of the second positioning point 12 in the image coordinate system are (a_12, b_12), and the coordinates in the initial AR coordinate system are (X_12, Y_12);

[0137] The first transverse adjustment ratio K_x=(a_12-a_11) / (X_12-X_11); the first longitudinal adjustment ratio K_y=(b_12-b_11) / (Y_12-Y_11).

[0138] The above example is illustrated using two first positioning points as an example. In implementation, more first positioning points may be used, such as the first horizontal adjustment ratio and the first vertical adjustment ratio are determined based on different first positioning points; or the first horizontal adjustment ratio and the first vertical adjustment ratio corresponding to every two first positioning points may be determined, and the final first horizontal adjustment ratio and the first vertical adjustment ratio may be obtained by combining them, such as calculating the average value of the first horizontal adjustment ratios corresponding to every two first positioning points to obtain the final first horizontal adjustment ratio, and averaging the first vertical adjustment ratios corresponding to every two first positioning points to obtain the final first vertical adjustment ratio, etc.

[0139] Step S303: performing AR positioning at the trajectory point of the terminal device to obtain a first AR coordinate of the trajectory point; and determining detection data corresponding to the trajectory point.

[0140] The specific implementation of step S303 can refer to the above embodiment and will not be described again here.

[0141] Step S304: based on the first adjustment ratio, converting the first AR coordinates of the trajectory point into the image coordinates of the trajectory point.

[0142] Since the first adjustment ratio represents the conversion relationship between the AR coordinate system and the image coordinate system, the first AR coordinates of the trajectory point can be converted into the image coordinates of the trajectory point in the above-mentioned floor plan based on the first adjustment ratio.

[0143] Exemplarily, the first adjustment ratio may include a first transverse adjustment ratio and a first longitudinal adjustment ratio;

[0144] Determine the first AR horizontal coordinate change amount based on the difference between the first AR horizontal coordinate of the trajectory point and the first AR horizontal coordinate of any first positioning point, and determine the first image horizontal coordinate change amount based on the first AR horizontal coordinate change amount and the first horizontal adjustment ratio; add the first image horizontal coordinate change amount to the image horizontal coordinate of the first positioning point to obtain the image horizontal coordinate of the trajectory point;

[0145] Based on the difference between the first AR vertical coordinate of the trajectory point and the first AR vertical coordinate of any first positioning point, the change of the first AR vertical coordinate is determined, and based on the change of the first AR vertical coordinate and the first longitudinal adjustment ratio, the change of the first image vertical coordinate is determined; the image vertical coordinate of the trajectory point can be obtained by adding the first image vertical coordinate change to the image vertical coordinate of the first positioning point.

[0146] For example, the coordinates of the first positioning point 11 in the image coordinate system are (a_11, b_11) and the coordinates in the initial AR coordinate system are (X_11, Y_11):

[0147] The image horizontal coordinate a_m of the track point m=K_x(X_m-X_11)+a_11; wherein K_x is the first horizontal adjustment ratio, X_m is the first AR horizontal coordinate of the track point m, X_11 is the first AR horizontal coordinate of the first positioning point 11, and a_11 is the image horizontal coordinate of the first positioning point 11;

[0148] The image vertical coordinate of the trajectory point m is b_m=K_y(Y_m-Y_11)+b_11; wherein K_y is the first vertical adjustment ratio, Y_m is the first AR vertical coordinate of the trajectory point m, Y_11 is the first AR vertical coordinate of the first positioning point 11, and b_11 is the image vertical coordinate of the first positioning point 11.

[0149] Step S305: generating a moving trajectory of the terminal device in the floor plan based on the image coordinates of the trajectory points.

[0150] Since the image coordinates of the trajectory points are the coordinates in the image coordinate system of the floor plan, the movement trajectory of the terminal device can be generated by drawing points on the floor plan based on the image coordinates of the trajectory points.

[0151] Step S306: Displaying the movement trajectory and the detection data.

[0152] In this embodiment, the movement trajectory is formed in the floor plan, and therefore, displaying the movement trajectory is to display the floor plan including the movement trajectory.

[0153] See also Figure 4 As shown, a user interface provided by this embodiment is provided, and the movement track in the user interface is generated in the floor plan.

[0154] Above Figure 4 The user interface shown is also an exemplary description. The positions of the floor plan and the detection data can be swapped. In addition, the user interface may display the entire floor plan or a portion of the floor plan (for example, when the floor plan is large, only a portion of the floor plan may be displayed). This embodiment does not make specific limitations on this.

[0155] In the above scheme, the AR coordinate system is used for terminal device positioning; the floor plan is an image, and the image coordinate system is used; at least two first positioning points are used, and the image coordinates and the first AR coordinates of the first positioning points are determined; then the first adjustment ratio between the image coordinate system and the initial AR coordinate system is determined, and the first AR coordinates of the trajectory point are transformed based on the first adjustment ratio to obtain the coordinates in the image coordinate system of the floor plan, and then the moving trajectory is generated in the floor plan. The floor plan has the indoor distribution structure of the detection area, which can more effectively guide the user to plan subsequent detection routes.

[0156] The present application embodiment provides a flow chart of a third roaming test method, such as Figure 5 As shown, the following steps are included:

[0157] Step S501: If the AR coordinate system corresponding to the terminal device is offset, the image coordinates of the second positioning point and the second AR coordinates are determined.

[0158] The second positioning points include at least two positioning points; and the second AR coordinates are coordinates in the offset AR coordinate system of the terminal device.

[0159] During implementation, if the AR coordinate system corresponding to the terminal device is offset, the conversion relationship between the AR coordinate system and the image coordinate system will also change;

[0160] Based on this, this embodiment adopts at least two second positioning points, and determines the image coordinates and second AR coordinates of the second positioning points; then determines the adjustment ratio between the image coordinate system and the offset AR coordinate system, and coordinate transformation can be performed based on the adjustment ratio.

[0161] This embodiment does not specifically limit the manner in which the terminal device determines that the AR coordinate system is offset. For example:

[0162] 1. The terminal device will collect images during the AR positioning process. If the images collected by the terminal device do not have relevant feature points, it is determined that the AR coordinate system is offset;

[0163] 2. When the user's current position in the perceived movement trajectory does not match the actual position, a command representing the offset is triggered, and the terminal device responds to the command to determine that the AR coordinate system is offset.

[0164] Step S502: determining a second adjustment ratio between the image coordinate system and the offset AR coordinate system based on the image coordinates of the second positioning point and the second AR coordinates.

[0165] As described above, by determining the image coordinates and the second AR coordinates of the second positioning point, and then determining the adjustment ratio between the image coordinate system and the offset AR coordinate system, the coordinates of the offset trajectory point can be transformed based on the adjustment ratio.

[0166] Exemplarily, the second adjustment ratio may include a second horizontal adjustment ratio and a second vertical adjustment ratio; the second horizontal adjustment ratio is determined based on the difference between the image horizontal coordinates of different second positioning points and the difference between the second AR horizontal coordinates; the second vertical adjustment ratio is determined based on the difference between the image vertical coordinates of different second positioning points and the difference between the second AR vertical coordinates. The method of determining the first adjustment ratio is similar to that described above and will not be repeated here.

[0167] Step S503: performing AR positioning at the trajectory point of the terminal device to obtain a second AR coordinate of the trajectory point; and determining detection data corresponding to the trajectory point.

[0168] The specific implementation of step S503 can refer to the above embodiment and will not be described again here.

[0169] Step S504: based on the second adjustment ratio, converting the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point.

[0170] Since the second adjustment ratio represents the conversion relationship between the offset AR coordinate system and the image coordinate system, the second AR coordinates of the offset trajectory point can be converted into the image coordinates in the above-mentioned floor plan based on the second adjustment ratio.

[0171] Exemplarily, the second adjustment ratio may include a second horizontal adjustment ratio and a second vertical adjustment ratio; based on the difference between the second AR horizontal coordinate of the trajectory point and the second AR horizontal coordinate of any second positioning point, the second AR horizontal coordinate change amount is determined; based on the second AR horizontal coordinate change amount and the second horizontal adjustment ratio, the second image horizontal coordinate change amount is determined; the image horizontal coordinate of the trajectory point can be obtained by adding the second image horizontal coordinate change amount to the image horizontal coordinate of the second positioning point;

[0172] Based on the difference between the second AR vertical coordinate of the trajectory point and the second AR vertical coordinate of any second positioning point, the change of the second AR vertical coordinate is determined, and based on the change of the second AR vertical coordinate and the second longitudinal adjustment ratio, the change of the second image vertical coordinate is determined; the image vertical coordinate of the trajectory point can be obtained by adding the second image vertical coordinate change to the image vertical coordinate of the second positioning point.

[0173] For example, the coordinates of the second positioning point 21 in the image coordinate system are (a_21, b_21), and the coordinates in the offset AR coordinate system are (X_21, Y_21):

[0174] The image horizontal coordinate a_n of the track point n=K′_x(X′_n-X_21)+a_21; wherein K′_x is the second horizontal adjustment ratio, X′_n is the second AR horizontal coordinate of the track point n, X_21 is the first AR horizontal coordinate of the second positioning point 21, and a_21 is the image horizontal coordinate of the second positioning point 21;

[0175] The image ordinate of trajectory point n is b_n=K′_y(Y′_n-Y_21)+b_21; wherein K′_y is the second longitudinal adjustment ratio, Y′_n is the second AR ordinate of trajectory point n, Y_21 is the first AR ordinate of the second positioning point 21, and b_21 is the image ordinate of the second positioning point 21.

[0176] Step S505: Based on the image coordinates of the trajectory points after the shift, a moving trajectory of the terminal device after the shift is generated in the floor plan.

[0177] Since the image coordinates of the trajectory points are the coordinates in the image coordinate system of the floor plan, the movement trajectory of the terminal device can be generated by drawing points on the floor plan based on the image coordinates of the trajectory points.

[0178] As described above, the terminal device is moving, and new trajectory points are constantly added during the roaming test, generating a mobile trajectory in real time (adding new trajectory points to the previous mobile trajectory). Therefore, this embodiment also has a mobile trajectory generation process and display process before the offset. For details, please refer to the above embodiment, which will not be repeated here.

[0179] Step S506: Displaying the movement trajectory and the detection data.

[0180] The specific implementation of step S506 can refer to the above embodiment and will not be described again here.

[0181] In the above scheme, after the AR coordinate system corresponding to the terminal device is offset, the conversion relationship between the AR coordinate system and the image coordinate system will also change, and the previous first adjustment ratio will no longer apply; after the offset, at least two second positioning points are used, and the image coordinates of the second positioning points and the second AR coordinates (the coordinates in the offset AR coordinate system) are determined; then the second adjustment ratio between the image coordinate system and the offset AR coordinate system is determined, and the second AR coordinates of the offset trajectory points are converted based on the second adjustment ratio, so that the coordinates in the image coordinate system of the floor plan can be obtained, and then the moving trajectory can be generated in the floor plan, so that the moving trajectory can be accurately generated in the AR offset scene.

[0182] In some optional implementations, when the AR coordinate system corresponding to the terminal device is offset, the following steps are further performed:

[0183] Based on the first adjustment ratio and the second adjustment ratio, converting the second AR coordinate of the offset trajectory point into the first AR coordinate in the initial AR coordinate system;

[0184] After the roaming test is completed, a roaming track corresponding to the roaming test is generated based on the first AR coordinates of all track points.

[0185] During implementation, if the AR coordinate system corresponding to the terminal device is offset during the roaming test, the AR coordinates of the trajectory point are not the AR coordinates in the AR coordinate system; the second AR coordinates of the offset trajectory point need to be converted into the first AR coordinates in the initial AR coordinate system to obtain the AR coordinates with unified coordinate standards for all trajectory points during the roaming test.

[0186] For example, for trajectory point n, the image coordinates determined based on the first adjustment ratio and the first AR coordinates are theoretically the same as the image coordinates determined based on the second adjustment ratio and the second AR coordinates. Therefore, the corresponding first AR coordinates can be determined based on the first adjustment ratio, the second adjustment ratio and the second AR coordinates.

[0187] The method for determining the first adjustment ratio and the second adjustment ratio can be referred to in the above embodiment and will not be described in detail here.

[0188] The following is a specific example to illustrate the AR coordinate system transformation:

[0189] a_n=K_x(X_n-X_11)+a_11=K′_x(X′_n-X_21)+a_21;

[0190] b_n=K_y(Y_n-Y_11)+b_11=K′_y(Y_n-Y_21)+b_21;

[0191] From the above two formulas, we can infer that X_n=(X′_n-X_21)K′_x / K_x+(a_21-a_11) / K_x+X_11;

[0192] Y_n=(Y′_n-Y_21)K′_y / K_y+(b_21-b_11) / K_y+Y_11;

[0193] Among them, the coordinates of the first positioning point 11 in the image coordinate system are (a_11, b_11), and the coordinates in the initial AR coordinate system are (X_11, Y_11); the coordinates of the second positioning point 21 in the image coordinate system are (a_21, b_21), and the coordinates in the offset AR coordinate system are (X_21, Y_21); K_x is the first horizontal adjustment ratio, K_y is the first vertical adjustment ratio, K′_x is the second horizontal adjustment ratio, K′_y is the second vertical adjustment ratio, the coordinates of the trajectory point n in the offset AR coordinate system are (X′_n, Y′_n), and the coordinates in the initial AR coordinate system are (X_n, Y_n).

[0194] After the roaming test is completed, a roaming trajectory in a unified coordinate system is generated based on the first AR coordinates of all trajectory points in the initial AR coordinate system.

[0195] It can be understood that the above moving trajectory is a real-time trajectory, and the roaming trajectory is an overall trajectory.

[0196] Since the roaming trajectory is the roaming trajectory of the entire roaming test generated based on the AR coordinates of the unified coordinate standard; therefore, a roaming report can be generated based on the roaming trajectory, and abnormality identification can be performed later based on the roaming report.

[0197] In the above scheme, if the AR coordinate system corresponding to the terminal device is offset during the roaming test, the AR coordinates of the trajectory point are not the AR coordinates in the unified AR coordinate system. By converting the second AR coordinates of the offset trajectory point into the first AR coordinates in the initial AR coordinate system, the first AR coordinates of the unified coordinate standard of all trajectory points in the roaming test are obtained, thereby generating the roaming trajectory of the entire roaming test in the unified coordinate system.

[0198] In some optional implementation manners, the above-mentioned displaying the movement trajectory and the detection data further includes:

[0199] The collected real-life image of the detection area is displayed.

[0200] That is to say, this embodiment not only displays the movement trajectory and detection data, but also displays the real-life image of the detection area collected by the terminal device, such as obtaining a real-life image in front of the terminal device by collecting images through the camera of the terminal device.

[0201] See also Figure 6 As shown, a real scene is displayed below the detection data and above the movement track.

[0202] It is understandable that the above Figure 6The user interface shown is only an example. During implementation, the positions of different detection data may be swapped, and the positions of the detection data, movement trajectory and real-scene image may also be swapped. In addition, these three items of information may not be displayed side by side, such as overlaying the movement trajectory on the real-scene image, occupying part of the area of ​​the real-scene image, etc. This embodiment does not make any specific limitations on this.

[0203] The above solution, by displaying the collected real-life image of the detection area, facilitates the user to plan the route more reasonably based on the real scene ahead, such as avoiding obstacles, going to a specific area, etc.

[0204] In some optional implementations, some trajectory points may be marked to obtain target trajectory points, which may be determined by, but not limited to, the following methods:

[0205] In response to a user marking instruction, determining the trajectory point corresponding to the user marking instruction as the target trajectory point; wherein the marking type of the target trajectory point is user marking; and / or

[0206] A trajectory point representing AP switching is determined as the target trajectory point; wherein the annotation type of the target trajectory point is roaming.

[0207] Exemplarily, if the user wants to mark a specific trajectory point, such as a trajectory point with poor signal, a trajectory point with abnormal signal, etc., a user marking instruction can be triggered, such as clicking the position corresponding to the target trajectory point in the user interface of the terminal device, and entering the marking content; the terminal device determines the trajectory point corresponding to the user marking instruction as the target trajectory point, and the marking type of the target trajectory point is user marking;

[0208] If the terminal device determines that AP switching occurs at a certain trajectory point, the trajectory point is determined as a target trajectory point, and the marking type of the target trajectory point is roaming.

[0209] In some optional implementation manners, the following steps are further performed based on the above embodiments:

[0210] The target track point is marked in the moving track.

[0211] As described above, there are multiple types of target trajectory points, such as target trajectory points marked by users, target trajectory points marked by roaming, and target trajectory points marked with special symbols in the moving trajectory, and corresponding types can also be added.

[0212] See also Figure 7 As shown, the target track point is marked with a dot in the moving track, and the corresponding type is added in the form of a dialog box.

[0213] The above solution records some locations that need to be focused on in the trajectory by marking the target trajectory points in the moving trajectory.

[0214] In some optional implementation manners, the following steps are further performed based on the above embodiments:

[0215] If the real scene image includes a target track point, the annotation information corresponding to the target track point is rendered in the real scene image.

[0216] This embodiment displays a real scene image. If the real scene image contains target track points, annotation information corresponding to the target track points can be rendered in the real scene image to perform AR real scene marking.

[0217] This embodiment does not specifically limit the annotation information. For example, since there are multiple types of target trajectory points, such as target trajectory points marked by users and target trajectory points of roaming, the annotation information may include corresponding types. In addition, for target trajectory points marked by users, the annotation information may also include the marked content. For target trajectory points of roaming, the annotation information may also include roaming-related information, such as the original AP, the AP after switching, switching parameters, etc.

[0218] During implementation, the moving path may also be rendered in the real scene image.

[0219] See also Figure 8 As shown, for the target track point marked by the user, the type of the target track point, the network parameters of the target track point and the marked content are rendered in the real scene. Figure 8 Taking "the signal at the stairwell door is not very good" as an example, during implementation, the user can enter other annotation content.

[0220] See also Fig. 9 As shown, for the target track point of roaming, the type of the target track point is rendered in the real scene, switching from AP1 to AP2, AP1 address, AP2 address and switching parameters, etc. Fig. 9 Take the handover parameters including signal strength change, roaming time and roaming packet loss as an example.

[0221] The above scheme performs AR real scene marking by rendering the annotation information corresponding to the target trajectory point in the real scene image, thereby more intuitively displaying the locations that need to be focused on.

[0222] In some optional implementation manners, based on the above embodiments, the following steps are further performed:

[0223] If the real scene image includes a target area, the AP information corresponding to the target area is rendered in the real scene image; wherein the target area is the location of the AP to which the terminal device is currently connected.

[0224] During implementation, the user may not be clear about the specific location of the AP deployment. Based on this, this embodiment renders the location of the AP to which the terminal device is currently connected in the real scene image.

[0225] See also Fig.10 As shown, the terminal device is currently connected to AP2, and the corresponding AP information is rendered at the location of AP2 in the real scene. Fig.10 Take the example where the AP information includes the AP to which the terminal device is currently connected and the symbol corresponding to the AP.

[0226] The above solution prompts the user the location of the AP by rendering the AP information corresponding to the location of the AP currently connected to the terminal device in the real-life image, thereby further guiding the user to reasonably plan the roaming route.

[0227] In some optional implementation manners, based on the above embodiments, the following steps are further performed:

[0228] generating a roaming report for the detection area;

[0229] The roaming report includes part or all of the roaming track, roaming times, signal strength change curve and delay change curve corresponding to the roaming test.

[0230] The generation method of the roaming trajectory can refer to the above embodiment. The roaming number is the number of switching of the AP connected to the AR during the roaming test. The signal strength change curve is the change of signal strength over time. The delay change curve is the change of delay over time.

[0231] In this embodiment, by generating a roaming report, it is possible to subsequently infer where roaming anomalies occur and where network anomalies and fluctuations occur based on the report, thereby providing better signal coverage.

[0232] like Fig.11 As shown, an embodiment of the present application provides a roaming test device 1100, which is applied to a terminal device, and the device includes:

[0233] The AR positioning module 1101 is used to perform AR positioning at the track point of the terminal device to obtain the AR coordinates of the track point; wherein the AR coordinates are coordinates in the AR coordinate system of the terminal device; the track point is the location of the terminal device in the roaming test in the detection area;

[0234] A detection module 1102, used to determine detection data corresponding to the trajectory point;

[0235] A movement trajectory generating module 1103, configured to generate a movement trajectory of the terminal device based on the AR coordinates of the trajectory points;

[0236] The display module 1104 is used to display the movement trajectory and the detection data.

[0237] In some optional implementation manners, before generating the movement trajectory of the terminal device, the movement trajectory generating module 1103 is further used to:

[0238] In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area; wherein the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device;

[0239] Determining a first adjustment ratio between the image coordinate system and the initial AR coordinate system based on the image coordinates of the first positioning point and the first AR coordinates;

[0240] The movement trajectory generation module 1103 is specifically used for:

[0241] If the AR coordinate system corresponding to the terminal device is not offset, converting the first AR coordinate of the track point into the image coordinate of the track point based on the first adjustment ratio;

[0242] Based on the image coordinates of the trajectory points, a movement trajectory of the terminal device is generated in the floor plan.

[0243] In some optional implementation manners, the movement trajectory generating module 1103 is further used to:

[0244] If the AR coordinate system corresponding to the terminal device is offset, determine the image coordinates and the second AR coordinates of the second positioning point; wherein the second positioning point includes at least two positioning points; and the second AR coordinates are coordinates in the offset AR coordinate system of the terminal device;

[0245] determining a second adjustment ratio between the image coordinate system and the offset AR coordinate system based on the image coordinates and the second AR coordinates of the second positioning point;

[0246] In some optional implementation manners, the movement trajectory generating module 1103 is further used to:

[0247] If the AR coordinate system corresponding to the terminal device is offset, converting the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0248] Based on the image coordinates of the trajectory points after the shift, a moving trajectory of the terminal device after the shift is generated in the floor plan.

[0249] Some optional implementations further include a coordinate conversion module 1105, which is used to:

[0250] If the AR coordinate system corresponding to the terminal device is offset, based on the first adjustment ratio and the second adjustment ratio, converting the second AR coordinate of the offset trajectory point into the first AR coordinate in the initial AR coordinate system;

[0251] After the roaming test is completed, a roaming track corresponding to the roaming test is generated based on the first AR coordinates of all track points.

[0252] In some optional implementation manners, the movement trajectory generating module 1103 is further used to:

[0253] The target track point is marked in the moving track.

[0254] In some optional implementations, the display module 1104 is further configured to:

[0255] The collected real-life image of the detection area is displayed.

[0256] In some optional implementations, the display module 1104 is further configured to:

[0257] If the real scene image includes a target track point, the annotation information corresponding to the target track point is rendered in the real scene image.

[0258] In some optional implementations, the target trajectory point is determined by:

[0259] In response to a user marking instruction, determining the trajectory point corresponding to the user marking instruction as the target trajectory point; wherein the marking type of the target trajectory point is user marking; and / or

[0260] A trajectory point representing AP switching is determined as the target trajectory point; wherein the annotation type of the target trajectory point is roaming.

[0261] In some optional implementations, the display module 1104 is further configured to:

[0262] If the real scene image includes a target area, the AP information corresponding to the target area is rendered in the real scene image; wherein the target area is the location of the AP to which the terminal device is currently connected.

[0263] Some optional implementations further include a report generation module 1106, which is used to:

[0264] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming track, roaming times, signal strength change curve and delay change curve corresponding to the roaming test.

[0265] Based on the same technical concept, the embodiment of the present application also provides a terminal device 1200, such as Fig.12 As shown, it includes at least one processor 1201 and a memory 1202 connected to the at least one processor. The specific connection medium between the processor 1201 and the memory 1202 is not limited in the embodiment of the present application. Fig.12 For example, the processor 1201 and the memory 1202 are connected via a bus 1203. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.12 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0266] Among them, the processor 1201 is the control center of the terminal device, and can use various interfaces and lines to connect various parts of the terminal device, and realize data processing by running or executing instructions stored in the memory 1202 and calling data stored in the memory 1202. Optionally, the processor 1201 may include one or more processing units, and the processor 1201 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application program, and the modem processor mainly processes the issuance of instructions. It is understandable that the above-mentioned modem processor may not be integrated into the processor 1201. In some embodiments, the processor 1201 and the memory 1202 may be implemented on the same chip, and in some embodiments, they may also be implemented separately on independent chips.

[0267] The processor 1201 may be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor, an application-specific integrated circuit (ASIC), a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component, and may implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. The steps of the method disclosed in the embodiment of the roaming test method may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0268] Memory 1202, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. Memory 1202 may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (Random Access Memory, RAM), static random access memory (Static Random Access Memory, SRAM), programmable read-only memory (Programmable Read Only Memory, PROM), read-only memory (Read Only Memory, ROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), magnetic memory, disk, optical disk, etc. Memory 1202 is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The memory 1202 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0269] In the embodiment of the present application, the memory 1202 stores a computer program. When the program is executed by the processor 1201, the processor 1201 executes:

[0270] Performing AR positioning at the trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; and determining the detection data corresponding to the trajectory point; wherein the AR coordinates are coordinates in the AR coordinate system of the terminal device; the trajectory point is the location of the terminal device in the roaming test of the detection area;

[0271] Based on the AR coordinates of the trajectory points, a movement trajectory of the terminal device is generated, and the movement trajectory and the detection data are displayed.

[0272] In some optional implementation manners, before generating the movement trajectory of the terminal device, the processor 1201 further executes:

[0273] In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area; wherein the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device;

[0274] Determining a first adjustment ratio between the image coordinate system and the initial AR coordinate system based on the image coordinates of the first positioning point and the first AR coordinates;

[0275] The processor 1201 specifically executes:

[0276] If the AR coordinate system corresponding to the terminal device is not offset, converting the first AR coordinate of the track point into the image coordinate of the track point based on the first adjustment ratio;

[0277] Based on the image coordinates of the trajectory points, a movement trajectory of the terminal device is generated in the floor plan.

[0278] In some optional implementations, the processor 1201 further executes:

[0279] If the AR coordinate system corresponding to the terminal device is offset, determine the image coordinates and the second AR coordinates of the second positioning point; wherein the second positioning point includes at least two positioning points; and the second AR coordinates are coordinates in the offset AR coordinate system of the terminal device;

[0280] determining a second adjustment ratio between the image coordinate system and the offset AR coordinate system based on the image coordinates and the second AR coordinates of the second positioning point;

[0281] The processor 1201 also executes:

[0282] If the AR coordinate system corresponding to the terminal device is offset, converting the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point based on the second adjustment ratio;

[0283] Based on the image coordinates of the trajectory points after the shift, a moving trajectory of the terminal device after the shift is generated in the floor plan.

[0284] In some optional implementations, if the AR coordinate system corresponding to the terminal device is offset, the processor 1201 further executes:

[0285] Based on the first adjustment ratio and the second adjustment ratio, converting the second AR coordinate of the offset trajectory point into the first AR coordinate in the initial AR coordinate system;

[0286] After the roaming test is completed, a roaming track corresponding to the roaming test is generated based on the first AR coordinates of all track points.

[0287] In some optional implementations, the processor 1201 further executes:

[0288] The target track point is marked in the moving track.

[0289] In some optional implementations, the processor 1201 further executes:

[0290] The collected real-life image of the detection area is displayed.

[0291] In some optional implementations, the processor 1201 further executes:

[0292] If the real scene image includes a target track point, the annotation information corresponding to the target track point is rendered in the real scene image.

[0293] In some optional implementations, the target trajectory point is determined by:

[0294] In response to a user marking instruction, determining the trajectory point corresponding to the user marking instruction as the target trajectory point; wherein the marking type of the target trajectory point is user marking; and / or

[0295] A trajectory point representing AP switching is determined as the target trajectory point; wherein the annotation type of the target trajectory point is roaming.

[0296] In some optional implementations, the processor 1201 further executes:

[0297] If the real scene image includes a target area, the AP information corresponding to the target area is rendered in the real scene image; wherein the target area is the location of the AP to which the terminal device is currently connected.

[0298] In some optional implementations, the processor 1201 further executes:

[0299] Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming track, roaming times, signal strength change curve and delay change curve corresponding to the roaming test.

[0300] Based on the same technical concept, an embodiment of the present application also provides a computer-readable storage medium, which stores a computer program executable by a processor. When the program runs on the processor, the processor executes the steps of the above-mentioned roaming test method.

[0301] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0302] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0303] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0304] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0305] Although the embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the embodiments and all changes and modifications falling within the scope of the present application.

[0306] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A roaming test method, characterized in that: Applied to a terminal device, the method comprises: Performing augmented reality (AR) positioning at the trajectory point of the terminal device to obtain the AR coordinates of the trajectory point; and determining the detection data corresponding to the trajectory point; wherein the AR coordinates are coordinates in the AR coordinate system of the terminal device; and the trajectory point is the location of the terminal device in the roaming test of the detection area; Based on the AR coordinates of the trajectory points, a movement trajectory of the terminal device is generated, and the movement trajectory and the detection data are displayed.

2. The method according to claim 1, characterized in that Before generating the movement trajectory of the terminal device, the method further includes: In response to the floor plan of the detection area, determine the image coordinates and the first AR coordinates of the first positioning point in the detection area; wherein the first positioning point includes at least two positioning points; the image coordinates are coordinates in the image coordinate system of the floor plan; and the first AR coordinates are coordinates in the initial AR coordinate system of the terminal device; Determining a first adjustment ratio between the image coordinate system and the initial AR coordinate system based on the image coordinates of the first positioning point and the first AR coordinates; Generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory point includes: If the AR coordinate system corresponding to the terminal device is not offset, converting the first AR coordinate of the track point into the image coordinate of the track point based on the first adjustment ratio; Based on the image coordinates of the trajectory points, a movement trajectory of the terminal device is generated in the floor plan.

3. The method according to claim 2, characterized in that Also includes: If the AR coordinate system corresponding to the terminal device is offset, determine the image coordinates and the second AR coordinates of the second positioning point; wherein the second positioning point includes at least two positioning points; and the second AR coordinates are coordinates in the offset AR coordinate system of the terminal device; determining a second adjustment ratio between the image coordinate system and the offset AR coordinate system based on the image coordinates and the second AR coordinates of the second positioning point; Generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory point also includes: If the AR coordinate system corresponding to the terminal device is offset, converting the second AR coordinates of the offset trajectory point into the image coordinates of the offset trajectory point based on the second adjustment ratio; Based on the image coordinates of the trajectory points after the shift, a moving trajectory of the terminal device after the shift is generated in the floor plan.

4. The method according to claim 3, characterized in that If the AR coordinate system corresponding to the terminal device is offset, the method further includes: Based on the first adjustment ratio and the second adjustment ratio, converting the second AR coordinate of the offset trajectory point into the first AR coordinate in the initial AR coordinate system; After the roaming test is completed, a roaming track corresponding to the roaming test is generated based on the first AR coordinates of all track points.

5. The method according to claim 1, characterized in that Also includes: The target track point is marked in the moving track.

6. The method according to claim 1, characterized in that Displaying the movement trajectory and the detection data also includes: The collected real-life image of the detection area is displayed.

7. The method according to claim 6, characterized in that Also includes: If the real scene image includes a target track point, the annotation information corresponding to the target track point is rendered in the real scene image.

8. The method according to claim 5 or 7, characterized in that The target trajectory point is determined by: In response to a user marking instruction, determining the trajectory point corresponding to the user marking instruction as the target trajectory point; wherein the marking type of the target trajectory point is user marking; and / or A trajectory point representing AP switching is determined as the target trajectory point; wherein the annotation type of the target trajectory point is roaming.

9. The method according to claim 6, characterized in that Also includes: If the real scene image includes a target area, the AP information corresponding to the target area is rendered in the real scene image; wherein the target area is the location of the AP to which the terminal device is currently connected.

10. The method according to claim 1, characterized in that Also includes: Generate a roaming report for the detection area; wherein the roaming report includes part or all of the roaming track, roaming times, signal strength change curve and delay change curve corresponding to the roaming test.

11. A roaming test device, characterized in that: Applied to augmented reality terminal equipment, the device includes: An augmented reality (AR) positioning module, configured to perform AR positioning at a track point of the terminal device to obtain AR coordinates of the track point; wherein the AR coordinates are coordinates in an AR coordinate system of the terminal device; and the track point is a location of the terminal device in a roaming test in a detection area; A detection module, used to determine the detection data corresponding to the trajectory point; A movement trajectory generating module, used for generating a movement trajectory of the terminal device based on the AR coordinates of the trajectory points; A display module is used to display the movement trajectory and the detection data.

12. An augmented reality terminal device, characterized in that: The method comprises at least one processor and at least one memory, wherein the memory stores a computer program, and when the program is executed by the processor, the processor executes the method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that: It stores a computer program executable by a computer. When the program is run on the computer, the computer is enabled to execute the method according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Mobile terminal online space roaming method based on AR

    CN111161421A

  • Multi-rover collaborative navigation method, electronic equipment and storage medium

    CN112710985A

  • Mesh networking test method, device, equipment and storage medium

    CN113938899A

  • Track map generation method and device and computer readable storage medium

    CN114549582A

  • WebGL-based information labeling method, live-action navigation method and terminal

    CN114758098A

Cited By

  • Roaming test method and apparatus, terminal device, and storage medium

    EP4738915A1