Analog test system, method, apparatus, electronic device, and storage medium
By combining a simulated track and a mobile platform with a six-axis steering platform, a dynamic testing system was developed to solve the problem of testing accuracy for AR glasses under dynamic posture and spatial position changes, achieving efficient and reliable automated testing.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HUBEI XINGJI MEIZU TECH CO LTD
- Filing Date
- 2022-09-21
- Publication Date
- 2026-06-19
AI Technical Summary
Existing AR glasses testing methods are mainly based on static conditions, which fail to effectively simulate the device's performance under dynamic posture and spatial position changes, resulting in insufficient test accuracy and reliability.
A simulation testing system was designed to simulate the dynamic spatial and attitude changes of AR glasses using a simulated track and a mobile platform. Combined with a six-axis steering platform and a wireless communication module, the system enables the simulation and automated testing of the six degrees of freedom position and attitude of AR glasses.
It improves the accuracy and reliability of AR glasses testing, reduces manpower input, and improves testing efficiency and precision by simulating real-world usage conditions.
Smart Images

Figure CN115541275B_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the technical field of equipment testing, and relates to a simulation testing system, and more particularly to a simulation testing system, method, apparatus, electronic device and storage medium. Background Technology
[0002] Currently, most new forms of smart wearable electronic devices, such as AR (Augmented Reality) glasses, are developed based on the Android system. Compared with other wearable devices and mobile phones, the displayed images and interaction methods of AR glasses and other visual wearable devices are strongly correlated with the user's body posture and spatial position. The glasses display adjusts the corresponding image content according to the user's position and posture. In the testing of such AR glasses devices, most tests are based on static methods such as placing the device flat. However, in actual use, AR glasses devices read the user's posture and spatial position in real time. Therefore, the accuracy and reliability of testing such AR glasses devices need further improvement. Summary of the Invention
[0003] This application provides a simulation testing system, method, apparatus, electronic device, and storage medium, which further improves the accuracy and reliability of smart wearable device testing through dynamic testing.
[0004] One embodiment of this application provides a simulation testing system for testing smart wearable devices. The simulation testing system includes: a simulated track configured on the smart wearable device to achieve a first spatial change; a mobile platform movably connected to the simulated track and configured on which the smart wearable device, mounted on the mobile platform, achieves a first attitude change with three degrees of freedom; and a test host communicatively connected to both the mobile platform and the smart wearable device, configured to issue test commands to both the mobile platform and the smart wearable device, so that the mobile platform drives the smart wearable device to perform a preset action along the simulated track based on the test commands, and the smart wearable device generates a first operation command when performing the preset action.
[0005] In one possible implementation, the test host is further configured to: receive first spatial data and first posture data of the smart wearable device, wherein the first spatial data is spatial data when the smart wearable device is preset to be placed on the mobile platform, and the first posture data is three-degree-of-freedom posture data of the smart wearable device when preset to be placed on the mobile platform; receive at least one second spatial data and at least one second posture data of the smart wearable device, wherein the second spatial data is spatial data when the smart wearable device performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when performing the preset action based on the test command; and determine the spatial and posture changes of the smart wearable device when performing the preset action based on the first spatial data, the second spatial data, the first posture data, and the second posture data.
[0006] In one possible implementation, the test host is further configured to: receive the number of times the smart wearable device performs a preset action and the number of times it generates a first operation command, and determine the first operation success rate of the smart wearable device.
[0007] In one possible implementation, the test host is further configured to: receive processor data and memory data when the smart wearable device performs a preset action process along the simulated track via the mobile platform, wherein the processor data and memory data include peak data and average data.
[0008] In one possible implementation, the simulated track includes at least one or more combinations of straight tracks, curves, undulating tracks, or spiral tracks.
[0009] In one possible implementation, the simulated track is further configured such that the design accuracy of the simulated track is not lower than the positioning accuracy of the smart wearable device; wherein, the design accuracy refers to the accuracy with which the simulated track causes the mobile platform to translate, and the positioning accuracy refers to the translation accuracy possessed by the smart wearable device.
[0010] In one possible implementation, the smart wearable device includes a first wireless communication module; the smart wearable device communicates with the test host through the first wireless communication module.
[0011] In one possible implementation, the mobile platform includes: a six-degree-of-freedom simulation turntable and a track trolley; the six-degree-of-freedom simulation turntable has a loading surface, which is configured to place the smart wearable device; the six-degree-of-freedom simulation turntable and the track trolley are fixedly connected; the track trolley is movably connected to the simulated track.
[0012] In one possible implementation, the movable connection is a rolling connection; the bottom of the track trolley is provided with wheels, and the simulated track includes double rails and a connecting rod with a fixed distance between the double rails; the wheels of the track trolley achieve rolling connection through friction with the connecting rod.
[0013] In one possible implementation, the track trolley includes a second wireless communication module; the track trolley is communicatively connected to the test host via the second wireless communication module.
[0014] In one possible implementation, the six-degree-of-freedom simulation turntable includes a six-axis steering platform, which, when rotated, simulates the first attitude change of the smart wearable device in six degrees of freedom; the six-axis steering platform includes a third wireless communication module; and the six-axis steering platform is communicatively connected to the test host through the third wireless communication module.
[0015] In one possible implementation, a spatial position reference device is provided on the simulated track. When the mobile cargo platform travels on the simulated track and passes the spatial position reference device, the generated spatial position reference data is used to associate with the current spatial data of the smart wearable device. By analyzing the degree of deviation between the spatial data and the spatial position reference data, the spatial position accuracy is determined.
[0016] In one possible implementation, the spatial position reference device includes a sensing magnetic sheet.
[0017] Another embodiment of this application provides a simulation testing method applied to the aforementioned simulation testing system. A smart wearable device is placed on a mobile platform, and the mobile platform is movably connected to a simulated track. The smart wearable device is configured to generate a first operation command when performing a preset action. The simulated track is configured for the smart wearable device to perform a first spatial change. The mobile platform is configured for the smart wearable device, which is placed on the mobile platform, to perform a first attitude change with three degrees of freedom. The method includes: receiving a test command from a test host, causing the mobile platform to drive the smart wearable device along the simulated track to perform a preset action based on the test command. The test host is communicatively connected to both the mobile platform and the smart wearable device.
[0018] In one possible implementation, the method further includes: receiving first spatial data and first posture data of the smart wearable device, wherein the first spatial data is spatial data when the smart wearable device is preset to be placed on the mobile platform, and the first posture data is three-degree-of-freedom posture data of the smart wearable device when preset to be placed on the mobile platform; receiving at least one second spatial data and at least one second posture data of the smart wearable device, wherein the second spatial data is spatial data when the smart wearable device performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when performing the preset action based on the test command; and determining the spatial and posture changes of the smart wearable device when performing the preset action based on the first spatial data, the second spatial data, the first posture data, and the second posture data.
[0019] In one possible implementation, the method further includes: receiving the number of times the smart wearable device performs a preset action and the number of times it generates a first operation command, and determining the first operation success rate of the smart wearable device.
[0020] In one possible implementation, the method further includes: receiving processor data and memory data when the smart wearable device performs a preset action process along the simulated track via the mobile platform, wherein the processor data and memory data include peak data and average data.
[0021] In one possible implementation, the mobile cargo platform includes a three-degree-of-freedom simulation turntable and a track trolley; the method further includes controlling the movement speed of the track trolley through the test host.
[0022] Another aspect of this application provides a simulation testing device, in which a smart wearable device is placed on a mobile platform, and the mobile platform is movably connected to a simulated track. The smart wearable device is configured to generate a first operation command when a preset action is performed. The simulated track is configured for the smart wearable device to achieve a first spatial change. The mobile platform is configured for the smart wearable device, placed on the mobile platform, to achieve a first attitude change with three degrees of freedom. The device includes: a first receiving unit for receiving test commands from a test host, so that the mobile platform drives the smart wearable device to perform a preset action along the simulated track based on the test commands. The test host is communicatively connected to both the mobile platform and the smart wearable device.
[0023] In another aspect, this application provides an electronic device including a processor and a memory, wherein the memory stores instructions, and when the processor executes the instructions, the device performs the method described thereon.
[0024] The last aspect of this application provides a computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a computer, cause the computer to perform the method described thereon.
[0025] As described above, the simulation testing system, method, apparatus, electronic device, and storage medium described in the embodiments of this application, taking AR glasses as an example, have the following beneficial effects:
[0026] This application embodiment simulates a track to provide an operating environment for the smart wearable device to change its spatial position in three translational degrees of freedom: up and down, forward and backward, and left and right. A mobile platform is used to place the smart wearable device and drive it to perform position changes in three rotational degrees of freedom: X, Y, and Z. Therefore, the mobile platform that places the smart wearable device runs on the simulated track. By combining the three-dimensional track system with a six-axis turntable, the simulation of the six-degree-of-freedom position and attitude of the AR glasses is realized.
[0027] This application embodiment uses a six-axis steering platform to simulate the head posture changes of AR glasses users and simulates the spatial position changes of AR glasses in actual use by simulating the track. Therefore, this application designs an automated software testing system based on simulating head posture changes and spatial position changes.
[0028] This application embodiment improves the accuracy and reliability of AR glasses software test results by analyzing test data such as attitude data, performance data, power consumption data, and stability data returned in real time when AR glasses run on a simulated track.
[0029] This application embodiment achieves WIFI control of the test execution machine by communicating with the first wireless communication module of the AR glasses, the second wireless communication module of the track vehicle, and the third wireless communication module of the six-axis steering platform through the communication connection between the test host and the AR glasses, thereby improving the testing efficiency of the AR glasses software testing phase and reducing the manpower input of software testing work.
[0030] This application embodiment realizes automated testing of 6DOF simulation of AR glasses in realistic usage conditions. Specifically, when simulating changes in the head posture of the AR glasses user, a spherical 3D posture positioning APP is used in conjunction with a six-axis turntable for posture control, achieving dynamic testing of the accuracy of 3DOF posture evaluation for AR glasses. Attached Figure Description
[0031] Figure 1AThe diagram shown is a schematic diagram of a smart wearable device provided in an embodiment of this application.
[0032] Figure 1B The diagram shown is a structural connection diagram of the simulation test system in one embodiment of this application.
[0033] Figure 2 The diagram shows the spatial position change of the simulation test system in one embodiment of this application.
[0034] Figure 3 The diagram shown is a schematic representation of a simulated track in one embodiment of the simulation test system of this application.
[0035] Figure 4 The diagram shown is a simulated track structure diagram of a simulation test system in one embodiment of this application.
[0036] Figure 5 The diagram shown illustrates the communication architecture of a simulation testing system in one embodiment of this application.
[0037] Figure 6 The diagram shown is a schematic representation of the attitude model of the simulation test system in one embodiment of this application.
[0038] Figure 7 The diagram shown is a flowchart illustrating the principle of a simulation testing method in one embodiment of this application.
[0039] Component designation explanation
[0040] 101. Frame body
[0041] 102 First temple
[0042] 103 Second temple
[0043] 104 sensors
[0044] 105 Circuit
[0045] 1. Simulated orbit
[0046] 2. Mobile cargo platform
[0047] 3. Test host
[0048] Steps S71-S72 Detailed Implementation
[0049] The following specific examples illustrate the implementation of this application. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. This application can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be noted that, unless otherwise specified, the following embodiments and features in the embodiments can be combined with each other.
[0050] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this application. Therefore, the illustrations only show the components related to this application and are not drawn according to the number, shape and size of the components in actual implementation. In actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.
[0051] Figure 1A This illustration shows a schematic diagram of a smart wearable device according to an embodiment of this application. As an example, this smart wearable device can be smart glasses, or other devices such as smart bracelets, smartwatches, or devices that utilize wearable technology to intelligently design and develop everyday wearables; this application does not limit the scope of the invention. Figure 1A As shown, the smart glasses include a frame body 101, a first temple 102, a second temple 103, a sensor 104, and a circuit 105. The frame body 101 has lenses and includes a first end connected to the first temple 102 and a second end connected to the second temple. The sensor 104 is connected to the circuit 105.
[0052] The circuit 105 can be a processor, such as a central processing unit (CPU) or a system on chip (SOC), but this application embodiment does not limit it.
[0053] The sensor 104 can be an inertial measurement unit (IMU). The smart glasses collect the current six degrees of freedom information of the smart glasses through the sensor 104. The circuit 105 determines the preset action to be implemented based on the six degrees of freedom information collected by the sensor 104 and generates the first operation command.
[0054] In some examples, the smart glasses may also include an A / D converter, which is connected to the sensor 104 and the circuit 105 respectively, and is used to convert the analog data collected by the sensor 104 into digital data and send it to the circuit 105. It should be noted that the A / D converter may also be integrated into the sensor 104 or the circuit 105, and this application embodiment does not limit this.
[0055] It should be noted that, Figure 1A This is merely an example and not a limitation. For instance, in this embodiment, the sensor 104 or circuit 105 can be disposed not only on the first temple 102, but also on the frame body 101 or the second temple 103. As another example, the sensor 104 or circuit 105 can be disposed not only inside the temple, but also outside the temple (e.g., protruding from the temple). Furthermore, the number of sensors can be greater than one, such as two or three.
[0056] In some descriptions, the first temple 102 and the second temple 103 can also be referred to as the left and right temples. That is, in some descriptions, "left and right temples" and "first temple 102 and second temple 103" have the same meaning and can be used interchangeably.
[0057] As an example, the sensor may also include an electronic compass, a compass, a gyroscope, a Hall sensor, an optical sensor, etc., but this application does not limit the embodiments thereto.
[0058] The simulation testing system, method, apparatus, electronic device, and storage medium described in this application realize automated testing of AR glasses in real-world usage using a six-degree-of-freedom structure. This application provides an automated testing structure scheme for testing AR glasses in actual use, such as during head movements of the wearer, which can improve the accuracy and reliability of AR glasses software testing, while also increasing testing efficiency through fully automated control of the system structure.
[0059] 3DOF refers to the three degrees of freedom of rotation in posture changes. 6DOF refers to the three degrees of freedom of rotation, and the degrees of freedom related to the three positions: up / down, forward / backward, and left / right. AR (Augmented Reality) is a technology that cleverly integrates virtual information with the real world. It simulates computer-generated text, images, 3D models, music, videos, and other virtual information, and applies them to the real world. The two types of information complement each other, thereby "enhancing" the real world.
[0060] The following will combine Figures 1A to 7 This paper elaborates on the principles and implementation methods of a simulation testing system, method, apparatus, electronic device, and storage medium of this embodiment, so that those skilled in the art can understand the simulation testing system, method, apparatus, electronic device, and storage medium of this embodiment without creative effort.
[0061] Please see Figure 1B The diagram shows a schematic representation of the structural connection of a simulation testing system according to one embodiment of this application. Figure 1BAs shown, the simulation testing system is used to test smart wearable devices, with AR glasses as an example. The simulation testing system includes: a simulation track 1, a mobile platform 2, and a test host 3.
[0062] The simulated track 1 is configured on the smart wearable device 4 to achieve the first spatial change.
[0063] The mobile platform 2 is movably connected to the simulated track 1, and the smart wearable device 4 configured on the mobile platform 2 realizes the first attitude change with three degrees of freedom.
[0064] The test host 3 is communicatively connected to the mobile platform 2 and the smart wearable device 4, and is configured to send test commands to the mobile platform 2 and the smart wearable device 4, so that the mobile platform 2 drives the smart wearable device 4 to perform a preset action along the simulated track based on the test command, and the smart wearable device generates a first operation command when it performs the preset action.
[0065] Please see Figure 2 This is a schematic diagram showing the spatial position change of the simulation test system in one embodiment of this application. Figure 2 As shown, this application mainly simulates the changes in the user's head posture during actual use of AR glasses, i.e., 3DOF posture simulation. The AR glasses are placed on the surface of an electrically powered, programmable, mobile platform to simulate changes in head posture, including common posture changes such as looking up 40 degrees, looking down 40 degrees, turning 90 degrees to the left, and turning 90 degrees to the right.
[0066] Please see Figure 3 The image shows a schematic diagram of a simulated track in one embodiment of the simulation test system of this application. Figure 3 As shown, the simulation track of this application needs to have a combination of three-dimensional tracks, straight tracks, vertical upward and downward tracks, and horizontal curves to simulate the changes in the three-dimensional spatial position of AR glasses.
[0067] Please see Figure 4 The diagram shows a simulated track structure of the simulation test system in one embodiment of this application. Figure 4 As shown, the simulated track includes at least one or more combinations of straight tracks, curves, undulating tracks, or spiral tracks.
[0068] It should be noted that, Figure 4 The structure of the simulated track is just one example; other structures that can simulate changes in the spatial position of AR glasses also exist. Figure 3Any of the features of the track structure or its variations are within the scope of protection of this application.
[0069] In one embodiment, the test host is further configured to: receive first spatial data and first posture data of the smart wearable device, wherein the first spatial data is spatial data when the smart wearable device is preset to be placed on the mobile platform, and the first posture data is three-degree-of-freedom posture data of the smart wearable device when preset to be placed on the mobile platform; receive at least one second spatial data and at least one second posture data of the smart wearable device, wherein the second spatial data is spatial data when the smart wearable device performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when performing the preset action based on the test command; and determine the spatial and posture changes of the smart wearable device when performing the preset action based on the first spatial data, the second spatial data, the first posture data, and the second posture data.
[0070] In one embodiment, the test host is further configured to: receive the number of times the smart wearable device performs a preset action and the number of times it generates a first operation instruction, and determine the first operation success rate of the smart wearable device.
[0071] In one embodiment, the test host is further configured to: receive processor data and memory data when the smart wearable device performs a preset action process along the simulated track via the mobile platform, wherein the processor data and memory data include peak data and average data.
[0072] In one embodiment, the design accuracy of the simulated track is no less than the positioning accuracy of the AR glasses; wherein, the design accuracy refers to the accuracy with which the simulated track causes the mobile platform to translate, and the positioning accuracy refers to the translation accuracy of the smart wearable device, such as AR glasses.
[0073] In one embodiment, a spatial position reference device is provided on the simulated track. When the mobile platform travels on the simulated track and passes the spatial position reference device, the generated spatial position reference data is used to associate with the current spatial data of the AR glasses. By analyzing the degree of deviation between the spatial data and the spatial position reference data, the spatial position accuracy is determined.
[0074] like Figure 4 As shown, in practical applications, the spatial position reference device includes a sensing magnetic sheet.
[0075] In practical applications, the mobile cargo platform includes: a three-degree-of-freedom simulation turntable and a track trolley, the three-degree-of-freedom simulation turntable and the track trolley being fixedly connected; the three-degree-of-freedom simulation turntable is provided with a cargo surface, on which the AR glasses are fixed; the track trolley is movably connected to the simulated track, and the three-degree-of-freedom simulation turntable includes a six-axis steering platform. Figure 4 A trolley track system is used to simulate changes in the spatial position of the AR glasses. The trolley moves at a constant speed within the track system. Simultaneously, a six-axis steering platform on the trolley simulates the wearing posture. This trolley track system and the six-axis steering platform are used to simulate the 6DOF (6 Degrees of Flight) of the AR glasses, i.e., changes in the spatial position of the glasses plus changes in their posture. Spatial position reference points are anchored at several locations within the track system, such as using inductive magnetic sheets or other devices for sensing at fixed positions, to determine the 6DOF spatial position accuracy. Furthermore, the actual scale of the simulated track needs to be designed according to the positioning accuracy of the AR glasses, maintaining a spatial scale at least on the same order of magnitude as or higher than the positioning accuracy of the AR glasses. The rotational sensitivity of the six-axis steering platform also needs to maintain a spatial scale on the same order of magnitude as or higher than the positioning accuracy of the AR glasses. Specifically, the inductive magnetic sheet can be a screw fixed on the simulated track or any other component that can be sensed as an electrical signal by the simulated trolley. The simulated car senses the screw via NFC (Near Field Communication) and then transmits the sensing signal to the test host via communication, so that the test host can associate the spatial coordinate information of the location with test data such as the posture data of the AR glasses when driving at that location.
[0076] Please see Figure 5 This is a communication architecture diagram of the simulation test system in one embodiment of this application. Figure 5 As shown, the dashed ellipse marks the six-axis steering platform and track vehicle carrying the AR glasses under test.
[0077] The AR glasses include a first wireless communication module; the first wireless communication module is communicatively connected to the test host.
[0078] In one embodiment, the movable connection is a rolling connection; the bottom of the track trolley is provided with wheels, and the simulated track includes double rails and a connecting rod with a fixed distance between the double rails; the wheels of the track trolley achieve rolling connection through friction with the connecting rod.
[0079] In one embodiment, the track trolley includes a second wireless communication module; the second wireless communication module is communicatively connected to the test host.
[0080] In one embodiment, when the six-axis steering platform rotates, it simulates the first posture change of the AR glasses, namely the user's head posture change; the head posture change includes at least one of tilting the head up 40 degrees, tilting the head down 40 degrees, turning 90 degrees to the left, or turning 90 degrees to the right; the six-axis steering platform includes a third wireless communication module; the third wireless communication module is communicatively connected to the test host.
[0081] For example, the first wireless communication module, the second wireless communication module, the third wireless communication module, and the test host can connect and communicate with the network using wireless communication. The wireless communication can be a short-range wireless transmission technology, such as Wi-Fi, Bluetooth (BT), or Near Field Communication (NFC). The wireless communication can also be a long-range wireless transmission technology, including Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), New Radio (NR), GNSS, FM (Frequency Modulation), and / or IR (Infrared Radiation) technology. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS), etc.
[0082] Please see Figure 6The image shown is a schematic diagram of the attitude model of the simulation test system in one embodiment of this application. Figure 6 As shown, this application places AR glasses in an electrically programmable six-axis steering platform to simulate the 3DOF head posture changes of users in actual use of AR glasses. The specific simulated head posture changes include: looking up 40 degrees, looking down 40 degrees, turning left 90 degrees, turning right 90 degrees, and other common posture changes when wearing AR glasses. Figure 6 The diagram shows a 3D attitude testing app. A 3D sphere with grid numbers is used in conjunction with the real-time attitude control of a six-axis platform to dynamically test the attitude and position of the fixed sphere under different attitudes.
[0083] In practical applications, the simulation test system consists of two main parts: (1) a 6DOF laboratory simulation system consisting of a WIFI-controlled track trolley, a six-axis head posture simulation steering platform (3DOF simulation), a test sample glasses camera, and a simulation track. (2) an automated test system consisting of a test host or server and a wireless router.
[0084] Furthermore, the software support related to the use of the automated testing system includes: head motion simulation algorithm, 6DOF accuracy testing APP, and Android performance / stability / power consumption testing software (such as Monkey stability testing software, performance monitoring testing software, Android aging scripts, and other automated testing software).
[0085] The test host includes a control and data storage module. The test host controls the speed of the vehicle and the attitude of the six-axis platform through a WIFI network, and sends test commands from the Android automated testing software to the AR glasses through WIFI. At the same time, the test host or server receives test data such as attitude, performance, power consumption, and stability returned by the AR glasses through WIFI, performs test data analysis, and outputs test result charts.
[0086] Please see Figure 7 The diagram shows a flowchart illustrating the principle of a simulation testing method in one embodiment of this application. Figure 7As shown, the simulation testing method is applied to a simulation testing system for testing smart wearable devices. The smart wearable device is placed on a mobile platform, which is movably connected to a simulation track. The smart wearable device is configured to generate a first operation command when performing a preset action. The simulation track is configured to allow the smart wearable device to achieve a first spatial change. The mobile platform is configured to allow the smart wearable device, placed on the mobile platform, to achieve a first posture change with three degrees of freedom. Taking AR glasses as an example, the smart wearable device includes: a simulation track providing an operating environment for the AR glasses to perform spatial position changes with three translational degrees of freedom (up / down, forward / backward, and left / right); a mobile platform movably connected to the simulation track; the mobile platform is used to place the AR glasses, causing the AR glasses to perform position changes with three rotational degrees of freedom (X, Y, Z); and a test host communicating with both the mobile platform and the AR glasses. The simulation testing method includes:
[0087] S71 receives test commands from the test host.
[0088] S72, the mobile platform drives the smart wearable device to perform a preset action along the simulated track based on the test command, wherein the test host is communicatively connected to the mobile platform and the smart wearable device respectively.
[0089] In one embodiment, the method further includes: receiving first spatial data and first posture data of the smart wearable device, wherein the first spatial data is spatial data when the smart wearable device is preset to be placed on the mobile platform, and the first posture data is three-degree-of-freedom posture data of the smart wearable device when preset to be placed on the mobile platform; receiving at least one second spatial data and at least one second posture data of the smart wearable device, wherein the second spatial data is spatial data when the smart wearable device performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when performing the preset action based on the test command; and determining the spatial and posture changes of the smart wearable device when performing the preset action based on the first spatial data, the second spatial data, the first posture data, and the second posture data.
[0090] In one embodiment, the method further includes: receiving the number of times the smart wearable device performs a preset action and the number of times it generates a first operation instruction, and determining the first operation success rate of the smart wearable device.
[0091] In one embodiment, the method further includes: receiving processor data and memory data when the smart wearable device performs a preset action process along the simulated track via the mobile platform, wherein the processor data and memory data include peak data and average data.
[0092] In one embodiment, the mobile cargo platform includes a three-degree-of-freedom simulation turntable and a track trolley; the method further includes controlling the movement speed of the track trolley through the test host.
[0093] In one embodiment, the mobile cargo platform includes: a three-degree-of-freedom simulation turntable and a track trolley; the simulation testing method further includes:
[0094] The test host controls the movement speed of the track vehicle, the attitude of the three-degree-of-freedom simulated turntable, and sends test commands to the AR glasses.
[0095] The test host receives test data returned by the AR glasses, including posture data, performance data, power consumption data, and stability data.
[0096] In one embodiment, the simulation testing method further includes: analyzing the degree of deviation between the test data and the reference data during calibration using the test host, determining the six-degree-of-freedom spatial position accuracy, and outputting the test results.
[0097] Specifically, the test data includes: attitude data, performance data, power consumption data, and stability data, which are analyzed in real time, and the output test results include:
[0098] (1) Attitude data analysis
[0099] Attitude data analysis mainly involves calculating spatial coordinates X, Y, Z and Euler angles for accuracy analysis. The specific calculation method is based on existing Euler angle calculation methods.
[0100] (2) Performance data analysis
[0101] Performance testing primarily includes testing startup time, response time, smoothness, I / O performance, and responsiveness. Startup time mainly tests the application's initial launch, cold start, and warm start times, using the adb command `adb shell am start -WpackageName / ActivityName` to capture the application's startup time. Response time mainly tests the response time in scenarios such as interface switching, application switching, and system interaction switching, using logcat logs and methods such as subjective stopwatch or high-speed camera frame capture. Smoothness mainly tests the smoothness of scrolling, switching, and animation effects; this can be achieved by capturing three or more consecutive frames (in red) to indicate dropped frames. I / O performance mainly tests app installation, ZIP decompression, and file transfer. Responsiveness mainly tests the responsiveness of the touchpad and 3Dof head-tracking during use, captured using the Systrace tool.
[0102] (3) Power consumption data analysis
[0103] Power consumption testing primarily includes testing standby current, scene current, regression current, memory, battery life, and temperature rise. Standby current mainly tests screen-on standby and screen-off standby. Scene current mainly tests the current during system calls, message notifications, settings, pop-up prompts, TouchPad, smart connections, and smart interactions. Regression current mainly tests the regression current during small window mode, call notifications, accessing the task center, settings, 3DOF applications, AR applications, Wi-Fi connections, and Bluetooth connections. Memory testing mainly tests memory usage, memory leaks, resident memory, and remaining memory at boot, focusing on whether memory is properly reclaimed during system use and whether memory leaks occur. Battery life testing focuses on high-frequency usage scenarios (driving, business, and entertainment) to verify the power consumption of these scenarios and their impact on the overall battery life. Temperature rise testing also focuses on high-frequency usage scenarios (driving, business, and entertainment) to verify the temperature changes of the entire device during prolonged use in these scenarios.
[0104] (4) Stability data analysis
[0105] Stability testing primarily involves Monkey, aging, stress, and interruption tests. Random stress tests are conducted using the Monkey command, focusing on the presence of ANR, Exception, Null, Error, and Crash (Fatal) I / O anomalies. A 72-hour full-device aging test simulates the aging state of user devices, performing performance tests under various scenarios. The key focus is ensuring that system stability testing does not result in shutdown, crash, unresponsiveness, or black / frozen screens. Repeated operations are performed 500 times for scenarios such as power on / off, screen on / off, system notifications, factory reset, and switching Bluetooth / Wi-Fi on / off, with a focus on ensuring that system stability testing does not result in crashes, restarts, crashes, black screens, or frozen screens. General interruption tests are performed under different system states, such as incoming calls, message notifications, and alarm notifications, to simulate interruptions during use, including AR navigation, video playback, music playback, phone calls, voice and video calls, and WeChat chatting.
[0106] In one embodiment, the simulation testing method further includes: storing the received test data corresponding to different times through the test host.
[0107] One embodiment of this application provides a simulation testing device, in which a smart wearable device is placed on a mobile platform, and the mobile platform is movably connected to a simulated track. The smart wearable device is configured to generate a first operation command when a preset action is performed. The simulated track is configured for the smart wearable device to achieve a first spatial change. The mobile platform is configured for the smart wearable device, placed on the mobile platform, to achieve a first attitude change with three degrees of freedom. The device includes: a first receiving unit for receiving test commands from a test host, so that the mobile platform drives the smart wearable device to perform a preset action along the simulated track based on the test commands. The test host is communicatively connected to both the mobile platform and the smart wearable device.
[0108] One embodiment of this application provides an electronic device, including a processor and a memory, wherein the memory stores instructions, and when the processor executes the instructions, the device performs the method described thereon.
[0109] In practical applications, the electronic device may be a computer including all or some of its components such as memory, storage controller, one or more processing units (CPU), peripheral interfaces, RF circuitry, audio circuitry, speakers, microphones, input / output (I / O) subsystems, displays, other output or control devices, and external ports; the computer includes, but is not limited to, personal computers such as desktop computers, laptops, tablets, smartphones, and personal digital assistants (PDAs). In other embodiments, the electronic device may also be a server, which may be deployed on one or more physical servers depending on factors such as function and load, or it may be a cloud server composed of distributed or centralized server clusters; this embodiment does not impose any limitations.
[0110] One embodiment of this application provides a computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a computer, cause the computer to perform the method described thereon.
[0111] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented using computer program-related hardware. The aforementioned computer program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned computer-readable storage medium includes various computer storage media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.
[0112] The scope of protection of the simulation test method described in this application is not limited to the execution order of the steps listed in this embodiment. Any solution implemented by adding, subtracting, or replacing steps in the prior art based on the principles of this application is included within the scope of protection of this application.
[0113] The principles of the simulation testing method and testing device described in this application correspond one-to-one with the simulation testing system described in this application. The simulation testing system described in this application can implement the simulation testing method described in this application. However, the implementation device of the simulation testing method described in this application includes, but is not limited to, the structure of the simulation testing system listed in this embodiment. All structural modifications and substitutions of the prior art made based on the principles of this application are included within the protection scope of this application.
[0114] In summary, the simulation testing system, method, apparatus, electronic equipment, and storage medium described in this application, combined with a three-dimensional track system and a six-axis turntable, achieve 6DOF position and posture simulation for AR glasses. An automated software testing system based on mimicking head posture changes and spatial position changes is designed. This improves the accuracy and reliability of AR glasses software test results. The addition of Wi-Fi control to the test execution machine enhances testing efficiency during the AR glasses software testing phase and reduces manpower investment in software testing. It achieves automated testing of 6DOF simulation of AR glasses in realistic usage conditions. A spherical three-dimensional posture positioning APP, in conjunction with the six-axis turntable, performs posture control, enabling dynamic testing of the accuracy of 3DOF posture evaluation for AR glasses.
[0115] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this application should still be covered by the claims of this application.
Claims
1. An analog test system, characterized by, The simulation testing system is used for testing smart wearable devices and includes: A simulated track is configured on the smart wearable device to achieve a first spatial change; A mobile platform, movably connected to the simulated track, is configured to enable the smart wearable device, which is mounted on the mobile platform, to achieve a first attitude change with three degrees of freedom. A test host, communicatively connected to both the mobile platform and the smart wearable device, is configured to issue test commands to both the mobile platform and the smart wearable device. The mobile platform, based on the test commands, drives the smart wearable device to perform a preset action along the simulated track. When the smart wearable device performs the preset action, it generates a first operation command. The test host is also configured to receive first spatial data and first posture data from the smart wearable device, wherein the first spatial data is the spatial data of the smart wearable device when it is presetly placed on the mobile platform, and the first posture data is the three-dimensional spatial data of the smart wearable device when it is presetly placed on the mobile platform. The system includes: receiving at least one second spatial data and at least one second posture data from the smart wearable device, wherein the second spatial data is spatial data of the smart wearable device when it performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when it performs a preset action based on the test command; determining the spatial and posture changes of the smart wearable device when performing the preset action based on the first spatial data, the second spatial data, the first posture data, and the second posture data; and receiving the number of times the smart wearable device performs the preset action and the number of times it generates the first operation command, and determining the first operation success rate of the smart wearable device.
2. The analog test system of claim 1, wherein, The test host is also configured to: The processor data and memory data received by the smart wearable device during the preset action process along the simulated track via the mobile platform include peak data and average data.
3. The simulation testing system according to claim 1, characterized in that: The simulated track includes at least one or more combinations of straight tracks, curves, undulating tracks, or spiral tracks.
4. The analog test system of claim 1, wherein, The simulated track is also configured to: The design accuracy of the simulated track is no less than the positioning accuracy of the smart wearable device; wherein, the design accuracy refers to the accuracy with which the simulated track causes the mobile platform to translate, and the positioning accuracy refers to the translation accuracy of the smart wearable device.
5. The simulation testing system according to claim 1, characterized in that: The smart wearable device includes a first wireless communication module; The smart wearable device communicates with the test host via the first wireless communication module.
6. The analog test system of claim 1, wherein, The mobile cargo platform includes: a six-degree-of-freedom simulation turntable and a track trolley; The six-degree-of-freedom simulation turntable is provided with a loading surface, which is configured to place the smart wearable device. The six-degree-of-freedom simulation turntable and the track trolley are fixedly connected; The track trolley is movably connected to the simulated track.
7. The simulation testing system according to claim 6, characterized in that: The mobile connection is a scrolling connection; The track trolley is equipped with wheels at its bottom, and the simulated track includes double rails and connecting rods with a fixed spacing between the double rails; the wheels of the track trolley achieve rolling connection through friction with the connecting rods.
8. The simulation testing system according to claim 6, characterized in that: The track trolley includes a second wireless communication module; The track trolley is connected to the test host via the second wireless communication module.
9. The simulation testing system according to claim 6, characterized in that: The six-degree-of-freedom simulation turntable includes a six-axis steering platform, which, when rotated, simulates the first attitude change of the smart wearable device in six degrees of freedom. The six-axis steering platform includes a third wireless communication module; The six-axis steering platform is connected to the test host via the third wireless communication module.
10. The simulation testing system according to claim 1, characterized in that: The simulated track is equipped with a spatial position reference device. When the mobile cargo platform travels on the simulated track and passes the spatial position reference device, the generated spatial position reference data is used to associate with the current spatial data of the smart wearable device. By analyzing the degree of deviation between the spatial data and the spatial position reference data, the spatial position accuracy is determined.
11. The simulation testing system according to claim 10, characterized in that: The spatial position reference device includes a sensing magnetic sheet.
12. A simulation test method applied to the simulation test system of any one of claims 1-11, characterized in that, A smart wearable device is placed on a mobile platform, and the mobile platform is movably connected to a simulated track. The smart wearable device is configured to generate a first operation command when a preset action is performed. The simulated track is configured to allow the smart wearable device to achieve a first spatial change. The mobile platform is configured to allow the smart wearable device, placed on the mobile platform, to achieve a first attitude change with three degrees of freedom. The method includes: The test host receives test instructions to enable the mobile platform to drive the smart wearable device to perform preset actions along the simulated track based on the test instructions. The test host is communicatively connected to both the mobile platform and the smart wearable device.
13. The analog test method of claim 12, wherein, The method further includes: The system receives first spatial data and first posture data of the smart wearable device, wherein the first spatial data is spatial data when the smart wearable device is preset to be placed on the mobile platform, and the first posture data is three-degree-of-freedom posture data when the smart wearable device is preset to be placed on the mobile platform. Receive at least one second spatial data and at least one second posture data from the smart wearable device, wherein the second spatial data is spatial data of the smart wearable device when it performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when it performs a preset action based on the test command; Based on the first spatial data, the second spatial data, the first posture data, and the second posture data, the spatial and posture changes of the smart wearable device when performing the preset action are determined.
14. The analog test method of claim 12, wherein, The method further includes: The system receives the number of preset actions performed and the number of times the first operation command is generated by the smart wearable device, and determines the first operation success rate of the smart wearable device.
15. The analog test method of claim 12, wherein, The method further includes: The processor data and memory data received by the smart wearable device during the preset action process along the simulated track via the mobile platform include peak data and average data.
16. The analog test method of claim 12, wherein, The mobile cargo platform includes: a three-degree-of-freedom simulation turntable and a track trolley; the method further includes: The test host controls the movement speed of the track trolley.
17. An analog test apparatus, characterized by A smart wearable device is placed on a mobile platform, and the mobile platform is movably connected to a simulated track. The smart wearable device is configured to generate a first operation command when a preset action is performed. The simulated track is configured to allow the smart wearable device to achieve a first spatial change. The mobile platform is configured to allow the smart wearable device, placed on the mobile platform, to achieve a first attitude change with three degrees of freedom. The device includes: The first receiving unit is used to receive test instructions from the test host, so that the mobile platform can drive the smart wearable device to perform a preset action along the simulated track based on the test instructions. The test host is communicatively connected to the mobile platform and the smart wearable device. The test host is further configured to: receive first spatial data and first posture data of the smart wearable device, wherein the first spatial data is spatial data when the smart wearable device is preset to be placed on the mobile platform, and the first posture data is three-degree-of-freedom posture data of the smart wearable device when preset to be placed on the mobile platform; receive at least one second spatial data and at least one second posture data of the smart wearable device, wherein the second spatial data is spatial data when the smart wearable device performs a preset action based on the test command, and the second posture data is three-degree-of-freedom posture data of the smart wearable device when performing the preset action based on the test command; determine the spatial and posture changes of the smart wearable device when performing the preset action based on the first spatial data, the second spatial data, the first posture data, and the second posture data; and receive the number of times the smart wearable device performs the preset action and the number of times the first operation command is generated, and determine the first operation success rate of the smart wearable device.
18. An electronic device, characterized in that, The device includes a processor and a memory, the memory storing instructions, which, when executed by the processor, cause the device to perform the method of any one of claims 12-16.
19. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a computer, cause the computer to perform the method as described in any one of claims 12-16.