Terminal drop test methods, systems and related devices

Abstract

This application provides a terminal drop test method, system, and related apparatus, relating to the field of terminals. The method includes: a clamping device controlling the terminal to drop. The terminal starts a drop timer and calculates the drop height based on the drop duration. When the terminal drops to a target height corresponding to a target position, the terminal controls a camera to take pictures. When the camera's shooting time reaches t1, the camera stops shooting and sends multiple images, including those of the terminal, to an analysis device. The analysis device can determine the landing frame image from the multiple images and determine the terminal's landing posture angle based on the landing frame image. When the error between the terminal's landing posture angle and the standard posture angle is less than or equal to a first predetermined value, the analysis device can control a warning light to output a first indication (e.g., a green light); otherwise, it controls the warning light to output a second indication (e.g., a red light).

Description

Technical Field

[0001] This application relates to the field of terminals, and in particular to a method, system and related apparatus for terminal drop testing. Background Technology

[0002] With the development of terminal technology, users are using terminal devices to handle various tasks and projects more and more frequently. During daily use, terminal devices are frequently dropped for various reasons. Therefore, the reliability and durability of terminal devices have received increasing public attention and have become a prominent selling point for many terminal device manufacturers. Incorporating the accidental drop resistance of terminal devices into regulations has become a global trend. Terminal device manufacturers often use drop tests to verify the accidental drop resistance performance of their devices. Therefore, how to improve the accuracy of drop test results has become an urgent problem to be solved. Summary of the Invention

[0003] This application provides a terminal drop test method, system, and related apparatus, which enables real-time and accurate monitoring of whether the landing posture angle of the terminal device meets the preset standard at the moment of falling onto the plane, and provides early warning for abnormal drop situations, thereby obtaining a more accurate accidental drop performance report, improving the reliability, standardization, and accuracy of controlled drop testing, and providing more precise assistance for the analysis of problematic terminal devices.

[0004] In a first aspect, this application provides a terminal drop test method applied to a drop test system. The drop test system includes: a first electronic device, a camera, a drop platform, a clamping device, a warning light, and a second electronic device. The camera and the second electronic device establish a communication connection. The clamping device controls the first electronic device to drop onto the drop platform. When the first electronic device falls to the target position, the first electronic device controls the camera to start capturing images. When the camera's capturing time reaches a first capturing time, the camera stops capturing images and sends multiple captured first images, including those of the first electronic device, to the second electronic device. The second electronic device determines one or M landing frame images from the multiple first images. The landing frame images include the posture of the first electronic device at the instant it falls onto the drop platform. Based on the one or M landing frame images, the second electronic device determines the landing posture angle of the first electronic device. When the error between the determined landing posture angle of the first electronic device and a preset standard posture angle is less than or equal to a first predetermined value, the second electronic device controls the warning light to output first indication information. This enables real-time and precise monitoring of whether the landing posture angle of the terminal device meets the preset standard at the moment of impact with the plane, and provides early warning for abnormal drop situations, thereby obtaining a more accurate report on the performance of accidental drop protection. This improves the reliability, standardization and accuracy of controlled drop testing, and provides more precise assistance for the analysis of problematic terminal devices.

[0005] In one possible implementation, the first electronic device and the second electronic device establish a wireless communication connection. When the first electronic device falls to the target location, it controls the camera to start recording. Specifically, this includes: when the first electronic device falls to the target location, it sends a camera activation instruction to the second electronic device. In response to the camera activation instruction, the second electronic device sends a recording activation command to the camera. In response to the recording activation command, the camera begins recording. This allows for automated control of the camera for recording, making operation convenient.

[0006] In one possible implementation, the first electronic device and the camera establish a wireless communication connection. When the first electronic device falls to the target location, it controls the camera to start taking pictures. Specifically, when the first electronic device falls to the target location, it sends a shooting start command to the camera. In response to the shooting start command, the camera begins to take pictures. This allows for automated control of the camera for shooting, making operation convenient.

[0007] In one possible implementation, when the first electronic device falls to the target location, it sends a camera activation instruction to the second electronic device. Specifically, this includes: when the first electronic device detects displacement along the direction of gravity via a gravity sensor, it starts a fall duration timer. Based on the fall duration, the first electronic device calculates its fall height. When the fall height is greater than or equal to the target height corresponding to the target location, the first electronic device sends a camera activation instruction to the second electronic device. This allows the first electronic device to more precisely control the timing of the camera's capture.

[0008] In one possible implementation, when the camera's shooting time reaches a first shooting duration, the camera stops shooting and sends multiple captured first images, including those of the first electronic device, to the second electronic device. Specifically, when the shooting start command is sent, the second electronic device times the camera's shooting duration. When the shooting duration reaches the first shooting duration, the second electronic device sends a shooting end command to the camera. In response to the shooting end command, the camera stops shooting and sends multiple captured first images, including those of the first electronic device, to the second electronic device. This allows for automated control of the camera's shooting, making operation convenient.

[0009] In one possible implementation, the second electronic device determines the landing attitude angle of the first electronic device based on one or M landing frame images. Specifically, this includes: when the second electronic device determines, and only determines, a second image as a landing frame image from the plurality of first images, the second electronic device determines the landing attitude angle corresponding to the second image as the landing attitude angle of the first electronic device. When the second electronic device determines M landing frame images from the plurality of first images, the second electronic device determines the landing attitude angle corresponding to each of the M landing frame images. The M landing frame images correspond to M landing attitude angles. The second electronic device determines the average or median value of the M landing attitude angles as the landing attitude angle of the first electronic device. In this way, the landing attitude angle of the first electronic device can be automatically calculated, which is convenient to operate and has high accuracy.

[0010] In one possible implementation, the communication system includes a calibration board. The second electronic device determines the landing attitude angle corresponding to the second image as the landing attitude angle of the first electronic device, specifically including: the second electronic device determining the internal parameters of the camera based on the calibration board. The internal parameters of the camera are related to the camera's inherent characteristics. The second electronic device determines a first pose of the calibration board relative to the camera based on the second image. The second electronic device determines a second pose of the first electronic device relative to the camera based on the second image. The second electronic device determines the landing attitude angle corresponding to the second image based on the first and second poses. The second electronic device determines the landing attitude angle corresponding to the second image as the landing attitude angle of the first electronic device. This allows for automated calculation of the landing attitude angle of the first electronic device, offering convenient operation and high accuracy.

[0011] In one possible implementation, the first pose includes a first rotation matrix, and the second pose includes a second rotation matrix. The second electronic device determines the landing posture angle corresponding to the second image based on the first pose and the second pose, specifically by: determining a transformation matrix based on the first rotation matrix and the second rotation matrix. The transformation matrix is ​​used for the conversion between the first rotation matrix and the second rotation matrix. The second electronic device determines the landing posture angle corresponding to the second image based on the transformation matrix.

[0012] In one possible implementation, the method further includes: when the error between the landing posture angle of the first electronic device and a preset standard posture angle is determined to be greater than a first predetermined value, the second electronic device controls the warning light to output a second indication message. This can indicate an abnormal fall and prompt the user whether the result of the fall test is accurate.

[0013] Secondly, this application provides a terminal drop test method applied to a first electronic device. The method includes: the first electronic device being dropped onto a drop platform. When the first electronic device detects displacement along the direction of gravity via a gravity sensor, the first electronic device starts a drop duration timer. Based on the drop duration, the first electronic device determines when it has reached a target position, and then controls a camera to begin recording. This allows for automated camera control and is convenient to operate.

[0014] In one possible implementation, the first electronic device controls the camera to start shooting, specifically by sending a camera start instruction to a second electronic device. This camera start instruction triggers the second electronic device to send a shooting start command to the camera, which in turn triggers the camera to start shooting. This allows for automated control of the camera for shooting, making operation convenient.

[0015] In one possible implementation, the first electronic device controls the camera to start shooting, specifically by sending a shooting start command to the camera. This shooting start command triggers the camera to begin shooting. This allows for automated control of the camera for shooting, making operation convenient.

[0016] In one possible implementation, the method further includes: the first electronic device timing the camera's shooting duration. When the shooting duration reaches a first shooting duration, the first electronic device sends a shooting end command to the camera. This shooting end command controls the camera to stop shooting and sends multiple captured images, including the first electronic device image, to a second electronic device. This allows for automated control of the camera's shooting process, making operation convenient.

[0017] Thirdly, this application provides a terminal drop test method applied to a second electronic device. The method includes: the second electronic device receiving multiple first images, including those of a first electronic device, sent by a camera. The second electronic device determines one or M landing frame images from the multiple first images. The landing frame image includes the posture of the first electronic device at the instant it falls onto the drop platform. Based on the one or M landing frame images, the second electronic device determines the landing posture angle of the first electronic device. When the error between the determined landing posture angle of the first electronic device and a preset standard posture angle is less than or equal to a first predetermined value, the second electronic device controls a warning light to output first indication information. This allows for automated calculation of the landing posture angle of the first electronic device, is convenient to operate, and yields highly accurate results.

[0018] In one possible implementation, the second electronic device determines the landing attitude angle of the first electronic device based on one or M landing frame images. Specifically, this includes: when the second electronic device determines, and only determines, a second image as a landing frame image from the plurality of first images, the second electronic device determines the landing attitude angle corresponding to the second image as the landing attitude angle of the first electronic device. When the second electronic device determines M landing frame images from the plurality of first images, the second electronic device determines the landing attitude angle corresponding to each of the M landing frame images. The M landing frame images correspond to M landing attitude angles. The second electronic device determines the average or median value of the M landing attitude angles as the landing attitude angle of the first electronic device. In this way, the landing attitude angle of the first electronic device can be automatically calculated, which is convenient to operate and has high accuracy.

[0019] In one possible implementation, the second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device. Specifically, this includes: the second electronic device determining the internal parameters of the camera based on a calibration board. The internal parameters of the camera are related to the camera's inherent characteristics. The second electronic device determines a first pose of the calibration board relative to the camera based on the second image. The second electronic device determines a second pose of the first electronic device relative to the camera based on the second image. The second electronic device determines the landing posture angle corresponding to the second image based on the first and second poses. The second electronic device then determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device. This allows for automated calculation of the landing posture angle of the first electronic device, offering convenient operation and high accuracy.

[0020] Fourthly, this application provides an electronic device comprising one or more processors and a memory. The memory is coupled to the one or more processors and stores computer program code including computer instructions. The one or more processors invoke the computer instructions to cause the electronic device to perform a method as described in any of the possible implementations of any of the above aspects. This enables real-time and accurate monitoring of whether the landing attitude angle of a terminal device conforms to a preset standard at the instant it falls onto a plane, and provides early warnings for abnormal drop situations, thereby obtaining a more accurate report on its accidental drop resistance performance. This improves the reliability, standardization, and accuracy of controlled drop testing, and provides more precise assistance for the analysis of problematic terminal devices.

[0021] Fifthly, this application provides a chip system applied to an electronic device. The chip system includes one or more processors that invoke computer instructions to cause the electronic device to execute methods as described in any of the possible implementations of any of the aforementioned aspects. This enables real-time and accurate monitoring of whether the landing attitude angle of a terminal device conforms to a preset standard at the instant it falls onto a plane, and provides early warnings for abnormal drop situations. This results in a more accurate report on its accidental drop resistance performance, improving the reliability, standardization, and accuracy of controlled drop testing, and providing more precise assistance for the analysis of problematic terminal devices.

[0022] Sixthly, this application provides a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any of the possible implementations of any of the above aspects. This enables real-time and accurate monitoring of whether the landing attitude angle of a terminal device at the instant it falls onto a plane meets a preset standard, and provides early warnings for abnormal drop situations, thereby obtaining a more accurate report on its accidental drop resistance performance. This improves the reliability, standardization, and accuracy of controlled drop testing, and provides more precise assistance for the analysis of problematic terminal devices.

[0023] Seventhly, this application provides a computer program product, including a computer program that, when executed by a processor, causes the electronic device to perform the method as described in any of the possible implementations of any of the above aspects. This enables real-time and precise monitoring of whether the landing posture angle of the terminal device at the instant it falls onto a plane meets a preset standard, and provides early warnings for abnormal drop situations, thereby obtaining a more accurate report on its accidental drop resistance performance. This improves the reliability, standardization, and accuracy of controlled drop testing, and provides more precise assistance for the analysis of problematic terminal devices. Attached Figure Description

[0024] Figure 1A An angle diagram drawn manually using an angle measurement tool with a high-speed camera, as provided in this application embodiment;

[0025] Figure 1B A schematic diagram of the setup architecture of a drop test system 10 provided in an embodiment of this application;

[0026] Figure 1C A schematic diagram of a terminal 100 with an identification block affixed, provided in an embodiment of this application;

[0027] Figure 1D A schematic diagram illustrating the placement of a camera 300 according to an embodiment of this application;

[0028] Figure 1EA schematic diagram of the setup architecture of another drop test system 10 provided in an embodiment of this application;

[0029] Figures 2A-2C A schematic diagram of the hardware and software structure of a drop test system 10 provided in an embodiment of this application;

[0030] Figure 3 A schematic diagram illustrating the execution logic of a terminal drop test method provided in an embodiment of this application;

[0031] Figure 4A This application provides a schematic diagram of a drop detection and image capture process for a terminal 100 according to an embodiment of the present application.

[0032] Figure 4B A schematic diagram illustrating a drop detection and image capture scenario for a terminal 100 provided in an embodiment of this application;

[0033] Figure 5A A schematic diagram illustrating the process of image analysis performed by an analysis device 400 according to an embodiment of this application;

[0034] Figure 5B This application provides a schematic diagram illustrating a specific process for determining a landing frame image in an embodiment of the present application.

[0035] Figure 5C A schematic diagram of a binary image display terminal 100 provided in an embodiment of this application;

[0036] Figures 5D-5E A set of specific example diagrams illustrating the determination of landing frame images provided in the embodiments of this application;

[0037] Figure 5F A schematic diagram of the landing posture angle of a computing terminal 100 provided in an embodiment of this application;

[0038] Figure 5G A schematic diagram of Euler angles provided for an embodiment of this application;

[0039] Figure 5H A schematic diagram of a reference coordinate system and an object coordinate system provided for embodiments of this application;

[0040] Figure 5I A flowchart illustrating the process of determining the landing posture angle of terminal 100, as provided in an embodiment of this application;

[0041] Figure 5J This application provides a schematic diagram comparing two coordinate systems with different coordinate axis directions.

[0042] Figure 5K A flowchart illustrating the process of determining the error between a landing attitude angle and a standard attitude angle, provided for an embodiment of this application;

[0043] Figure 6 A schematic diagram of the hardware structure of a terminal 100 provided in an embodiment of this application;

[0044] Figure 7 A schematic diagram of the hardware structure of an analysis device 400 provided in an embodiment of this application;

[0045] Figure 8 This is a schematic diagram of the hardware structure of a clamping device 202 provided in an embodiment of this application. Detailed Implementation

[0046] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0047] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0048] In some applications, terminal drop testing (also known as controlled drop testing) is a testing method that simulates the drop scenarios that terminal devices may encounter in common situations such as daily use or transportation. It is mainly used to evaluate the durability and reliability of terminal devices after accidental drops. Terminal drop testing can verify the terminal device's resistance to accidental drops, for example: 1. Mechanical performance: testing the integrity of the terminal device's casing and structure after a drop impact, such as whether the screen shatters. 2. Electrical performance: assessing whether the terminal device's circuitry and electrical components, such as the battery, still function normally after a drop. 3. Shock resistance: evaluating the terminal device's ability to withstand impacts through drop tests at different heights and with different numbers of drops. 4. Durability: especially the performance of vulnerable components such as the casing and screen after multiple drops. 5. Reliability: assessing the long-term reliability and stability of the terminal device by simulating drop scenarios during actual use.

[0049] The "controlled" aspect of "controlled drop testing" refers to the precise control of drop conditions during the test to ensure the accuracy and repeatability of the results. There are two main reasons for conducting controlled drop tests on terminal devices: 1. Standardized test conditions: By controlling parameters such as drop height, landing angle, number of drops, and drop speed, each test is conducted under identical conditions, resulting in comparable results. 2. Data recording and analysis: In controlled drop testing, analysis equipment can record various data during the test, such as drop height and impact force. By comparing this data with the dynamic simulation results from the R&D side, it can be determined whether the terminal device meets the structural design requirements, facilitating subsequent data analysis and performance improvements.

[0050] In some embodiments, since controlled drop tests are typically conducted and analyzed manually, standardized test conditions are often not guaranteed, resulting in large errors in the final accidental drop performance report (also known as a drop test report) and inaccurate analysis results.

[0051] For example, in controlled drop tests on terminal devices, two testers are often involved: one performs the test procedures, and the other uses a high-speed camera to photograph the terminal device during the drop. The tester can then manually select the image of the terminal device at the moment of impact (which can be called the impact frame image) from the multiple photographs taken, and... Figure 1A As shown, angles are manually drawn using a high-speed camera angle measurement tool to determine whether the error between the actual drop posture and the theoretical landing posture is less than the specified value, thereby judging whether the obtained accidental drop protection performance report is reliable.

[0052] As can be seen from the above description, the data measured manually has low accuracy and contains errors, and the testing method has loopholes (the 2D angle of the terminal device when it falls is not equal to the 3D angle of the terminal device when it falls in three-dimensional space), resulting in a considerable error in the accidental drop performance report.

[0053] Therefore, this application provides a terminal drop test method that enables real-time and accurate monitoring of whether the landing posture angle of the terminal device when it falls onto a plane (hereinafter referred to as the drop platform 200) meets the preset standard, and provides early warning for abnormal drop situations, thereby obtaining a more accurate anti-accidental drop performance report, improving the reliability, standardization and accuracy of controlled drop testing, and providing more accurate assistance for the analysis of problematic terminal devices.

[0054] Figure 1B This is a schematic diagram of the setup architecture of a drop test system 10 provided in an embodiment of this application.

[0055] like Figure 1B As shown, the drop test system 10 can be placed in a glass enclosure with a safety door. Figure 1B (Not shown). The drop test system 10 may include: a terminal device 100 (which may be simply referred to as terminal 100, the first electronic device), a drop platform 200, a calibration plate 201, a clamping device 202 (including clamps 202A and support rods 202B), a camera 300 (i.e., a high-speed camera), an analysis device 400 (which may be referred to as the second electronic device), a warning light 500, and an industrial control device 600. Among them:

[0056] Terminal device 100 is the device under test in a controlled drop test; that is, the drop test system 10 performs a controlled drop test on terminal device 100 to obtain its performance against accidental drops. Identification blocks (also called marker blocks) may be affixed to terminal device 100. Figure 1C As shown, a label block can be affixed to the display screen and the back cover of the terminal device 100, namely label block 101A affixed to the display screen and label block 102A affixed to the back cover. This label block can be used by the analysis device 400 to determine the landing attitude angle of the terminal device 100. Generally, a larger label block is more beneficial for the camera 300's recognition. Due to the size limitations of the terminal device 100 and to keep the label blocks on the same plane to improve the data accuracy of the drop test, the size of the label block can preferably be 7cm*6cm.

[0057] The drop platform 200 can be used for the drop of the terminal device 100, that is, during the test, the terminal device 100 needs to be dropped onto the drop platform 200. In this embodiment, the landing posture angle of the terminal device 100 is also the posture angle of the terminal device 100 at the instant it falls onto the drop platform 200.

[0058] The calibration plate 201 can be affixed within the field of view of the camera 300. For example... Figure 1B As shown, the calibration plate 201 can be perpendicular to the drop platform 200 and close to the support rod 202B. This calibration plate 201 can be used to determine the landing attitude angle of the terminal device 100. The size of the calibration plate 201 can be determined according to the field of view of the camera 300; preferably, it is 25cm x 35cm for easy recognition by the camera 300.

[0059] The clamping device 202 may include a clamp 202A and a support rod 202B. The clamp 202A may be mounted on the support rod 202B and opposite to the drop platform 200. The support rod 202B may be close to the side of the drop platform 200. The clamp 202A can be used to clamp the terminal 100 and control the terminal 100 to drop. Figure 1BAs shown, the clip 202A can be set at the top of the support rod 202B, and optionally, the clip 202A can slide on the support rod 202B.

[0060] Camera 300 can be a high-speed camera used to capture images of terminal device 100 during the fall. In some possible implementations, such as... Figure 1B As shown, the entire controlled drop test can be performed using only one camera 300 (i.e., only a single high-speed camera). In this case, the camera 300 cannot be directly facing the drop platform 200; it needs to be offset relative to the drop platform 200, such as... Figure 1D As shown, the normal vector of the plane where the display screen of the camera 300 is located and the vector perpendicular to the normal vector of the drop platform 200 cannot be perpendicular or parallel. They should have an angle greater than 0 and less than 90. This ensures that the camera 300 can capture the marker block of the terminal 100 on each plane during the controlled drop test.

[0061] The analysis device 400 can be connected to the industrial control device 600, the camera 300, and the warning light 500 respectively. The analysis device 400 can receive multiple images, including those of the terminal 100, captured by the camera 300, and analyze the images to determine whether the error between the landing attitude angle and the standard attitude angle of the terminal device 100 is less than or equal to a first predetermined value.

[0062] The analysis device 400 can also control the warning light 500 to output different indication information (such as lighting up different colored lights) to indicate whether the current drop test of the terminal device 100 is an abnormal drop.

[0063] When the error between the landing attitude angle of the terminal device 100 and the standard attitude angle is less than or equal to a first predetermined value, the analysis device 400 controls the warning light 500 to output a first indication (e.g., a green light), indicating that the current terminal device 100 has experienced a normal fall. When the error between the landing attitude angle of the terminal device 100 and the standard attitude angle is greater than the first predetermined value, the analysis device 400 controls the warning light 500 to output a second indication (e.g., a red light), indicating that the current terminal device 100 has experienced an abnormal fall. Unlike the above example, the output of the first indication can also be a single flash, and the output of the second indication can also be a double flash. That is to say, the specific forms of the first and second indications are not limited in this application.

[0064] The industrial control device 600 can be connected to the clamping device 202 to trigger the clamping device 202 to control the terminal 100 to drop via the clamp 202A. Optionally, the industrial control device 600 can also be connected to the analysis device 400 so that when the terminal 100 cannot trigger the analysis device 400 to control the camera 300 to take pictures via Bluetooth signal, the industrial control device 600 can receive user input to trigger the analysis device 400 to control the camera 300 to take pictures.

[0065] In one possible implementation, the safety door of the glass enclosure housing the drop test system 10 can confine the various devices within the drop test system 10 to a specific area. When the controlled drop test is initiated, the safety door can be closed to ensure that the devices are not disturbed by external factors during the test, thereby improving the accuracy of the test.

[0066] It should be noted that, Figure 1B This is for illustrative purposes only and does not constitute any limitation on this application.

[0067] In some embodiments, the drop test system 10 may use multiple high-speed cameras to capture images of the terminal 100 during the drop process. For example... Figure 1E As shown, the drop test system 10 may include camera 300 and camera 301, which can be connected to the analysis device 400. Camera 301 can be positioned facing the front of the drop platform 200, meaning the normal vector of the plane where the camera 301's display screen is located is parallel to the normal vector perpendicular to the normal vector of the drop platform 200. Camera 300 can be positioned facing the side of the drop platform 200, meaning the normal vector of the plane where the camera 301's display screen is located is perpendicular to the normal vector perpendicular to the normal vector of the drop platform 200. When the terminal 100 is in the process of being dropped, cameras 301 and 300 can jointly capture multiple images of the terminal 100 and send these multiple images to the analysis device 400 so that the analysis device 400 can analyze the landing posture angle of the terminal 100 based on the multiple images.

[0068] Figures 2A-2C This is a schematic diagram of the hardware and software structure of a drop test system 10 provided in an embodiment of this application.

[0069] like Figure 2AAs shown, in this drop test system 10, the terminal 100 can be pre-configured with: drop detection software, a gravity sensor (i.e., a G-Sensor), and a Bluetooth module (also known as a Bluetooth communication module). The drop detection software can set the target drop height (which can be simply referred to as the target height) corresponding to the target position. The target drop height is: the distance from the initial drop position to the drop platform 200 (i.e., the total drop height of the terminal 100) - the distance from the target position to the drop platform 200.

[0070] The analysis device 400 can be pre-configured with a test report database and a data analysis backend, which may include image analysis software. The data analysis backend can store standard attitude angles set by the user with reference to the product specifications.

[0071] First, the clamp 202A in the clamping device 202 ( Figure 2A (Not shown in the image) Terminal 100 can be clamped to the initial drop position, and then controlled to begin the drop. If the drop test mode is set to free fall, the initial velocity of terminal 100 is V0 = 0, the drop speed is gt, and the acceleration is the gravitational acceleration g; if the drop test mode is constant speed drop, the initial velocity of terminal 100 is V0 = V t V t It can be preset to a fixed value, and the clip 202A can hold the terminal 100 at V. t The device will be dropped. When the terminal 100 falls to the target location, the terminal 100 can control the camera 300 to start taking pictures.

[0072] like Figure 2B As shown, the drop detection software is carried by terminal 100, and the relevant modules are a G-Sensor and a Bluetooth module. The drop detection software can store the target drop height corresponding to the target location. When terminal 100 detects that it has fallen to the target location through the drop detection software, terminal 100 can control camera 300 to take pictures via Bluetooth module.

[0073] like Figure 2CAs shown, the image analysis software is carried by the analysis device 400, and the related modules are the camera 300, the test report database, and the warning light. The image analysis software can receive and store the standard attitude angle set by the user with reference to the product specifications. The image analysis software can receive multiple images, including those of the terminal 100, sent by the camera 300, and determine the landing attitude angle of the terminal 100 based on these images, judging whether the error between the landing attitude angle and the standard attitude angle is less than or equal to a first predetermined value. The image analysis software generates a drop test report (including the landing attitude angle of the terminal 100, and / or landing frame images, etc.) based on the multiple images and sends the drop test report to the test report database for storage. Furthermore, the image analysis software can also trigger the analysis device 400 to control the warning light 500 to output different indication information (e.g., lighting up different colored lights). The landing attitude angle can be calculated based on the reference coordinate system established by the calibration plate 201 and the object coordinate system established by the marker block; the specific implementation will be described in detail in subsequent embodiments.

[0074] It should be noted that, Figures 2A-2C This is merely an illustrative explanation of the present application and does not constitute a limitation thereof.

[0075] Figure 3 This is a schematic diagram illustrating the execution logic of a terminal drop test method provided in an embodiment of this application.

[0076] like Figure 3 As shown, the execution logic of this terminal drop test method may include:

[0077] S301. The analysis device 400, terminal 100 and industrial control device 600 receive one or more standard parameters set by the user (e.g., target drop height, standard attitude angle, drop test mode, etc.).

[0078] Specifically, before the terminal 100 begins its drop, the analysis device 400 can receive one or more standard parameters set by the user (e.g., standard attitude angle, attitude error judgment algorithm, and first specified value). The terminal 100 can receive one or more standard parameters set by the user (e.g., target height value, drop height calculation algorithm, drop height judgment conditions, etc.). The industrial control device 600 can receive one or more standard parameters set by the user (e.g., drop test mode, etc.). Detailed descriptions will be provided in subsequent embodiments and will not be repeated here.

[0079] It is understandable that one or more of the above standard parameters can be changed in different terminal drop test items. That is to say, the standard parameters are not static and can be flexibly adjusted according to the terminal drop test items.

[0080] In one possible implementation, the analysis device 400 may receive in advance the parameter information of the terminal 100, such as the product model and / or serial number (SN) of the terminal 100, input by the user, so that the analysis device 400 can generate a corresponding drop test report in the future.

[0081] Phase 1: Drop detection and image capture of Terminal 100:

[0082] S302. When a drop test start input is received, the industrial control device 600 sends a drop test start command (including drop test mode) to the clamping device 202. In response to the drop test start command, the clamping device 202 controls the terminal 100 to start the drop.

[0083] Specifically, the analysis device 400 starts and runs the data analysis backend and test report database, the terminal 100 starts and runs the drop detection software, G-Sensor, and Bluetooth module, and the terminal 100 and the analysis device 400 establish a wireless communication connection through the Bluetooth module. The camera 300 and the analysis device 400 establish a wired communication connection, and the analysis device 400 and the warning light 500 establish a wired communication connection. After the clamping device 202 clamps the terminal 100 through the clamp 202A, the industrial control device 600 can receive the drop test start input. In response to the drop test start input, the industrial control device 600 can send a drop test start command to the clamping device 202. The drop test start command can include a drop test mode, used to indicate to the clamping device 202 the drop type of the terminal 100, such as free fall or constant speed drop. In response to the drop test start command, the clamp 202A can clamp the terminal 100 to the initial drop position and control the terminal 100 to start the drop.

[0084] If the drop test mode is free fall, the initial velocity of terminal 100 is V0 = 0, the acceleration is the acceleration due to gravity g, and clamp 202A can release terminal 100 to allow it to fall freely; if the drop test mode is constant speed drop, the initial velocity of terminal 100 is V0 = V t V t It can be preset to a fixed value, and the clip 202A can hold the terminal 100 at V. t It falls.

[0085] S303. When the terminal 100 falls to the target position, the terminal 100 controls the camera 300 to start shooting.

[0086] Specifically, during the fall, terminal 100 can calculate its fall height using fall detection software. When the fall height is greater than or equal to the target height corresponding to the target location, terminal 100 has fallen to the target location. At this point, terminal 100 can send a camera activation instruction to analysis device 400 via Bluetooth module. In response to this instruction, analysis device 400 sends a shooting activation command to camera 300. In response to this activation command, camera 300 begins shooting. Since camera 300's field of view includes terminal 100, it can capture images including terminal 100 during the fall.

[0087] In one possible implementation, terminal 100 can establish a Bluetooth connection with camera 300. When terminal 100 falls to the target location, it can send a shooting start command to camera 300 via the Bluetooth module. In response to the shooting start command, camera 300 begins shooting.

[0088] In one possible implementation, upon receiving a drop test start input, the industrial control device 600 can send a camera start instruction to the analysis device 400. In response to this camera start instruction, the analysis device 400 sends a shooting start command to the camera 300. In response to this shooting start command, the camera 300 begins shooting. That is, the camera 300 begins shooting when the terminal 100 is in the initial drop position.

[0089] Phase Two: Analysis device 400 analyzes multiple images, including those from terminal 100.

[0090] S304. When the shooting time of camera 300 reaches t1, camera 300 stops shooting and sends the captured images, including those of terminal 100, to analysis device 400.

[0091] Among them, t1 can be preset in the image analysis software in the analysis device 400, and its specific value can be determined according to the height of the target position from the drop platform 200 and the drop test mode.

[0092] Specifically, when the analysis device 400 sends a shooting start command to the camera 300, the analysis device 400 can start timing the shooting duration of the camera 300. When the shooting duration of the camera 300 reaches t1, the analysis device 400 can send a shooting end command to the camera 300 to control the camera 300 to stop shooting. The camera 300 sends multiple captured images, including those of the terminal 100, to the analysis device 400.

[0093] In one possible implementation, when terminal 100 sends a shooting start command to camera 300, terminal 100 can start timing the shooting duration of camera 300. When the shooting duration of camera 300 reaches t1, terminal 100 can send a shooting end command to camera 300 via Bluetooth module to control camera 300 to stop shooting. Camera 300 then sends multiple captured images, including those of terminal 100, to analysis device 400.

[0094] In one possible implementation, when terminal 100 sends a shooting start command to camera 300, terminal 100 can start timing the shooting duration of camera 300, and camera 300 can also start timing its own shooting duration. If, within a shooting duration t1, camera 300 receives a shooting end command sent by terminal 100 via Bluetooth module, camera 300 stops shooting and sends the captured images, including those of terminal 100, to analysis device 400; if the shooting duration is greater than or equal to t1, and camera 300 does not receive a shooting end command sent by terminal 100 via Bluetooth module, camera 300 stops shooting and sends the captured images, including those of terminal 100, to analysis device 400.

[0095] S305. The analysis device 400, based on multiple images, determines whether the error between the landing posture angle of the terminal 100 and the standard posture angle is less than or equal to a first specified value.

[0096] Among them, the landing posture angle of terminal 100 is the posture angle of terminal 100 at the moment it falls to the landing platform 200.

[0097] Preferably, the first specified value can be set to 5 degrees, 7 degrees, 10 degrees, etc., and this application does not limit it.

[0098] Specifically, the analysis device 400 can determine one or more landing frame images of the terminal 100 from multiple images. These landing frame images can include the posture of the terminal 100 at the moment it falls onto the drop platform 200. Then, based on one or more landing frame images, the analysis device 400 can determine the landing posture angle of the terminal 100 and calculate whether the error between the landing posture angle of the terminal 100 and the standard posture angle is less than or equal to a first predetermined value. Detailed explanations can be found in subsequent embodiments and will not be repeated here.

[0099] S306. When the error is less than or equal to the first specified value, the analysis device 400 generates a drop test report for the terminal 100.

[0100] S307. The analysis device 400 sends a first indication information output command to the warning light 500.

[0101] S308. In response to the first indication information output command, the warning light 500 outputs the first indication information (e.g., green light).

[0102] Specifically, when the error is less than or equal to the first specified value, it indicates that the drop test of the terminal 100 meets the specifications and is a normal drop. The drop test report is highly reliable. Therefore, the analysis device 400 can control the warning light 500 to output the first indication information to indicate that the drop test is a normal drop.

[0103] The first indication information output can be either a green light or a flashing light; this application does not impose any restrictions on this.

[0104] S309. When the error exceeds the first specified value, the analysis device 400 sends a second indication information output command to the warning light 500.

[0105] S310. In response to the second indication information output command, the warning light 500 outputs the second indication information (e.g., a red light).

[0106] Specifically, when the error exceeds the first specified value, it indicates that the drop test of the terminal 100 does not meet the standard and is an abnormal drop. Even if a drop test report is generated, its reliability is not high. Therefore, the analysis device 400 does not generate a drop test report at this time. Instead, the analysis device 400 can control the warning light 500 to output a second indication to indicate that the drop test is an abnormal drop.

[0107] The output of the second indication information can refer to turning on the red light or flashing twice; this application does not impose any restrictions on this.

[0108] Next, this application embodiment will provide a detailed description of each step in S301 and stage one:

[0109] Figure 4A This is a schematic diagram of a drop detection and image capture process for a terminal 100 provided in an embodiment of this application.

[0110] like Figure 4A As shown, the drop detection and image capture process of the terminal 100 may include:

[0111] S401. Terminal 100 receives the user-input drop height calculation algorithm.

[0112] Specifically, the drop height calculation algorithm is used to calculate the height that the terminal 100 falls over time.

[0113] 1. For example, when terminal 100 performs a random / directional free fall, the fall height calculation algorithm 1 can be:

[0114]

[0115] Where H is the drop height of terminal 100, g is the gravitational acceleration, and t is the drop duration of terminal 100.

[0116] 2. For example, when terminal 100 is in a constant-speed drop motion, the drop height calculation algorithm 2 can be:

[0117] H = V t ×t

[0118] Among them, V t The drop speed of terminal 100 is fixed, and t is the drop duration of terminal 100.

[0119] Not limited to the above examples, the drop height calculation algorithm can also be set with other formulas according to the characteristics of the test project, and this application does not impose any restrictions.

[0120] S402. Terminal 100 receives the user's input of the fall height judgment condition (including the fall height being greater than the target height).

[0121] Specifically, the drop height judgment condition can be used to determine whether the terminal 100 has fallen to the target position, that is, to determine whether the drop height of the terminal 100 has reached the target height H1 corresponding to the target position.

[0122] 1. For example, when terminal 100 is in a random / directional free fall motion, the fall height determination condition 1 can be:

[0123]

[0124] The relevant parameters of this formula can be found in the previous description and will not be repeated here.

[0125] 2. For example, when terminal 100 is in a constant-speed drop motion, the drop height determination condition 2 can be:

[0126] H = V t ×t≥H1

[0127] The relevant parameters of this formula can be found in the previous description and will not be repeated here.

[0128] In one possible implementation, the right side of the above-mentioned fall height determination condition can be H1±σ, where σ is a preset deviation value.

[0129] Not limited to the above examples, the drop height judgment condition can also be set with other formulas according to the characteristics of the test project, and this application does not impose any restrictions.

[0130] S403. Terminal 100 receives the target height value input by the user.

[0131] The target height can be used to determine whether the terminal 100 has fallen to the target position, thereby triggering the terminal 100 to control the camera 300 to take a picture. The specific value of the target height can be set according to the characteristics of the test item, such as 1 meter, 1.5 meters, etc., and this application does not limit it.

[0132] In one possible implementation, prior to the controlled drop test, the industrial control device 600 and / or the analysis device 400 may receive parameter information of the drop test item input by the user. The parameter information of the drop test item can be used to indicate the characteristics of the current drop test item. The parameter information may include one or more of the following: drop test mode, name of drop test item, product model of terminal 100 and SN code of terminal 100, etc. This application does not limit this.

[0133] It is understood that S401 to S403 above refer to one or more standard parameters input by the user received by the terminal 100. The drop height calculation algorithm, drop height judgment conditions, and target height values ​​can be set in the drop detection software.

[0134] Upon receiving the drop test start input, the industrial control device 600 triggers the clamping device 202 to clamp the terminal 100 to the initial drop position using the clamp 202A, and controls the terminal 100 to start dropping.

[0135] S404. When terminal 100 detects a change in acceleration on the X, Y, and Z axes (or detects displacement along the direction of gravity) through the G-Sensor, terminal 100 starts the fall duration timer.

[0136] Specifically, the terminal 100 detects changes in acceleration on the X, Y, and Z axes (or detects displacement along the direction of gravity) through the G-Sensor. In other words, the terminal 100 determines that it is now starting to fall. Therefore, the terminal 100 can start timing the fall duration through the fall detection software so that the terminal 100 can calculate the fall height.

[0137] S405. Terminal 100 substitutes the value of the fall duration into the fall height calculation algorithm to calculate the fall height of terminal 100.

[0138] The explanation of the fall height calculation algorithm can be found in the foregoing description, and will not be repeated here.

[0139] Specifically, terminal 100 can calculate its drop height using drop detection software based on a drop height calculation algorithm. It is understandable that the drop duration of terminal 100 is constantly changing during the drop process; therefore, the drop height of terminal 100 also changes in real time.

[0140] S406. Terminal 100 determines whether the drop height of Terminal 100 is greater than or equal to the target height based on the drop judgment condition.

[0141] The description of the target drop height can be found in the preceding description and will not be repeated here.

[0142] Specifically, the terminal 100 can use drop detection software to determine whether the drop height of the terminal 100 is greater than or equal to the target height using the aforementioned drop height judgment conditions.

[0143] S407. When the drop height is greater than or equal to the target height, the terminal 100 controls the camera 300 to capture multiple images.

[0144] In one possible implementation, terminal 100 can establish a wireless communication connection with analysis device 400 via a Bluetooth module (hereinafter referred to as Bluetooth), while terminal 100 does not establish a wireless communication connection with camera 300 via Bluetooth. When terminal 100 falls to the target location, terminal 100 sends a camera activation instruction to analysis device 400 via Bluetooth. Analysis device 400 receives and responds to the camera activation instruction, sending a shooting start command to camera 300. The camera activation instruction can be a Bluetooth signal with a value of "10011001", but is not limited to this; it can also be other Bluetooth signal values, and this application does not impose any restrictions on this.

[0145] In one possible implementation, terminal 100 can establish a Bluetooth connection with camera 300. When terminal 100 falls to the target location, terminal 100 can send a shooting start command to camera 300 via Bluetooth module. In response to the shooting start command, camera 300 begins shooting. The shooting start command can be a Bluetooth signal with a value of "10011001", but is not limited to this; it can also be other Bluetooth signal values, and this application does not impose any restrictions on this.

[0146] In one possible implementation, when the drop height of terminal 100 is less than the target height, terminal 100 determines that it has not fallen to the target position, and terminal 100 can execute S405.

[0147] Figure 4B This is a schematic diagram of a drop detection and image capture scenario for a terminal 100 provided in an embodiment of this application.

[0148] like Figure 4B As shown, this application is implemented Figure 4AIn the illustrated process, terminal 100 begins its fall from its initial position onto drop platform 200. During this fall, terminal 100 can detect changes in acceleration along the X, Y, and Z axes (or detect displacement along the direction of gravity) using a G-sensor. During the fall, terminal 100 can time the fall using fall detection software. The software then calculates the fall height based on the fall duration and a fall height calculation algorithm. Furthermore, the software can determine whether the fall height is greater than or equal to the target height. When the fall height is greater than or equal to the target height, i.e., when terminal 100 reaches the target position, terminal 100 can control camera 300 to capture multiple images of itself.

[0149] It can be seen that implementation Figure 4A As shown in the process, this application can realize automatic shooting by camera 300, reduce human intervention, is easy to operate, and improve the accuracy of testing by reducing human error.

[0150] Next, we will explain each step in Phase Two in detail:

[0151] Figure 5A This is a schematic diagram illustrating the process of image analysis performed by an analysis device 400 according to an embodiment of this application.

[0152] like Figure 5A As shown, the image analysis process performed by the analysis device 400 may include:

[0153] S501. The analysis device 400 receives the attitude error judgment algorithm input by the user.

[0154] Specifically, the attitude error judgment algorithm can be used to determine whether the error between the landing attitude angle of the terminal 100 and the standard attitude angle is less than or equal to a first specified value.

[0155] For example, the attitude error judgment algorithm can be as follows:

[0156] A≤x1

[0157] Where A is the difference between the landing posture angle of terminal 100 at the instant it falls onto the drop platform 200 and the standard posture angle. x1 is a first specified value, preferably 5 degrees, 7 degrees, 10 degrees, etc., which is not limited in this application.

[0158] S502. The analysis device 400 receives the standard attitude angle and the first specified value input by the user.

[0159] Specifically, the attitude error judgment algorithm, standard attitude angle, and first specified value can be stored in the image analysis software of the analysis device 400.

[0160] It is understandable that the analysis device 400 in S501 to S502, i.e., the aforementioned S301, receives one or more standard parameters input by the user.

[0161] S503. When the shooting time of camera 300 reaches t1, the analysis device 400 receives N images, including those of terminal 100, sent by camera 300.

[0162] The value of t1 is related to the distance H2 between the target position and the drop platform 200 and the drop speed of the terminal 100.

[0163] For example, t1 = the time it takes for terminal 100 to fall from its initial position to the drop platform 200 - the time it takes for terminal 100 to fall from its initial position to the target position + α. Here, α is a preset deviation threshold. The reason for setting α is that, in the actual constant-speed drop process of terminal 100, its speed still needs to accelerate from 0 to a fixed speed V at the instant the drop begins. t Therefore, within the same drop duration, the actual drop height of terminal 100 is less than the theoretical drop height. For example, when terminal 100 calculates its target position based on the drop height calculation algorithm, it has not actually reached the target position yet. Therefore, α is set to ensure that camera 300 can capture the image of terminal 100 at the instant it falls onto drop platform 200. If α is not set, when the shooting time reaches t1, terminal 100 has not yet reached drop platform 200, and camera 300 will not be able to capture the image of terminal 100 at the instant it falls onto drop platform 200.

[0164] Specifically, when camera 300 starts recording, analysis device 400 can time the recording duration of camera 300. When the recording duration of camera 300 reaches t1, analysis device 400 sends a recording end command to camera 300. Camera 300 receives and responds to the recording end command, stops recording, and sends the N captured images, including those of terminal 100, to analysis device 400.

[0165] In one possible implementation, terminal 100 can time the shooting duration of camera 300. When the timed shooting duration reaches t1, terminal 100 can send a shooting end command to camera 300 via Bluetooth module. Camera 300 receives and responds to the shooting end command, stops shooting, and sends the N captured images, including those of terminal 100, to analysis device 400.

[0166] S504. The analysis device 400 uses image analysis software to determine one or M landing frame images from N images, including the terminal 100. The landing frame image includes the posture of the terminal 100 at the moment it falls onto the drop platform 200.

[0167] It is understood that in the embodiments of this application, the number of landing frame images M < the total number of images N.

[0168] Specifically, such as Figure 5B As shown, the steps by which the analysis device 400 determines one or M landing frame images include (it should be noted that the execution of each of the following steps is carried out by image analysis software):

[0169] A) Sample from N images at intervals of T, and select the image to be detected (which is an RGB image).

[0170] In some embodiments, to make image analysis fast and convenient, the analysis device 400 does not analyze every single image, but instead marks (i.e. samples) the images every T intervals out of N images. The marked images can be used to determine the landing attitude angle of the terminal 100, and are referred to as the images to be detected.

[0171] It is understandable that the image sent from camera 300 to analysis device 400 is an RGB image; therefore, the image to be detected at this time is an RGB image.

[0172] B) Identify the ROI region in the image to be detected that includes terminal 100.

[0173] Preferably, image analysis software can use the YOLOv5s model to determine the region of interest (ROI) in the image to be detected, including terminal 100. During training, the YOLOv5s model can perform Mosaic data augmentation and adaptively scale the input training image frames to preserve more complete original image information. This helps the YOLOv5s model learn to detect small-scale targets (such as terminal 100), thus enhancing the model's detection accuracy.

[0174] In addition to this, image analysis software can also determine the ROI region in the image to be detected through BMS model (a Boolean Mapbased Saliency model), LSM-YOLO model, etc., and this application does not limit this.

[0175] C) Convert the RGB format image to be detected into a grayscale image (called the grayscale image to be detected) and determine the contour 1 of terminal 100 in the grayscale image to be detected.

[0176] Specifically, image analysis software can determine the contour 1 of terminal 100 in the grayscale image to be detected using optical flow or inter-frame difference methods. Since the camera 300 captures images of terminal 100 during the drop process, terminal 100 is in motion in a series of captured images; therefore, terminal 100 can be considered a moving target. Optical flow and inter-frame difference methods can detect the contour of moving targets in images; therefore, image analysis software can determine the contour 1 of terminal 100 in the grayscale image to be detected using these methods.

[0177] D) Based on the ROI region in the image to be detected, perform post-processing on the grayscale image to be detected after step C) to determine the contour 2 of the terminal 100 in the grayscale image to be detected. Among them, the contour 2 of the terminal 100 is more accurate and complete than the contour 1 of the terminal 100.

[0178] Due to the influence of motion and light noise in non-terminal 100 regions (which can be called background regions) in the image, some pixels in the background region may be detected as the outline of terminal 100, or some pixels in the terminal 100 region may be missed. Therefore, the image analysis software needs to perform post-processing on the grayscale image after step C) based on the ROI region in the image to be detected. Pixels outside the ROI region that are detected as the outline of terminal 100 are filtered out, and the missed pixels in the terminal 100 region are marked as part of the outline of terminal 100, thereby determining the outline 2 of terminal 100 in the grayscale image to be detected. The outline 2 of terminal 100 is more accurate and complete than the outline 1 of terminal 100.

[0179] E). Convert the grayscale image to be detected into a binary image (also called the binary image to be detected), and mark the lowest point on the contour 2 of the terminal 100 in the binary image to be detected.

[0180] A binary image is a binary image composed of 0 and 1 values. Generally, areas composed of 0 values ​​are black, and areas composed of 1 values ​​are white. For example... Figure 5C As shown, in the binary image to be detected, the outline 2 of terminal 100 can be a white area composed of 1 values, and other areas can be black areas composed of 0 values. Alternatively, the outline 2 of terminal 100 can be a black area composed of 0 values, and other areas composed of 1 values ​​as white.

[0181] After the grayscale image to be detected is converted into a binary image to be detected, the image analysis software can detect the lowest point on the contour 2 of the terminal 100 in each binary image to be detected and mark the lowest point.

[0182] F). Determine one or M landing frame images based on the binary image to be detected.

[0183] Image analysis software can determine one or M landing frame images based on the binary image to be detected in the following two ways:

[0184] In this embodiment, the coordinates of the lowest point refer to the coordinates of the lowest point on the outline 2 of the terminal 100.

[0185] Method 1: First, add the first 10 frames of binary images to be detected to a queue (initialized to None, i.e., an empty queue). Then, starting from the 11th frame, read the binary images to be detected sequentially and add them to the end of the queue for analysis. When a new frame of binary images is added to the end of the queue, the binary images at the head of the queue need to be dequeued. The binary images at the end of the queue can be considered as the k-th frame. Each time the queue changes, compare the coordinates of the lowest point in the k-th frame with the coordinates of the lowest points in frames (k-1) to (k-9) to determine whether the coordinates of the lowest point in the k-th frame are the lowest in the entire queue.

[0186] If yes, it means that in the k-th frame, terminal 100 is still falling and has not yet fallen to the drop platform 200. Continue to add the (k+1)-th frame to the end of the queue and dequeue the (k-9)-th frame (at the head of the queue). If no, it means that in the k-th frame, terminal 100 is in a rebound state. Take any frame before the k-th frame (preferably the (k-2)-th or (k-3)-th frame for more accurate and stable results) or M frames (M<10) as the landing frame image.

[0187] For example, such as Figure 5D As shown, firstly, frames 1 through 10 are added to an empty queue in the binary image sequence to be detected. Then, it is determined whether the lowest point coordinate of frame 10 is the lowest in the entire queue. If yes, frame 11 is added to the end of the queue, and frame 1 is dequeued. It is then determined whether the lowest point coordinate of frame 11 is the lowest in the entire queue. If yes, frame 12 is added to the end of the queue, and frame 2 is dequeued; otherwise, it indicates that terminal 100 is in a bounce state in frame 11, and any frame before frame 11 (e.g., frame 9 or frame 8), or M frames (M < 10, e.g., frames 3 through 10) are taken as the landing frame image.

[0188] Method 2: In the sequence of binary images to be detected, the difference between the coordinates of the lowest point in adjacent images can be called the step size. Since the fall of terminal 100 is a falling motion with constant acceleration, the step size exhibits a certain regular change in time sequence (for example, the difference between multiple step sizes is less than a preset value A1). If the step size corresponding to a certain frame image changes abruptly (i.e., the difference between the step size corresponding to a certain frame image and the step size corresponding to the previous frame image is greater than the preset value A1), then terminal 100 is in a rebound state in that frame image. Any frame before that frame image (preferably the (k-2)th or (k-3)th frame, for more accurate and stable results) or M frames (M<10) are taken as the landing frame image.

[0189] It can be understood that the step size corresponding to a specified frame image is the difference between the lowest point coordinate of the specified frame image and the lowest point coordinate of the previous frame image. For example, the step size corresponding to the k-th frame image = the lowest point coordinate of the k-th frame image - the lowest point coordinate of the (k-1)-th frame image.

[0190] First, the first 10 frames of binary images to be detected can be added to a queue (initialized to None, i.e., an empty queue). Then, starting from the 11th frame, the binary images to be detected are read sequentially and added to the end of the queue for analysis. When a new frame of binary images to be detected is added to the end of the queue, the binary images to be detected at the head of the queue need to be dequeued. The binary images to be detected at the end of the queue can be considered as the k-th frame. Each time the queue changes, the difference between the step size corresponding to the k-th frame (i.e., the coordinates of the lowest point of the k-th frame - the coordinates of the lowest point of the (k-1)-th frame) and the step size corresponding to the (k-1)-th frame (i.e., the coordinates of the lowest point of the (k-1)-th frame - the coordinates of the lowest point of the (k-2)-th frame) is calculated. Whether this difference is greater than a preset value A1 is checked, i.e., whether the step size corresponding to the k-th frame has changed abruptly.

[0191] If no sudden change occurs, it means that terminal 100 is still falling in frame k and has not yet fallen to the drop platform 200. Continue to add frame k+1 to the end of the queue and dequeue frame k-9 (at the head of the queue). If a sudden change occurs, it means that terminal 100 is in a bounce state in frame k. Take any frame before frame k or M frames (M<10) as the landing frame image.

[0192] For example, such as Figure 5EAs shown, firstly, in the binary image sequence to be detected, frames 1 to 10 are added to an empty queue. Then, it is determined whether the difference between the step size corresponding to frame 10 and the step size corresponding to frame 9 is greater than a preset value A1, that is, whether the step size corresponding to frame 10 has a sudden change. If not, frame 11 is added to the end of the queue, and frame 1 is dequeued. It is then determined whether the difference between the step size corresponding to frame 11 and the step size corresponding to frame 10 is greater than a preset value A1, that is, whether the step size corresponding to frame 11 has a sudden change. If not, frame 12 is added to the end of the queue, and frame 2 is dequeued; if yes, it indicates that terminal 100 is in a bounce state in frame 11, and any frame before frame 11 (e.g., frame 9 or frame 8) or M frames (M<10) are taken as the landing frame image.

[0193] In some embodiments, the analysis device 400 may not sample the N images, but instead treat each of the N images as the image to be detected and perform the above-described operation. Figure 5B Steps B to F are shown.

[0194] In some embodiments, when determining the landing frame image, it is not necessary to detect in a queue of 10 frames. Instead, it can be detected in a queue of 11 frames or in a queue of 9 frames. This application does not impose any restrictions on this.

[0195] S505. The analysis device 400 determines the landing attitude angle of the terminal 100 based on one or M landing frame images using image analysis software.

[0196] It is understandable that each landing frame image includes the landing posture of the terminal 100. Therefore, the analysis device 400 can determine the landing posture angle of the terminal 100 corresponding to each landing frame image.

[0197] If the analysis device 400 acquires only a single landing frame image, the landing attitude angle of the terminal 100 corresponding to that landing frame image will be the landing attitude angle of the terminal 100 used for subsequent analysis. If the analysis device 400 acquires M landing frame images, it will determine the landing attitude angle corresponding to each landing frame image, and M landing attitude angles can be calculated from the M landing frame images. The analysis device 400 can calculate the average or median value of the above M landing attitude angles, and this average or median value will be the landing attitude angle of the terminal 100 used for subsequent analysis.

[0198] Figure 5F This is a schematic diagram illustrating the implementation logic for calculating the landing posture angle of terminal 100 in a single landing frame image, as provided in an embodiment of this application.

[0199] Specifically, in this application embodiment, calculating the landing posture angle of the terminal 100 corresponding to a certain landing frame image may include:

[0200] A) The analysis device 400 determines the internal parameters of the camera 300 based on the calibration board 201.

[0201] The internal parameters of the camera 300 are parameters related to the characteristics of the camera 300 itself. The internal parameters of the camera 300 are fixed and unchanging, including the focal length of the camera 300, the position of the image sensor center, the distortion coefficient, etc.

[0202] Specifically, before the controlled drop test begins, multiple feature points B1 can be calibrated on the calibration plate 201. The calibration plate 201 is pre-positioned on a plane with world coordinate system Zw = 0. The origin of the world coordinate system can be located at a fixed corner of the calibration plate 201, with the horizontal direction as the Xw axis and the Yw axis perpendicular to the Xw axis. By moving the calibration plate 201, the camera 300 can capture multiple images (referred to as calibration images) showing the calibration plate 201 in different poses. Then, the analysis device 400 can acquire these multiple calibration images. Based on the coordinates of the multiple feature points B1 in the world coordinate system and the coordinates of the multiple feature points B1 in the pixel coordinate system of the multiple calibration images, the analysis device 400 determines the internal parameters of the camera 300. The origin of the pixel coordinate system is located at the upper left corner of the image, with the horizontal direction as the Xp axis and the Yp axis perpendicular to the Xp axis.

[0203] B). The analysis device 400 determines the pose of the calibration board 201 relative to the camera 300 based on the landing frame image and the internal parameters of the camera 300 (referred to as the pose of the calibration board 201, or the external parameters of the camera 300 relative to the calibration board 201).

[0204] like Figure 5G As shown in the embodiments of this application, the landing attitude angles of the terminal 100 are represented by Euler angles. Euler angles may include: pitch angle (i.e., rotation angle in the X-axis direction) around the X-axis, yaw angle (i.e., rotation angle in the Y-axis direction) around the Y-axis, and roll angle (i.e., rotation angle in the Z-axis direction) around the Z-axis. The pitch angle in the landing attitude angles of the terminal 100 can be called the landing pitch angle, the yaw angle in the landing attitude angles of the terminal 100 can be called the landing yaw angle, and the roll angle in the landing attitude angles of the terminal 100 can be called the landing roll angle.

[0205] like Figure 5HAs shown, to avoid significant errors in the calculation of the rotation angles along the X, Y, and Z axes due to the different coordinate axis directions between different coordinate systems when determining the landing attitude angle of the terminal 100 in three-dimensional space, it is stipulated that when establishing the reference coordinate system with the calibration plate 201, the upper left corner of the calibration plate 201 is the origin, the horizontal direction closest to the calibration plate 201 is the Xc axis, the vertical direction closest to the calibration plate 201 is the Yc axis, and the Zc axis is perpendicular to the plane of the calibration plate 201 and points outward; when establishing the object coordinate system with the marker block on the terminal 100, the upper left corner of the marker block is the origin, the horizontal direction closest to the marker block is the Xk axis, the vertical direction closest to the marker block is the Yk axis, and the Zk axis is perpendicular to the plane of the marker block and points outward.

[0206] Among them, the calibration plate 201 can calibrate multiple feature points B1, and the marker block can calibrate multiple feature points B2.

[0207] The analysis device 400 can determine the pose of the calibration board 201 based on: the internal parameters of the camera 300, the coordinates of multiple feature points B1 in the reference coordinate system, and the coordinates of multiple feature points B1 in the pixel coordinate system of the landing frame image.

[0208] The pose of the calibration plate 201 includes: the rotation matrix R1 of the calibration plate 201 relative to the camera 300, and the translation matrix T1 of the calibration plate 201 relative to the camera 300.

[0209] Understandably, during the controlled drop test, the calibration plate 201 remains fixed, and therefore the reference coordinate system also remains fixed.

[0210] C). The analysis device 400 determines the pose of the terminal 100 relative to the camera 300 based on the landing frame image and the internal parameters of the camera 300 (referred to as the pose of the terminal 100, or the external parameters of the camera 300 relative to the terminal 100).

[0211] The analysis device 400 can determine the pose of the terminal 100 based on: the internal parameters of the camera 300, the coordinates of multiple feature points B2 in the object coordinate system, and the coordinates of multiple feature points B2 in the pixel coordinate system of the landing frame image.

[0212] The pose of the terminal 100 includes: the rotation matrix R2 of the terminal 100 relative to the camera 300, and the translation matrix T2 of the terminal 100 relative to the camera 300.

[0213] D). The analysis device 400 determines the landing attitude angle of the terminal 100 based on the rotation matrix R1 in the pose of the calibration board 201 and the rotation matrix R2 in the pose of the terminal 100.

[0214] Understandably, to facilitate calculation and reduce errors, the Euler angles of the terminal 100 corresponding to the landing attitude angle are the Euler angles of the terminal 100 in the reference coordinate system. That is, the Euler angles of the terminal 100 include: the landing pitch angle of the terminal 100 rotating about the X-axis in the reference coordinate system, the landing yaw angle of the terminal 100 rotating about the Y-axis in the reference coordinate system, and the landing roll angle of the terminal 100 rotating about the Z-axis in the reference coordinate system.

[0215] Therefore, to solve for the Euler angles of terminal 100, it is necessary to first calculate the transformation matrix ΔR between rotation matrix R1 and rotation matrix R2, the formula of which is as follows:

[0216] R2=R1×ΔR

[0217]

[0218] Among them, rotation matrices R1 and R2 are known full-rank matrices, and ΔR can be solved by methods such as inverse matrix, singular value decomposition, and least squares method.

[0219] Once the transformation matrix ΔR is determined, the landing pitch angle α, landing yaw angle β, and landing roll angle γ of the terminal 100 landing attitude angle are calculated as follows:

[0220] α = arctan2(r32, r33)

[0221]

[0222] γ = arctan2(r21, r11)

[0223] Its matrix representation can be:

[0224]

[0225] Implement the landing attitude angle calculation method provided in this application, such as Figure 5I As shown, the internal parameters of the camera 300 are first determined based on the calibration board 201. Then, the pose [R1, T1] of the calibration board 201 is solved based on the internal parameters of the camera 300. The pose [R2, T2] of the terminal 100 is then solved based on the internal parameters of the camera 300. Next, the transformation matrix between the calibration board 201 and the terminal 100 can be solved. Based on the transformation matrix, the landing attitude angle of the terminal 100 can be determined. This method makes the calculation of the landing attitude angle relatively convenient, requires less data, and offers higher processing efficiency and calculation accuracy.

[0226] It is understood that in this embodiment, the coordinate axes of the reference coordinate system and the object coordinate system are set to the same direction to eliminate angle calculation errors caused by the different coordinate axis directions of the two coordinate systems. Otherwise, if... Figure 5JAs shown, the Z-axis of the reference coordinate system is perpendicular to the plane of calibration plate 201 and points inward, while the Z-axis of the object coordinate system is perpendicular to the plane of the marker block and points outward; the Y-axis of the reference coordinate system is close to the horizontal direction of calibration plate 201, while the Y-axis of the object coordinate system is close to the vertical direction of the marker block; the X-axis of the reference coordinate system is close to the vertical direction of calibration plate 201, while the X-axis of the object coordinate system is close to the horizontal direction of the marker block. Therefore, the following formula applies:

[0227]

[0228] There will be two solutions due to the unclear angle.

[0229] S506. The analysis device 400 uses image analysis software to determine whether the error between the landing attitude angle and the standard attitude angle is less than or equal to a first specified value.

[0230] Specifically, standard attitude angles include: standard pitch angle, standard yaw angle, and standard roll angle. The analysis device 400 uses image analysis software to determine whether the errors 1 (between the landing pitch angle and the standard pitch angle), 2 (between the landing yaw angle and the standard yaw angle), and 3 (between the landing roll angle and the standard roll angle) are all less than or equal to a first specified value (e.g., 5 degrees, 7 degrees, or 10 degrees).

[0231] S507. When the error between the landing attitude angle and the standard attitude angle is less than or equal to the first specified value, the analysis device 400 generates a drop test report for the terminal 100 and controls the warning light 500 to output the first indication information (e.g., a green light).

[0232] Specifically, when errors 1, 2, and 3 are all less than or equal to the first specified value, the controlled drop test of terminal 100 is considered reliable and the test results are relatively accurate. Therefore, the analysis device 400 can generate a drop test report for terminal 100 and control the warning light 500 to output the first indication information (e.g., a green light). The drop test report may include: a landing frame image, the serial number (SN) of terminal 100, the product model of terminal 100, and the landing attitude angle of each of the six planes included in terminal 100 during the controlled drop test.

[0233] S508. The analysis device 400 sends the drop test report to the test report database via image analysis software.

[0234] Specifically, after each plane in terminal 100 has completed a controlled drop test, the analysis device 400 can send the generated drop test report of terminal 100 to the test report database. The test report database can store the drop test report for subsequent performance improvements of terminal 100.

[0235] S509. When the error between the landing attitude angle and the standard attitude angle is greater than the first specified value, the analysis device 400 controls the warning light 500 to output a second indication message (e.g., a red light).

[0236] Specifically, when any one of the errors 1, 2, and 3 exceeds the first specified value, the controlled drop test of the terminal 100 is deemed unreliable and the test results are inaccurate. Therefore, the analysis device 400 may output a second indication (e.g., a red light). In this case, the analysis device 400 does not generate a drop test report.

[0237] The image analysis method provided in this application determines the landing posture angle of the terminal 100, such as... Figure 5K As shown, before the controlled drop test begins, a calibration plate 201 is first affixed and calibrated as a reference coordinate system. Then, when the analysis device 400 receives multiple images including those of the terminal 100, it can detect the terminal 100 in the images, which has a marker block affixed to it. Next, the analysis device 400 can determine the landing frame image. Based on the landing frame image, the analysis device 400 can calculate the pose of the calibration plate 201 and the pose of the terminal 100. The analysis device 400 can calculate the transformation matrix between the pose of the terminal 100 and the pose of the calibration plate 201, and based on the transformation matrix, determine the landing posture angle of the terminal 100 in the reference coordinate system, and determine whether the landing posture angle and the standard posture angle are less than or equal to a first predetermined value. In this way, the device can automatically analyze whether the landing posture of the terminal 100 meets the standard, improving the accuracy and efficiency of the calculation.

[0238] Figure 6 This is a schematic diagram of the hardware structure of a terminal 100 provided in an embodiment of this application.

[0239] In the embodiments of this application, Figure 6 The terminal 100 shown is the electronic device in the embodiments of this application.

[0240] Terminal 100 may be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, cellular phone, personal digital assistant (PDA), augmented reality (AR) device, virtual reality (VR) device, artificial intelligence (AI) device, wearable device, in-vehicle device, smart home device and / or smart city device. This application embodiment does not impose any special restrictions on the specific type of terminal 100.

[0241] like Figure 6 As shown, terminal 100 may include processor 101, memory 102, wireless communication module 103, display screen 104, sensor module 105, audio module 106 (optional), speaker 107 (optional), and microphone 108 (optional). These modules can be connected via a bus.

[0242] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the terminal 100. In other embodiments of this application, the terminal 100 may also include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0243] Processor 101 may include one or more processor units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0244] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0245] The processor 101 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 101 is a cache memory. This memory can store instructions or data that the processor 101 has just used or that are used repeatedly. If the processor 101 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 101, and thus improves the efficiency of the system.

[0246] In some embodiments, the processor 101 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface, etc.

[0247] The memory 102 is coupled to the processor 101 and is used to store various software programs and / or multiple sets of instructions. In specific implementations, the memory 102 may include volatile memory, such as random access memory (RAM); it may also include non-volatile memory, such as ROM, flash memory, hard disk drive (HDD), or solid-state drive (SSD); the memory 102 may also include combinations of the above types of memory. The memory 102 may also store some program code so that the processor 101 can call the program code stored in the memory 102 to implement the implementation method of the present application embodiment in the terminal 100. The memory 102 may store an operating system, such as uCOS, VxWorks, RTLinux, or other embedded operating systems.

[0248] The wireless communication module 103 can provide solutions for wireless communication applications on the terminal 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc.

[0249] The wireless communication module 103 can be one or more devices integrating at least one communication processing module. The wireless communication module 103 receives electromagnetic waves via an antenna, performs frequency modulation and filtering of the electromagnetic wave signal, and sends the processed signal to the processor 101. The wireless communication module 103 can also receive signals to be transmitted from the processor 101, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via the antenna. In this embodiment, the terminal 100 can also use the Bluetooth communication module 103A in the wireless communication module 103 to transmit signals to detect or scan devices near the terminal 100 and establish a wireless communication connection with those devices to transmit data. The Bluetooth communication module 103A can provide one or more Bluetooth communication solutions, including basic rate / enhanced data rate (BR / EDR) or Bluetooth Low Energy (BLE).

[0250] The display screen 104 can be used to display images, videos, etc. The display screen 104 may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal 100 may include one or N display screens 104, where N is a positive integer greater than 1.

[0251] The sensor module 105 may include a gravity sensor 105A and a touch sensor 105B, etc. The gravity sensor 105A can be used to detect the magnitude of acceleration of the terminal 100 in various directions (generally the x, y, and z axes), the magnitude and direction of gravity, and displacement along the direction of gravity. The touch sensor 105B can also be called a "touch device." The touch sensor 105B can be disposed on the display screen 104, and the touch sensor 105B and the display screen 104 together form a touch screen, also called a "touchscreen." The touch sensor 105B can be used to detect touch operations applied to or near it.

[0252] The audio module 106 can be used to convert digital audio information into analog audio signal output, and can also be used to convert analog audio input into digital audio signal. The audio module 106 can also be used to encode and decode audio signals. In some embodiments, the audio module 106 can also be disposed in the processor 101, or some functional modules of the audio module 106 can be disposed in the processor 101.

[0253] The speaker 107, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal 100 can listen to music or make hands-free calls through the speaker 107.

[0254] Microphone 108, also known as a "microphone" or "voice transducer," is used to collect sound signals from the environment surrounding the electronic device. This sound signal is then converted into an electrical signal, which undergoes a series of processing steps, such as analog-to-digital conversion, to obtain a digital audio signal that can be processed by the processor 101 of the electronic device. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to the microphone 108, inputting the sound signal into the microphone 108. Terminal 100 may have at least one microphone 108. In some embodiments, terminal 100 may have two microphones 108, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, terminal 100 may have three or more microphones 108, enabling sound signal collection, noise reduction, sound source identification, and directional recording, among other functions.

[0255] It should be noted that, Figure 6 The terminal 100 shown is merely an illustrative explanation of the hardware structure of the electronic device provided in this application and does not constitute a specific limitation on this application.

[0256] Figure 7 This is a schematic diagram of the hardware structure of an analysis device 400 provided in an embodiment of this application.

[0257] In this embodiment of the application, the hardware structure of the industrial control device 600 can be referred to the description of the analysis device 400.

[0258] like Figure 7 As shown, the analysis device 400 may include one or more processors 401A, a communication interface 402A, a memory 403A, a display screen 404A, and a bus 405A. The processor 401A, communication interface 402A, memory 403A, and display screen 404A can be connected via a bus or other means. This embodiment of the application takes connection via bus 405A as an example. Wherein:

[0259] The processor 401A may consist of one or more general-purpose processors, such as a CPU. The processor 401A can be used to run program code related to device control methods.

[0260] The communication interface 402A can be a wired interface (e.g., an Ethernet interface) or a wireless interface (e.g., a cellular network interface or a wireless LAN interface) for communicating with other devices. In this embodiment, the communication interface 402A can specifically be used to communicate with the camera 300, the warning light 500, and the industrial control equipment 600.

[0261] Memory 403A may include volatile memory, such as random access memory (RAM); it may also include non-volatile memory, such as ROM, flash memory, hard disk drive (HDD), or solid state drive (SSD); memory 403A may also include combinations of the above types of memory. Memory 403A may store some program code so that processor 401A can call the program code stored in memory 403A to implement the method implemented in analysis device 400 according to the embodiments of this application.

[0262] Display screen 404A can be used to display images, videos, etc. Display screen 404A may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a minimized display, a microLED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the analysis device 400 may include one or N displays 404A, where N is a positive integer greater than 1.

[0263] Understandable, Figure 7 The analysis device 400 shown is merely one implementation of the embodiment of this application. In actual applications, the analysis device 400 may include more or fewer components, which is not limited here.

[0264] Figure 8 This is a schematic diagram of the hardware structure of a clamping device 202 provided in an embodiment of this application.

[0265] like Figure 8 As shown, the clamping device 202 may include a controller 210, a communication interface 220, a memory 230, and a motor 240 (optional), wherein:

[0266] The controller 210 can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0267] The communication interface 220 can be a wired interface (e.g., an Ethernet interface) or a wireless interface (e.g., a cellular network interface or a wireless LAN interface) for communicating with other devices. In this embodiment, the communication interface 220 is specifically used to communicate with the industrial control equipment 600.

[0268] The memory 230 may include volatile memory, such as random access memory (RAM); it may also include non-volatile memory, such as ROM, flash memory, hard disk drive (HDD), or solid state drive (SSD); the memory 230 may also include combinations of the above types of memory. The memory 230 may store some program code so that the controller 210 can call the program code stored in the memory 230 to implement the method of the clamping device 202 in the embodiments of this application.

[0269] Optionally, the motor 240 can be used to hold the clamp 202A in the clamping device 202 to slide on the support rod 202B. For example, the motor 240 can control the clamp 202A to hold the terminal 100 and slide on the support rod 202B at a fixed speed to make a constant speed drop motion.

[0270] Understandable, Figure 8 The clamping device 202 shown is merely one implementation of the embodiment of this application. In actual applications, the clamping device 202 may include more or fewer components, which is not limited here.

[0271] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, can implement the steps in the above-described method embodiments.

[0272] This application also provides a computer program product, including a computer program that, when run on a processor, can implement the steps executed by the electronic device in the above-described method embodiments.

[0273] This application also provides a chip system, which includes a processing circuit interface circuit. The interface circuit receives instructions and transmits them to the processing circuit, which executes the instructions to cause the chip system to perform the steps executed by the electronic device in any of the method embodiments of this application. The chip system can be a single chip or a chip module composed of multiple chips.

[0274] The term "user interface (UI)" used in the specification and accompanying drawings of this application refers to the medium through which an application or operating system interacts and exchanges information with the user. It converts the internal form of information into a form acceptable to the user. The user interface of an application is source code written in a specific computer language such as Java or Extensible Markup Language (XML). This source code is parsed and rendered on the terminal device, ultimately presenting user-recognizable content, such as images, text, buttons, and other controls. Controls, also known as widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined through tags or nodes, such as XML. <textview> 、 <imgview> 、 <videoview>Nodes define the controls contained in the interface. A node corresponds to a control or property in the interface, and after parsing and rendering, the node is presented as the content visible to the user. In addition, many applications, such as hybrid applications, often contain web pages within their interfaces. A web page, also known as a webpage, can be understood as a special control embedded in the application interface. Web pages are source code written in a specific computer language, such as Hypertext Markup Language (HTML), Cascading Style Sheets (CSS), JavaScript (JS), etc. Web page source code can be loaded and displayed as user-readable content by a browser or a web page display component with browser-like functionality. The specific content contained in a webpage is also defined through tags or nodes in the webpage source code; for example, HTML uses tags or nodes to define the content. 、 、 <video> 、 <canvas>Used to define the elements and attributes of a webpage.

[0275] The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0276] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state drive), etc.

[0277] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. This program can be stored in a computer-readable storage medium, and when executed, it can include the processes described in the above method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0278] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.< / canvas> < / video> < / videoview> < / imgview> < / textview>

Claims

1. A method for terminal drop testing, characterized in that, The drop test system includes: a first electronic device, a camera, a drop platform, a clamping device, a warning light, and a second electronic device, wherein the camera and the second electronic device establish a communication connection. The clamping device controls the first electronic device to fall onto the drop platform; When the first electronic device falls to the target location, the first electronic device controls the camera to start taking pictures; When the camera's shooting time reaches the first shooting time, the camera stops shooting and sends the captured multiple images, including the first image of the first electronic device, to the second electronic device; The second electronic device determines one or M landing frame images from the plurality of first images; wherein the landing frame image includes the posture of the first electronic device at the moment of falling onto the drop platform; The second electronic device determines the landing posture angle of the first electronic device based on the one or M landing frame images; When the error between the landing posture angle of the first electronic device and the preset standard posture angle is less than or equal to a first specified value, the second electronic device controls the warning light to output the first indication information.

2. The method according to claim 1, characterized in that, The first electronic device and the second electronic device establish a wireless communication connection; when the first electronic device falls to the target location, the first electronic device controls the camera to start taking pictures, specifically including: When the first electronic device falls to the target location, the first electronic device sends a camera activation instruction to the second electronic device; In response to the camera activation instruction, the second electronic device sends a shooting start command to the camera; In response to the shooting start command, the camera begins to shoot.

3. The method according to claim 1, characterized in that, The first electronic device establishes a wireless communication connection with the camera; when the first electronic device falls to the target location, the first electronic device controls the camera to start taking pictures, specifically including: When the first electronic device falls to the target position, the first electronic device sends a shooting start command to the camera; In response to the shooting start command, the camera begins to shoot.

4. The method according to claim 2, characterized in that, When the first electronic device falls to the target location, it sends a camera activation instruction to the second electronic device, specifically including: When the first electronic device detects displacement along the direction of gravity through the gravity sensor, the first electronic device starts the drop duration timer. The first electronic device calculates the drop height based on the drop duration; When the drop height of the first electronic device is greater than or equal to the target height corresponding to the target position, the first electronic device sends a camera activation instruction to the second electronic device.

5. The method according to claim 2, characterized in that, When the camera's recording time reaches the first recording time, the camera stops recording and sends multiple captured images, including the first image from the first electronic device, to the second electronic device, specifically including: When the shooting start command is sent, the second electronic device times the shooting duration of the camera; When the shooting duration reaches the first shooting duration, the second electronic device sends a shooting end command to the camera; In response to the shooting end command, the camera stops shooting and sends the captured first images, including the first electronic device, to the second electronic device.

6. The method according to claim 1, characterized in that, The second electronic device determines the landing attitude angle of the first electronic device based on the one or M landing frame images, specifically including: When the second electronic device determines, and determines only, that the second image is a landing frame image from the plurality of first images, the second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device; When the second electronic device determines M landing frame images from the plurality of first images, the second electronic device determines the landing posture angle corresponding to each of the M landing frame images; the M landing frame images correspond to M landing posture angles. The second electronic device determines the average or median value of the M landing posture angles as the landing posture angle of the first electronic device.

7. The method according to claim 6, characterized in that, The communication system includes a calibration board; the second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device, specifically including: The second electronic device determines the internal parameters of the camera based on the calibration board; wherein, the internal parameters of the camera are related to the camera's own characteristics; The second electronic device determines the first pose of the calibration board relative to the camera based on the second image; The second electronic device determines a second pose of the first electronic device relative to the camera based on the second image; The second electronic device determines the landing posture angle corresponding to the second image based on the first pose and the second pose; The second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device.

8. The method according to claim 7, characterized in that, The first pose includes a first rotation matrix, and the second pose includes a second rotation matrix; The second electronic device determines the landing posture angle corresponding to the second image based on the first pose and the second pose, specifically including: The second electronic device determines a transformation matrix based on the first rotation matrix and the second rotation matrix; wherein the transformation matrix is ​​used for conversion between the first rotation matrix and the second rotation matrix; The second electronic device determines the landing posture angle corresponding to the second image based on the transformation matrix.

9. The method according to claim 1, characterized in that, The method further includes: when it is determined that the error between the landing posture angle of the first electronic device and the preset standard posture angle is greater than a first predetermined value, the second electronic device controls the warning light to output a second indication information.

10. A method for terminal drop testing, characterized in that, Applied to a first electronic device, the method includes: The first electronic device falls onto the drop platform; When the first electronic device detects displacement along the direction of gravity through the gravity sensor, the first electronic device starts the drop duration timer. When the first electronic device determines that it has fallen to the target position based on the drop duration, the first electronic device controls the camera to start taking pictures.

11. The method according to claim 10, characterized in that, The first electronic device controls the camera to start recording, specifically including: The first electronic device sends a camera start instruction to the second electronic device; wherein, the camera start instruction is used to trigger the second electronic device to send a shooting start command to the camera, and the shooting start command is used to trigger the camera to start shooting.

12. The method according to claim 10, characterized in that, The first electronic device controls the camera to start shooting, specifically including: The first electronic device sends a shooting start command to the camera; wherein the shooting start command is used to trigger the camera to start shooting.

13. The method according to claim 10, characterized in that, The method further includes: The first electronic device times the shooting duration of the camera; When the shooting duration reaches the first shooting duration, the first electronic device sends a shooting end command to the camera; wherein, the shooting end command is used to control the camera to stop shooting and send the multiple first images captured, including the first electronic device, to the second electronic device.

14. A method for terminal drop testing, characterized in that, Applied to a second electronic device, the method includes: The second electronic device receives multiple first images, including those from the first electronic device, sent by the camera; The second electronic device determines one or M landing frame images from the plurality of first images; wherein the landing frame image includes the posture of the first electronic device at the moment of falling onto the landing platform; The second electronic device determines the landing posture angle of the first electronic device based on the one or M landing frame images; When the error between the landing posture angle of the first electronic device and the preset standard posture angle is less than or equal to the first specified value, the second electronic device controls the warning light to output the first indication information.

15. The method according to claim 14, characterized in that, The second electronic device determines the landing attitude angle of the first electronic device based on the one or M landing frame images, specifically including: When the second electronic device determines, and determines only, that the second image is a landing frame image from the plurality of first images, the second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device; When the second electronic device determines M landing frame images from the plurality of first images, the second electronic device determines the landing posture angle corresponding to each of the M landing frame images; the M landing frame images correspond to M landing posture angles. The second electronic device determines the average or median value of the M landing posture angles as the landing posture angle of the first electronic device.

16. The method according to claim 15, characterized in that, The second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device, specifically including: The second electronic device determines the internal parameters of the camera based on a calibration board; wherein the internal parameters of the camera are related to the camera's own characteristics; The second electronic device determines the first pose of the calibration board relative to the camera based on the second image; The second electronic device determines a second pose of the first electronic device relative to the camera based on the second image; The second electronic device determines the landing posture angle corresponding to the second image based on the first pose and the second pose; The second electronic device determines the landing posture angle corresponding to the second image as the landing posture angle of the first electronic device.

17. An electronic device, characterized in that, The electronic device includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code including computer instructions, and the one or more processors call the computer instructions to cause the electronic device to perform the method as described in any one of claims 1-16.

18. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform the method as described in any one of claims 1-16.

19. A computer-readable storage medium comprising instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the method as described in any one of claims 1-16.

20. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, causes the electronic device to perform the method as described in any one of claims 1-16.

Images