Test Method, System, Chart Card and Terminal Device for Clarity of Terminal Camera

By designing multifocal image card and camera automatic alignment technology, the problem of test station and edge distortion in multi-camera testing is solved, and efficient and accurate clarity testing is achieved.

CN115695775BActive Publication Date: 2025-07-25HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110864185.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-29
Publication Date
2025-07-25
Estimated Expiration
2041-07-29

AI Technical Summary

Technical Problem

The prior art requires multiple picture cards and multiple test stations in multi-camera multifocal clarity testing, resulting in increased testing costs and edge distortion affecting the accuracy of the test.

Method used

A picture card is designed, which contains multiple test areas, each area corresponds to a different focal segment. By adjusting the camera's focal segment alignment, selecting intersection coordinates, and filtering black blocks that meet preset angles to form ROI areas to offset edge distortion and achieve multifocal segment clarity testing.

Benefits of technology

Implement multi-camera multi-focal segment clarity testing on one picture card, reduce test stations, improve test efficiency, eliminate the impact of edge distortion, and reduce costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115695775B_ABST
    Figure CN115695775B_ABST
Patent Text Reader

Abstract

An embodiment of the present application discloses a method, a system, a test chart, and a terminal device for testing the clarity of a terminal camera. The test method includes aligning the camera with a test area; obtaining a test picture; selecting multiple fields of view; respectively obtaining the intersection coordinates of each intersection of each diagonal line with the multiple fields of view; selecting a black block to be measured; selecting a target black block; and forming a ROI area. The test system includes a camera alignment module, a test picture acquisition module, a field of view selection module, an intersection acquisition module, a black block to be measured selection module, a target black block screening module, and a ROI area formation module. The test chart includes multiple test areas, which respectively correspond to different focal lengths. A plurality of black blocks are arranged in each test area, and the arrangement density increases as the focal length increases. The technical solution disclosed in the present application enables the clarity test of multiple cameras with multiple focal lengths to be carried out on a single test chart, effectively reducing the test stations of the cameras and also offsetting the edge distortion of the cameras.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the technical field of terminal camera performance testing, and particularly to a method and system for testing the clarity of a terminal camera, a test chart, and a terminal device.

Background Art

[0002] The resolution of an imaging system has always been one of the most critical indicators of a camera. Currently, the commonly used methods in the industry mainly include TV line (television line) detection, MTF (Modulation Transfer Function) detection, and SFR (Spatial Frequency Response) detection. Since the SFR test method greatly simplifies the test process, the SFR test method is widely used in the automated clarity testing of smartphone cameras in the industry. The currently commonly used solution is to control different cameras of a mobile phone to take pictures of different test charts respectively, export the pictures, grab the ROI (Region of Interest) through an algorithm, and calculate the SFR test method to complete the test.

[0003] As the number of mobile phone cameras continues to increase, the focal lengths covered by different cameras increase and there are significant differences. When there are limitations in the space of the test equipment, it is necessary to add test charts and test workstations to cover the tests of cameras with different focal lengths, resulting in an increase in the length of the production line and manufacturing costs.

[0004] In addition, when using a checkerboard chart for testing, since the SFR calculation requires the black and white boundary line to be inclined at a certain angle, usually due to the distortion of the edge field of view of the wide-angle camera, the slope of the boundary line does not meet the test requirements, resulting in inability to calculate. For the problem of edge field of view distortion, the current technology is to increase the overall rotation angle of the checkerboard to offset the distortion, but this will cause a loss of test values in the central area of the image, resulting in inaccurate test values, leading to mismeasurement and overkill in the production line.

[0005] The current technology uses a checkerboard with an inclined angle as the test chart. After the camera takes a picture, it grabs the black and white boundary ROI areas in different fields of view, and then calculates the SFR of the ROI area to complete the clarity test.

[0006] When the number of mobile phone cameras increases and the physical zoom ratios are inconsistent, checkerboard test charts with different grid sizes will be designed according to the field of view and magnification of the cameras. Figure 1 The figure shows an SFR test chart for a wide-angle camera. Figure 2 The figure shows an SFR test chart for a telephoto camera.

[0007] When there are scenarios of multiple cameras with multiple zoom ratios on a mobile phone, cameras with different focal lengths need to use test cards with different checkerboard sizes for testing. However, using the existing technology requires adding new test cards and test stations, increasing the requirements for the test site space and resulting in an increase in the test cost.

[0008] When calculating the image clarity using SFR, only a hypotenuse where black and white intersect is needed. The current technology usually tilts the black-and-white checkerboard at a certain angle and calculates by capturing the black-and-white hypotenuse in the corresponding field of view.

[0009] When there is edge distortion in the camera, the captured hypotenuse will be deformed, and the slope of the black-and-white hypotenuse does not meet the test requirements, resulting in a scenario where the calculation fails. For the slope distortion caused by edge distortion, the current technology is to pre-cancel the edge distortion by increasing the overall tilt angle of the checkerboard, as Figure 3 shown.

[0010] By increasing the tilt angle of the checkerboard to cancel the edge distortion, the edge clarity under edge distortion can be calculated. However, increasing the tilt angle will cause losses to the test values in the central area ( Figure 4 shown), resulting in overkill or mismeasurement.

Summary of the Invention

[0011] In view of this, the embodiments of the present application provide a method, system, test card and terminal device for testing the clarity of a terminal camera, so as to solve the technical problems of the clarity of the terminal camera in the existing technology.

[0012] In a first aspect, the embodiments of the present application provide a method for testing the clarity of a terminal camera, and the test method includes:

[0013] Align the camera with the test area corresponding to the focal length of the camera among multiple test areas of the test card;

[0014] Take a picture of the test area to obtain a test picture and the resolution of the test picture;

[0015] Based on the resolution of the test picture, select multiple fields of view with different radius sizes with the center of the test picture as the origin;

[0016] Respectively obtain the intersection coordinates of each diagonal of the test picture with the outer periphery of the multiple fields of view;

[0017] Select the to-be-tested black blocks that meet the preset squareness among the multiple black blocks arranged in the test area;

[0018] Select the target black blocks with the tilt angle meeting the preset angle among the multiple to-be-tested black blocks;

[0019] Form an ROI region based on the target black block.

[0020] Through the solution provided in this embodiment, the clarity test of multiple cameras with multiple focal lengths can be carried out on a single chart card, effectively reducing the test stations for cameras and also offsetting the edge distortion of the cameras.

[0021] In a preferred implementation, in the step of aligning the camera with the test area corresponding to the focal length of the camera among multiple test areas of the chart card, it includes:

[0022] According to the focal length of the camera, identify the test area corresponding to the focal length of the camera among multiple test areas of the chart card;

[0023] Adjust the projection position of the center point of the camera on the chart card so that the center point of the camera is aligned with the test area corresponding to the focal length of the camera.

[0024] Through the solution provided in this embodiment, the camera can automatically identify the test areas applicable to each focal length in the chart card and accurately align with the test area corresponding to the focal length of the camera. Especially in the case of multiple focal lengths, when the camera zooms in and out, it can automatically adjust the angle of the camera to align with the correct test area. In the case of multiple cameras, it can realize the function of multiple cameras with different focal lengths respectively aligning with different test areas for clarity test simultaneously.

[0025] In a preferred implementation, in the step of respectively obtaining the intersection coordinates of each diagonal of the test picture with the outer periphery of the multiple fields of view, it includes:

[0026] Obtain each diagonal of the test picture based on the resolution of the test picture;

[0027] Based on the picture center and resolution of the test picture, obtain the diagonal coordinate values of each diagonal and the field-of-view coordinate values of the outer periphery of the multiple fields of view;

[0028] Calculate the diagonal coordinate values and the field-of-view coordinate values to obtain each intersection of each diagonal with the outer periphery of the multiple fields of view and its intersection coordinates.

[0029] Through the solution provided in this embodiment, four intersection points intersecting with the diagonal are taken on each field of view, and rectangular regions similar to the test picture are formed at different field-of-view ranges, which helps to calculate the edge distortion of the camera.

[0030] In a preferred implementation, in the step of selecting the black blocks to be measured that meet the preset squareness among the multiple black blocks arranged in the test area, it includes:

[0031] Traverse the center of the test image and each intersection point in sequence;

[0032] Select search regions centered on the center of the image and each intersection point;

[0033] Calculate the squareness of each black block within each search region;

[0034] Select the black blocks that meet the preset squareness within each search region as the black blocks to be measured.

[0035] Through the solution provided in this embodiment, the black blocks near each intersection point that need to measure edge distortion are preliminarily screened, and the black blocks with good squareness and easy-to-calculate edges are selected as the black blocks to be measured, which helps to simplify the calculation of clarity testing and save computing resources.

[0036] In a preferred implementation, in the step of selecting a target black block with an inclination angle meeting a preset angle among the multiple black blocks to be measured, it includes:

[0037] Extract the coordinate values of each side of the black block to be measured;

[0038] Calculate the slope of each side to obtain the inclination angle of the black block to be measured;

[0039] Match and calculate the inclination angles of each black block to be measured with the preset angle respectively to obtain the matching degree of each black block to be measured;

[0040] Take the black block to be measured with the highest matching degree as the target black block.

[0041] Through the solution provided in this embodiment, the selected black blocks to be measured are further screened, and the black block to be measured with the inclination angle closest to the preset angle is selected as the target black block, ensuring the optimal calculation result when calculating the hypotenuse of the target black block in the full-field scenario during the test.

[0042] In a preferred implementation, in the step of forming a ROI region based on the target black block, it includes:

[0043] Extract the coordinate values of each side of the target black block;

[0044] Obtain the coordinate values of the midpoints of each side;

[0045] Form a ROI region based on each midpoint.

[0046] Through the solution provided in this embodiment, it helps to offset the influence of camera edge distortion.

[0047] In a preferred implementation, the test method further includes:

[0048] Align the shooting center of the camera with the calibration cross in the test area;

[0049] Capture four reference points symmetrically arranged around the calibration cross with respect to the center of the calibration cross;

[0050] Calculate the slope of the line connecting two of the reference points on the same side of the calibration cross to obtain the deflection angle;

[0051] Compare the deflection angle with a preset rotation angle;

[0052] When the deflection angle is greater than the preset rotation angle, adjust the position of the camera.

[0053] Through the solution provided in this embodiment, the tilt angle of the camera during the test can be detected in real time, the camera can be adjusted in time, and the tilt angle detection of multiple cameras with multiple focal lengths can be covered, improving the accuracy of the camera clarity test.

[0054] In a second aspect, an embodiment of the present application provides a test system for the clarity of a terminal camera. The test system includes: a camera alignment module, a test picture acquisition module, a field of view selection module, an intersection acquisition module, a to-be-tested black block selection module, a target black block screening module, and an ROI area formation module that are communicatively connected to each other;

[0055] The camera alignment module is used to align the camera with the test area corresponding to the focal length of the camera among multiple test areas of the chart;

[0056] The test picture acquisition module is used to shoot the test area to obtain a test picture and the resolution of the test picture;

[0057] The field of view selection module is used to select multiple fields of view with different radius sizes with the picture center of the test picture as the origin based on the resolution of the test picture;

[0058] The intersection acquisition module is used to respectively obtain the intersection coordinates of each diagonal of the test picture and the outer periphery of the multiple fields of view;

[0059] The to-be-tested black block selection module is used to select to-be-tested black blocks that meet a preset squareness among multiple black blocks arranged in the test area;

[0060] The target black block screening module is used to select target black blocks with tilt angles meeting a preset angle among the multiple to-be-tested black blocks;

[0061] The ROI area formation module is used to form an ROI area based on the target black blocks.

[0062] Through the solution provided by this embodiment, the clarity test of multiple cameras with multiple focal lengths can be carried out on a single chart card by using these seven modules, effectively reducing the test stations for cameras and also offsetting the edge distortion of the cameras.

[0063] In a third aspect, an embodiment of the present application provides a chart card, which includes multiple test areas. The multiple test areas respectively correspond to different focal lengths. Multiple black blocks are arranged in each test area, and the arrangement density of the black blocks in each test area increases as the focal length increases.

[0064] Through the solution provided by this embodiment, it is realized that a single chart card can cover the clarity tests of multiple cameras with multiple focal lengths, effectively reducing the test space requirements for the clarity test site, shortening the length of the production line, saving costs and improving efficiency.

[0065] In a preferred implementation, the multiple test areas include a first test area, a second test area and a third test area. The first test area is used for testing cameras with a focal length of 0.6 times to 1.5 times. The second test area is used for testing cameras with a focal length of 3 times or more. The third test area is used for testing cameras with a focal length of 1.5 times to 3 times;

[0066] The first test area is an X shape composed of two diagonal areas. The two diagonal areas extend along the diagonal of the chart card. The second test area is two upper and lower triangular areas divided by the two diagonal areas. The third test area is two left and right triangular areas divided by the two diagonal areas;

[0067] The length of the right-angled side intersecting each side of the chart card in the first test area is not greater than 1 / 5 of the length of the corresponding side of the chart card.

[0068] Through the solution provided by this embodiment, good test effects can be achieved for the three test areas designed for cameras with three different focal lengths.

[0069] In a preferred implementation, in the first test area, each diagonal area has multiple rows of black blocks extending along their respective diagonals;

[0070] The multiple rows of black blocks have a rotation angle with respect to each side of the chart card. Among them, the rotation angle of the row of black blocks closest to the diagonal is the same as the preset rotation angle, and the rotation angles of the remaining rows of black blocks are plus or minus angles added on the basis of the preset rotation angle. The plus and minus angles of the black blocks on the same side of the diagonal are the same.

[0071] Through the solution provided by this embodiment, the problem of edge distortion of the camera can be offset in advance.

[0072] Fourthly, an embodiment of the present application provides a terminal device, including: a memory and a processor: the memory is used to store a computer program; the processor is used to execute the computer program stored in the memory, so that the terminal device executes the method described in the first aspect.

[0073] Fifthly, an embodiment of the present application provides a computer-readable storage medium, including a program or an instruction. When the program or the instruction runs on a computer, the method described in the first aspect is executed.

[0074] Compared with the prior art, the technical solution of the present application has at least the following beneficial effects:

[0075] The method, system, test chart and terminal device for testing the clarity of a terminal camera disclosed in the embodiments of the present application can realize the clarity test of multiple focal lengths of a terminal camera covered by one test chart, which is suitable for the application scenario of batch testing of multiple cameras and multiple focal lengths, effectively reducing the test stations of the terminal camera, improving the test efficiency, and eliminating the influence of edge distortion in the clarity test room of the wide-angle focal length of multiple cameras.

Description of the Drawings

[0076] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0077] Figure 1 is a schematic diagram of a test chart for SFR test of a wide-angle camera in the prior art;

[0078] Figure 2 is a schematic diagram of a test chart for SFR test of a telephoto camera in the prior art;

[0079] Figure 3 is a schematic diagram of edge distortion occurring at the edge of a camera in the prior art, resulting in distortion of the slope of the hypotenuse;

[0080] Figure 4 is a schematic diagram of the influence of the black block of the test chart at different tilt angles on the SFR test value in the prior art;

[0081] Figure 5 is a schematic diagram of the structure of the terminal device provided in Embodiment 1 of the present application;

[0082] Figure 6 is a schematic diagram of the test chart provided in Embodiment 2 of the present application;

[0083] Figure 7It is an enlarged schematic diagram of the first test area in the card provided in Embodiment 2 of the present application;

[0084] Figure 8 It is an enlarged schematic diagram of the second test area in the card provided in Embodiment 2 of the present application;

[0085] Figure 9 It is an enlarged schematic diagram of the third test area in the card provided in Embodiment 2 of the present application;

[0086] Figure 10 It is a flowchart of the test method provided in Embodiment 3 of the present application;

[0087] Figure 11 It is a schematic diagram of drawing concentric circles representing three fields of view on the card in the test method provided in Embodiment 3 of the present application;

[0088] Figure 12 It is a schematic diagram of drawing a diagonal line on the card and determining the intersection point in the test method provided in Embodiment 3 of the present application;

[0089] Figure 13 It is an enlarged schematic diagram at each intersection point when selecting a black block to be measured in the card in the test method provided in Embodiment 3 of the present application;

[0090] Figure 14 It is a flowchart of detecting the deflection angle of the camera in the test method provided in Embodiment 3 of the present application;

[0091] Figure 15 It is an enlarged schematic diagram of calculating the deflection angle of the camera on the card in the test method provided in Embodiment 3 of the present application;

[0092] Figure 16 It is a module schematic diagram of the test system provided in Embodiment 4 of the present application.

[0093] Reference numerals:

[0094] 1 - Antenna;

[0095] 2 - Antenna;

[0096] 100 - Terminal device; 110 - Processor; 120 - External memory interface; 121 - Internal memory; 130 - Universal serial bus interface; 140 - Charging management module; 141 - Power management module; 142 - Battery; 150 - Mobile communication module; 160 - Wireless communication module; 170 - Audio module; 170A - Speaker; 170B - Receiver; 170C - Microphone; 170D - Headphone jack; 180 - Sensor module; 180A - Pressure sensor; 180B - Gyroscope sensor; 180C - Barometric pressure sensor; 180D - Magnetic sensor; 180E - Acceleration sensor; 180F - Distance sensor; 180G - Proximity light sensor; 180H - Fingerprint sensor; 180J - Temperature sensor; 180K - Touch sensor; 180L - Ambient light sensor; 180M - Bone conduction sensor; 190 - Button; 191 - Motor; 192 - Indicator; 193 - Camera; 194 - Display screen; 195 - User identification module card interface;

[0097] 11 - Camera alignment module; 12 - Test picture acquisition module; 13 - Field of view selection module; 14 - Intersection point acquisition module; 15 - Black block to be measured selection module; 16 - Target black block screening module; 17 - ROI region formation module; 18 - Deflection angle detection module;

[0098] 20 - Chart card; 21 - First test area; 22 - Second test area; 23 - Third test area; 24 - Black block; 25 - Diagonal area; 26 - Edge of the chart card; 27 - Right - angled side; 28 - Diagonal; 29 - Calibration cross; 30 - Reference point; 31 - Concentric circles; 32 - Picture center; 33 - Intersection point; 34 - Search area; 35 - Black block to be measured; 36 - Target black block; 37 - Mid - point; 38 - ROI region.

Detailed implementation manners

[0099] To better understand the technical solution of this application, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0100] It should be clear that the described embodiments are only a part of the embodiments of this application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.

[0101] Embodiments of a terminal device and a method for implementing the terminal device are described below. The terminal device may be a mobile phone (also known as a smart electronic device), a tablet personal computer, a personal digital assistant, an e-book reader, or a virtual reality interactive device, etc. The terminal device may be connected to various types of communication systems, such as: a long term evolution (LTE) system, the future 5th Generation (5G) system, a new radio access technology (NR), and future communication systems, such as the 6G system; it may also be a wireless local area networks (WLAN), etc.

[0102] For ease of explanation, in the following embodiments, a smart terminal device is taken as an example for illustration.

[0103] Embodiment 1

[0104] As Figure 5 shown, FIG. 1 of this application's Embodiment 1 discloses a schematic structural diagram of a terminal device. Among them, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. Among them, the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0105] It can be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than those illustrated, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0106] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0107] The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0108] A memory may also be provided in the processor 110 for storing instructions and data. In one embodiment, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0109] In one embodiment, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0110] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In one embodiment, the processor 110 may include multiple groups of I2C buses. The processor 110 may be respectively coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: The processor 110 may be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface to implement the touch function of the terminal device 100.

[0111] The I2S interface can be used for audio communication. In one embodiment, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 through the I2S bus to implement communication between the processor 110 and the audio module 170. In one embodiment, the audio module 170 may transmit an audio signal to the wireless communication module 160 through the I2S interface to implement the function of answering a call through a Bluetooth headset.

[0112] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In one embodiment, the audio module 170 and the wireless communication module 160 may be coupled through the PCM bus interface. In one embodiment, the audio module 170 may also transmit an audio signal to the wireless communication module 160 through the PCM interface to implement the function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0113] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication. In one embodiment, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In one embodiment, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to implement the function of playing music through Bluetooth headphones.

[0114] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes the camera serial interface (CSI), the display serial interface (DSI), etc. In one embodiment, the processor 110 and the camera 193 communicate through the CSI interface to implement the shooting function of the terminal device 100. The processor 110 and the display screen 194 communicate through the DSI interface to implement the display function of the terminal device 100.

[0115] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In one embodiment, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0116] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device 100, and can also be used to transfer data between the terminal device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones. This interface can also be used to connect other terminal devices, such as AR devices, etc.

[0117] It can be understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are only illustrative and do not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0118] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In an embodiment of wired charging, the charging management module 140 can receive the charging input from a wired charger through the USB interface 130. In an embodiment of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the terminal device 100. While charging the battery 142, the charging management module 140 can also supply power to the terminal device through the power management module 141.

[0119] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives the input from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In one embodiment, the power management module 141 can also be disposed in the processor 110. In another embodiment, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0120] The wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.

[0121] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the terminal device 100 can be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0122] The mobile communication module 150 can provide solutions for wireless communications such as 2G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 can include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter, amplify and process the received electromagnetic waves, and then transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In one embodiment, at least some functional modules of the mobile communication module 150 can be disposed in the processor 110. In one embodiment, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 can be disposed in the same device.

[0123] The modulation and demodulation processor can include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays an image or video through the display screen 194. In one embodiment, the modulation and demodulation processor can be an independent device. In some other embodiments, the modulation and demodulation processor can be independent of the processor 110 and be disposed in the same device as the mobile communication module 150 or other functional modules.

[0124] The wireless communication module 160 may provide solutions for wireless communications applied to the terminal device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive the signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.

[0125] In one embodiment, antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and antenna 2 is coupled to the wireless communication module 160, enabling the terminal device 100 to communicate with the network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).

[0126] The terminal device 100 implements the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0127] The display screen 194 is used to display images, videos, etc. Among them, the display screen 194 includes a display panel. Specifically, the display screen may include a folding screen, a special-shaped screen, etc. The display panel may adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In one embodiment, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0128] The terminal device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0129] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In one embodiment, the ISP can be set in the camera 193.

[0130] The camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard RGB, YUV, etc. formats. In one embodiment, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0131] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the terminal device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0132] The video codec is used to compress or decompress digital videos. The terminal device 100 can support one or more video codecs. In this way, the terminal device 100 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0133] The NPU is a neural-network (NN) computing processor. By learning from the biological neural network structure, such as learning from the transmission pattern between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the terminal device 100 can be realized, such as: image recognition, face recognition, voice recognition, text understanding, etc.

[0134] The external memory interface 120 can be used to connect to an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function. For example, files such as music and videos are saved in the external memory card.

[0135] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.). The data storage area can store the data created during the use of the terminal device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0136] The terminal device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor, etc. For example, music playback, recording, etc.

[0137] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. The audio module 170 can also be used for encoding and decoding audio signals. In one embodiment, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0138] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal. The terminal device 100 can listen to music or hands-free calls through the speaker 170A.

[0139] The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the terminal device 100 answers a call or a voice message, the voice can be listened to by bringing the receiver 170B close to the human ear.

[0140] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak by bringing the mouth close to the microphone 170C to input the sound signal into the microphone 170C. The terminal device 100 can be provided with at least one microphone 170C. In some other embodiments, the terminal device 100 can be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the terminal device 100 can also be provided with three, four or more microphones 170C to implement functions such as collecting sound signals, noise reduction, identifying the sound source, and implementing a directional recording function.

[0141] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D can be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0142] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In one embodiment, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The terminal device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal device 100 detects the touch operation intensity according to the pressure sensor 180A. The terminal device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In one embodiment, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0143] The gyroscope sensor 180B can be used to determine the motion posture of the terminal device 100. In one embodiment, the angular velocity of the terminal device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the terminal device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the terminal device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0144] The air pressure sensor 180C is used to measure air pressure. In one embodiment, the terminal device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0145] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In one embodiment, when the terminal device 100 is a flip phone, the terminal device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.

[0146] The acceleration sensor 180E can detect the magnitude of the acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device and applied to applications such as horizontal and vertical screen switching and pedometers.

[0147] A distance sensor 180F is used to measure distance. The terminal device 100 can measure distance by infrared or laser. In one embodiment, when shooting a scene, the terminal device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0148] The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode may be an infrared light-emitting diode. The terminal device 100 emits infrared light outward through the light-emitting diode. The terminal device 100 uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 can determine that there is no object near the terminal device 100. The terminal device 100 can use the proximity light sensor 180G to detect that the user holds the terminal device 100 close to the ear for a call, so as to automatically turn off the screen to achieve the purpose of power saving. The proximity light sensor 180G can also be used for the holster mode and automatic unlocking and locking of the pocket mode.

[0149] The ambient light sensor 180L is used to sense the ambient light brightness. The terminal device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the terminal device 100 is in the pocket to prevent accidental touch.

[0150] The fingerprint sensor 180H is used to collect fingerprints. The terminal device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint taking pictures, fingerprint answering calls, etc.

[0151] The temperature sensor 180J is used to detect temperature. In one embodiment, the terminal device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds the threshold, the terminal device 100 reduces the performance of the processor near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the terminal device 100 heats the battery 142 to avoid abnormal shutdown of the terminal device 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold, the terminal device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0152] The touch sensor 180K, also known as the "touch control device". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch control screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the terminal device 100, at a different position from that of the display screen 194.

[0153] In one embodiment, the touch control screen formed by the touch sensor 180K and the display screen 194 can be located in the side area or the folding area of the terminal device 100, and is used to determine the position and gesture of the user's touch when the user's hand touches the touch control screen; for example, when the user holds the terminal device, the touch sensor 180K can detect the user's click operation by clicking any position on the touch control screen, and transmit the click operation to the processor, and the processor determines that the click operation is used to wake up the screen according to the click operation.

[0154] The bone conduction sensor 180M can acquire vibration signals. In one embodiment, the bone conduction sensor 180M can acquire the vibration signals of the vibrating bone mass of the human vocal part. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulsation signals. In one embodiment, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bone mass of the human vocal part acquired by the bone conduction sensor 180M to implement the voice function. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 180M to implement the heart rate detection function.

[0155] The keys 190 include a power-on key, a volume key, etc. The keys 190 can be mechanical keys. They can also be touch keys. The terminal device 100 can receive key inputs and generate key signal inputs related to the user settings and function controls of the terminal device 100.

[0156] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (such as: time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0157] The indicator 192 can be an indicator light, which can be used to indicate the charging status, power change, or can also be used to indicate messages, missed calls, notifications, etc.

[0158] The SIM card interface 195 is used to connect to the SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation from the terminal device 100. The terminal device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The terminal device 100 interacts with the network through the SIM card to implement functions such as calls and data communication. In one embodiment, the terminal device 100 uses an eSIM, that is, an embedded SIM card. The eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.

[0159] When the terminal device uses a special-shaped screen or a foldable screen, the touch display screen of the terminal device can include multiple touch display areas. For example, the foldable area of the foldable screen of the terminal device includes a folding area when in the folded state, and this folding area can also achieve touch response. However, in the prior art, the operations on specific touch display areas of the terminal device are limited, and there are no related operations specifically for specific touch display areas. Based on this, the embodiments of the present application provide a gesture interaction method. In this gesture interaction method, there are touch response areas in the side area or the folding area of the terminal device. The terminal device can obtain the input events of the touch response areas and, in response to the input events, trigger the terminal device to execute the operation instructions corresponding to the input events to implement gesture operations on the side area or the folding area of the terminal device, thereby enhancing the operation experience of the terminal device.

[0160] In the terminal device disclosed in Embodiment 1 of the present application, the memory is used to store computer programs, and the processor is used to execute the computer programs stored in the memory so that the terminal device executes the method described in Embodiment 3 of the present application.

[0161] Embodiment 2

[0162] A chart card 20 provided in Embodiment 2 of the present application combines the test areas for cameras of different focal lengths for multi-camera clarity testing. For the problem that the chart cards 20 for different focal lengths in multi-camera clarity testing are not normalized and the distortion at the wide-angle edge makes it impossible to calculate clarity, it can cover the clarity testing of multiple cameras with multiple focal lengths and realizes the simultaneous testing of the clarity of different cameras with different focal lengths.

[0163] As shown Figure 6 in the figure, the test card 20 includes a plurality of test areas 21, 22, and 23. The plurality of test areas 21, 22, and 23 respectively correspond to different focal lengths. A plurality of black blocks 24 are arranged in each test area 21, 22, and 23. The arrangement density of the black blocks 24 in each test area 21, 22, and 23 increases as the focal length increases.

[0164] The arrangement density of the black blocks 24 in the test card 20 is actually divided according to the actual situation of the camera. If the focal length of the tested camera is farther, the density of the black blocks 24 is greater. Because in the case of a long focal length, if the black blocks 24 captured by the camera are very sparse, it is impossible to accurately receive a lot of black blocks 24, and it is impossible to accurately evaluate the imaging characteristics of the camera. If the focal length of the tested camera is short, and the captured black blocks 24 are very dense, then when testing the camera, the interval area for calculating the black blocks 24 is relatively small, so the length of the test pictures captured by the camera for sampling does not meet the requirements, and it may be impossible to test accurately. In addition, there are requirements for the pixels at the boundary section between the black blocks 24 and the non-black blocks 24, and they must match the imaging requirements of cameras with different focal lengths.

[0165] The test card 20 of this Embodiment 2 enables the same test card 20 to cover the clarity tests of multiple cameras with multiple focal lengths, effectively reducing the test space requirements of the clarity test site, shortening the length of the production line, saving costs, and improving efficiency.

[0166] In the test card 20 of this Embodiment 2, the plurality of test areas include a first test area 21, a second test area 22, and a third test area 23.

[0167] Specifically, the first test area 21 is used for testing cameras with a focal length range of 0.6 times to 1.5 times. The first test area 21 is in the shape of an X formed by two diagonal areas 25. The two diagonal areas 25 extend along the diagonal 28 of the chart 20, forming an X-shaped checkerboard area. The second test area 22 is used for testing cameras with a focal length of 3 times or more. The second test area 22 consists of two upper and lower triangular areas separated by the two diagonal areas 25. The two upper and lower triangular areas are triangular checkerboard areas composed of checkerboards. The third test area 23 is used for testing cameras with a focal length range of 1.5 times to 3 times. The third test area 23 consists of two left and right triangular areas separated by the two diagonal areas 25. The two left and right triangular areas are triangular checkerboard areas composed of checkerboards. Among them, the length of the right-angled side 27 that intersects each side 26 of the chart 20 in the first test area 21 is not greater than 1 / 5 of the length of the corresponding side 26 of the chart 20. The width of the two diagonal areas 25 forming the X shape in the first test area 21 along the diagonal 28 direction cannot be too large, otherwise it will affect the clarity test effect of the second test area 22 and the third test area 23. From Figure 6 It can be seen that among the three test areas, the first test area 21 has the fewest black blocks 24, the largest shape, and the sparsest arrangement density. The second test area 22 has the most black blocks 24, the smallest shape, and the densest arrangement density. The number, shape, and arrangement density of the black blocks 24 in the third test area 23 are in the middle between the first test area 21 and the second test area 22. And in the first test area 21, only one black block 24 located at the center and eight black blocks 24 distributed along the two diagonals 28 and symmetric about the center are arranged near the center of the chart 20. These nine black blocks 24 are used for the alignment operation of the camera before testing and for detecting whether the camera deflects during the testing process.

[0168] For the chart 20 of this Embodiment 2, the three test areas 21, 22, and 23 designed for cameras with three different focal lengths can all achieve good test effects.

[0169] In the chart 20 of this Embodiment 2, in the first test area 21, each diagonal area 25 has multiple rows of black blocks 24 extending along their respective corresponding diagonals 28. The multiple rows of black blocks 24 have a rotation angle relative to each side 26 of the chart 20. Among them, the rotation angle of the row of black blocks 24 closest to the diagonal 28 is the same as the preset rotation angle, and the rotation angles of the remaining rows of black blocks 24 are plus or minus angles added on the basis of the preset rotation angle. The plus and minus angles of the black blocks 24 on the same side of the diagonal 28 are the same.

[0170] In the chart 20 of the second embodiment, in the two oblique areas 25 of the first test area 21, a row of black blocks 24 forming the middle diagonal area 28 closest to the X-shape is rotated at a rotation angle that satisfies the preset rotation angle of the SFR test, and the two relatively outer rows of black blocks 24 are rotated at a rotation angle that has a certain positive and negative angle with the rotation angle, so that when the camera is tested for clarity, the black blocks 24 that are most suitable for calculating the SFR can be selected, and the edge distortion problem of the camera can be offset in advance.

[0171] In addition, if Figure 7 , Figure 8 and Figure 9 As shown, the first test area 21, the second test area 22 and the third test area 23 all contain calibration crosses 29 and reference points 30 for testing camera deflection angle defects, so that when the camera is performing a clarity test, it can simultaneously detect whether the camera is deflected due to external factors or internal factors, and adjust the camera angle in time to avoid affecting the accuracy of the clarity test of the camera.

[0172] Example 3

[0173] Embodiment 3 of the present application provides a method for testing the clarity of a terminal camera, which uses the image card 20 disclosed in Embodiment 2 of the present application to test the clarity of the camera, and is used to solve the problem of non-uniformity of image cards for clarity testing of multiple cameras and multiple focal lengths, solve the problem of requiring multiple image cards and multiple testing devices for multiple cameras and multiple focal lengths, reduce the number of camera SFR testing stations, and solve the problem of the inability to calculate edge distortion during clarity testing of multiple cameras with wide-angle focal lengths.

[0174] like Figure 10 As shown, the testing method of this embodiment 3 includes:

[0175] Step 100: Aim the camera at a test area corresponding to the focal length of the camera among the multiple test areas of the chart;

[0176] Step 200: photograph the test area to obtain a test image and the resolution of the test image;

[0177] Step 300: Based on the resolution of the test image, multiple fields of view with different radii are selected with the center of the test image as the origin;

[0178] Step 400: Obtain the coordinates of intersection points where each diagonal line of the test image intersects with the periphery of multiple fields of view;

[0179] Step 500: Selecting a black block to be tested that meets a preset squareness from a plurality of black blocks arranged in the test area;

[0180] Step600: Select a target black block with an inclination angle meeting a preset angle from multiple black blocks to be measured;

[0181] Step700: Form an ROI region based on the target black block.

[0182] In Step100, for example, in a camera test scenario of 0.6 times to 1.5 times, aim the camera at the first test area 21 in the chart 20 of Embodiment 2 of the present application. Through Step200 to Step700, use the black block 24 with a rotation angle in the X-shaped first test area 21 in the chart 20 of Embodiment 2 of the present application to select the target black block 36 to form the ROI region 38.

[0183] See Figure 11 , taking the test scenario of a camera with a focal length of 0.6 times to 1.5 times as an example, in Step300, according to the resolution of the acquired test picture, calculate the test picture and draw three concentric circles 31 representing three fields of view with the picture center 32 as the origin. The radii of the three fields of view are 0.3, 0.5, and 0.8 respectively, representing the long-focus, short-focus, and wide-angle fields of view in the test picture. These three concentric circles 31 are for testing the clarity of fields of view with different radii and are not actually drawn, but only for dividing the ranges of the test areas 21, 22, and 23 in the chart 20, and finding suitable black blocks 24 within the ranges to form the ROI region for clarity testing.

[0184] The test method of this Embodiment 3 enables the clarity test of multiple cameras with multiple focal lengths to be carried out on one chart 20, effectively reducing the test stations of the cameras and also being able to offset the edge distortion of the cameras.

[0185] In the test method of this Embodiment 3, Step100 includes:

[0186] Step101: According to the focal length of the camera, identify the test area corresponding to the focal length of the camera among multiple test areas of the chart;

[0187] Step102: Adjust the projection position of the center point of the camera on the chart so that the center point of the camera is aligned with the test area corresponding to the focal length of the camera.

[0188] When executing Step102, when the camera is aligned with the second test area 22 or the third test area 23, the center point of the camera is aligned with the geometric center of the triangle.

[0189] The testing method of this Embodiment 3 enables the camera to automatically identify the test areas 21, 22, and 23 applicable to each focal length in the card 20, and can accurately align with the test areas 21, 22, and 23 corresponding to the focal length of the camera. Especially in the case of multiple focal lengths, when the camera zooms in or out, it can automatically adjust the angle of the camera to align with the correct test areas 21, 22, and 23. In the case of multiple cameras, it can achieve the function of multiple cameras with different focal lengths respectively aligning with different test areas 21, 22, and 23 to simultaneously perform clarity tests.

[0190] In the testing method of this Embodiment 3, Step400 includes:

[0191] Step401: Obtain each diagonal of the test picture based on the resolution of the test picture;

[0192] Step402: Based on the picture center and resolution of the test picture, obtain the diagonal coordinate values of each diagonal and the field-of-view coordinate values of the outer periphery of multiple fields of view;

[0193] Step403: Calculate the diagonal coordinate values and field-of-view coordinate values to obtain each intersection point 33 where each diagonal intersects with the outer periphery of multiple fields of view and its intersection coordinates.

[0194] Refer to Figure 12 , execute Step401. After calculating the resolution of the test picture, two diagonals 28 of the test picture can be drawn; execute Step402, taking the picture center 32 as the origin, calculate the diagonal coordinate values of the diagonal 28 and the field-of-view coordinate values of three concentric circles 31 representing the outermost peripheries of three fields of view; execute Step403, by combining the calculation of the diagonal coordinate values and field-of-view coordinate values, four intersection points 33 where each diagonal 28 intersects with each concentric circle 31 and their intersection coordinates can be obtained.

[0195] In the testing method of this Embodiment 3, four intersection points 33 intersecting with the diagonal 28 are taken on each field of view respectively, and rectangular regions similar to the test picture are formed at different field-of-view ranges, which helps to estimate the edge distortion of the camera.

[0196] In the testing method of this Embodiment 3, Step500 includes:

[0197] Step501: Traverse the picture center and each intersection point of the test picture in sequence;

[0198] Step502: Select a search area with the picture center and each intersection point as the center;

[0199] Step503: Calculate the squareness of each black block in each search area;

[0200] Step504: Select black blocks that meet the preset squareness in each search area as the black blocks to be measured.

[0201] See Figure 13 , execute Step501, and sequentially perform the search work for the black blocks 35 to be measured on the picture center 32 and the twelve intersection points 33; execute Step502, select a rectangular area within a certain range centered on the intersection point 33 as the search area 34 at each intersection point 33; execute Step503, calculate the squareness of each black block 24 in the search area 34; execute Step504, find the black blocks 24 that meet the preset squareness, which are the black blocks 24 with the best squareness, and these black blocks 24 with the best squareness are the black blocks 35 to be measured screened out at the picture center 32 and the twelve intersection points 33. Among them, the range and size of the search area 34 can be determined according to the actual application scenario or user requirements.

[0202] The test method of this Embodiment 3 performs a primary screening on the black blocks 24 near each intersection point 33 that needs to measure the edge distortion, and selects the black blocks 24 with good squareness and easy-to-calculate edges as the black blocks 35 to be measured, which helps to simplify the calculation of the clarity test and save computing resources.

[0203] In the test method of this Embodiment 3, Step600 includes:

[0204] Step601: Extract the coordinate values of each side of the black block to be measured;

[0205] Step602: Calculate the slope of each side to obtain the tilt angle of the black block to be measured;

[0206] Step603: Perform a matching calculation on the tilt angles of each black block to be measured with the preset angle respectively to obtain the matching degree of each black block to be measured;

[0207] Step604: Select the black block to be measured with the highest matching degree as the target black block.

[0208] Through Step601 to Step604, among all the screened black blocks 35 to be measured, find the tilt angle closest to the preset angle that meets the SFR test requirements as the target black block 36 for selecting the ROI area 38. See Figure 13 , taking the camera's wide-angle focal length as an example, where the radius of the concentric circle 31 representing the outermost periphery of the field of view is 0.8, near the intersection point 33 of this field of view and the diagonal 28, four black blocks 35 to be measured that meet the requirements, namely a, b, c, and d, are screened out. After calculating the slopes of each side of these four black blocks 35 to be measured respectively, finally, the slope of the c-numbered black block 35 to be measured best meets the requirements of the tilt angle for SFR calculation and is selected as the target black block 36.

[0209] In the testing method of this Embodiment 3, the selected black blocks 35 to be tested are further screened, and the black block 35 to be tested with the tilt angle closest to the preset angle is selected as the target black block 36, ensuring that the calculation result is optimal when calculating the hypotenuse of the target black block 36 in the full-field scenario during the testing process.

[0210] In the testing method of this Embodiment 3, Step700 includes:

[0211] Step701: Extract the coordinate values of each side of the target black block;

[0212] Step702: Obtain the coordinate values of the midpoints of each side;

[0213] Step703: Form an ROI region based on each midpoint.

[0214] In Figure 13 , on the basis of selecting the target black block 36, calculate the midpoints 37 of each side of the target black block 36 and form an ROI region 38.

[0215] The testing method of this Embodiment 3 helps to offset the influence of the edge distortion of the camera.

[0216] As Figure 14 shown, the testing method of this Embodiment 3 further includes:

[0217] Step800: Align the shooting center of the camera with the calibration cross in the testing area;

[0218] Step900: Capture four reference points symmetrically arranged around the calibration cross center around the calibration cross;

[0219] Step1000: Calculate the slope of the line connecting two reference points on the same side of the calibration cross to obtain the deflection angle;

[0220] Step1100: Compare the deflection angle with the preset rotation angle;

[0221] When the deflection angle is greater than the preset rotation angle, execute Step1200: Adjust the camera position.

[0222] Refer to Figure 15 , when cameras with different focal length magnifications are aligned with the corresponding testing areas 21, 22, and 23 for shooting, they can all capture the calibration cross 29 with the cross and calculate the deflection defect of the camera installation for the 4 reference points 30 evenly distributed around it. Among them, Step800 to Step1100 can be executed synchronously with Step100 to Step700.

[0223] The test method of this Embodiment 3 can detect the deflection of the camera in real time during the test, adjust the camera in time, and can cover the deflection angle detection of multiple cameras with multiple focal lengths, improving the accuracy of the camera clarity test.

[0224] Embodiment 4

[0225] As Figure 16 Shown is a test system for the clarity of a terminal camera provided by Embodiment 4 of this application. The test system includes: a camera alignment module 11, a test picture acquisition module 12, a field of view selection module 13, an intersection point acquisition module 14, a to-be-tested black block selection module 15, a target black block screening module 16, an ROI region formation module 17, and a deflection angle detection module 18 that are communicatively connected to each other. Among them, the camera alignment module 11 is used to align the camera with the test area corresponding to the focal length of the camera among multiple test areas of the chart; the test picture acquisition module 12 is used to take pictures of the test area to obtain the test picture and the resolution of the test picture; the field of view selection module 13 is used to select multiple fields of view with different radius sizes with the picture center of the test picture as the origin based on the resolution of the test picture; the intersection point acquisition module 14 is used to respectively obtain the intersection point coordinates of each diagonal of the test picture and the outer periphery of the multiple fields of view; the to-be-tested black block selection module 15 is used to select the to-be-tested black blocks that meet the preset squareness among the multiple black blocks arranged in the test area; the target black block screening module 16 is used to select the target black blocks whose inclination angles meet the preset angle among the multiple to-be-tested black blocks; the ROI region formation module 17 is used to form an ROI region based on the target black blocks; the deflection angle detection module 18 is used to align the shooting center of the camera with the calibration cross in the test area, capture four reference points symmetrically arranged around the calibration cross center with respect to the calibration cross, calculate the slope of the line connecting the two reference points on the same side of the calibration cross, obtain the deflection angle, compare the deflection angle with the preset rotation angle, and adjust the position of the camera when the deflection angle is greater than the preset rotation angle.

[0226] The test system of this Embodiment 4 enables the clarity test of multiple cameras with multiple focal lengths to be carried out on one chart using these seven modules, effectively reducing the test stations of the camera, and can also offset the edge distortion of the camera. The deflection angle detection module 18 can detect the deflection of the camera in real time during the test, adjust the camera in time, and can cover the deflection angle detection of multiple cameras with multiple focal lengths, improving the accuracy of the camera clarity test.

[0227] Embodiment 5

[0228] Embodiment 5 of this application provides a computer-readable storage medium, including a program or instruction. When the program or instruction runs on a computer, the voice recognition method disclosed in Embodiment 2 of this application is executed.

[0229] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or wireless (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that the computer can access or a data storage device such as a server or data center that includes one or more integrated available media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a Digital Video Disc (DVD)), or a semiconductor medium (such as a Solid State Disk (SSD)), etc.

[0230] The method, system, chart card, and terminal device for testing the clarity of a terminal camera disclosed in the embodiments of the present application can achieve the clarity test of multiple focal lengths of a terminal camera by using one chart card, are suitable for the application scenario of batch testing of multiple cameras and multiple focal lengths, effectively reduce the test stations for terminal cameras, improve the test efficiency, and eliminate the influence of edge distortion in the clarity test room of the wide-angle focal length of multiple cameras.

[0231] Those of ordinary skill in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. To clearly illustrate the interchangeability of hardware and software, the components and steps of each example have been generally described according to their functions in the above description. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0232] The above are only the preferred embodiments of the present application and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present application shall be included within the scope of protection of the present application.

Claims

1. A method for testing the clarity of a terminal camera, characterized in that The described test method includes: Align the camera with the test area corresponding to the focal length of the camera among multiple test areas of the test chart; Take a picture of the test area to obtain a test picture and the resolution of the test picture; Based on the resolution of the test picture, select multiple fields of view with different radii centered on the picture center of the test picture; Obtain the intersection coordinates of each diagonal of the test picture with the outer periphery of the multiple fields of view respectively; Select a to-be-tested black block that meets the preset squareness among multiple black blocks arranged in the test area; Select a target black block with an inclination angle meeting the preset angle among the multiple to-be-tested black blocks; Form an ROI area based on the target black block; In the step of selecting a to-be-tested black block that meets the preset squareness among multiple black blocks arranged in the test area, it includes: Traverse the picture center of the test picture and each of the intersections in sequence; Select a search area centered on the picture center and each of the intersections; Calculate the squareness of each black block in each search area; Select a black block that meets the preset squareness in each search area as a to-be-tested black block respectively.

2. The test method for the clarity of the terminal camera according to claim 1, wherein In the step of aligning the camera with the test area corresponding to the focal length of the camera among multiple test areas of the test chart, it includes: Identify the test area corresponding to the focal length of the camera among multiple test areas of the test chart according to the focal length of the camera; Adjust the projection position of the center point of the camera on the test chart so that the center point of the camera is aligned with the test area corresponding to the focal length of the camera.

3. The test method for the clarity of the terminal camera according to claim 1, wherein In the step of obtaining the intersection coordinates of each diagonal of the test picture with the outer periphery of the multiple fields of view respectively, it includes: Obtain each diagonal of the test picture based on the resolution of the test picture; Based on the picture center and resolution of the test picture, obtain the diagonal coordinate values of each diagonal and the field-of-view coordinate values of the outer periphery of the multiple fields of view; Calculate the diagonal coordinate values and the field-of-view coordinate values to obtain the intersections of each diagonal with the outer periphery of the multiple fields of view and their intersection coordinates.

4. The method for testing the clarity of a terminal camera according to claim 1, wherein In the step of selecting a target black block with an inclination angle meeting the preset angle among the multiple to-be-tested black blocks, it includes: Extract the coordinate values of each side of the to-be-tested black block; Calculate the slope of each side to obtain the inclination angle of the to-be-tested black block; Perform a matching calculation by respectively matching the inclination angles of each to-be-tested black block with the preset angle to obtain the matching degree of each to-be-tested black block; Take the to-be-tested black block with the highest matching degree as the target black block.

5. The test method for the clarity of the terminal camera according to claim 1, wherein In the step of forming an ROI area based on the target black block, it includes: Extract the coordinate values of each side of the target black block; Obtain the coordinate values of the midpoints of each side; Form an ROI area based on each of the midpoints.

6. The method for testing the clarity of a terminal camera according to claim 1, wherein, The described test method further includes: Align the shooting center of the camera with the calibration cross in the test area; Capture four reference points symmetrically arranged around the calibration cross with respect to the center of the calibration cross; Calculate the slope of the line connecting two of the reference points on the same side of the calibration cross to obtain the deflection angle; Compare the deflection angle with a preset rotation angle; When the deflection angle is greater than the preset rotation angle, adjust the position of the camera.

7. A test system for the clarity of a terminal camera, characterized in that The test system includes: a camera alignment module, a test picture acquisition module, a field of view selection module, an intersection acquisition module, a to-be-tested black block selection module, a target black block screening module, and an ROI region formation module that are communicatively connected to each other; The camera alignment module is used to align the camera with the test area corresponding to the focal length of the camera among multiple test areas of the chart; The test picture acquisition module is used to photograph the test area to obtain a test picture and the resolution of the test picture; The field of view selection module is used to select multiple fields of view with different radii centered on the picture center of the test picture based on the resolution of the test picture; The intersection acquisition module is used to respectively obtain the intersection coordinates of the intersections of the diagonals of the test picture with the outer perimeters of the multiple fields of view; The to-be-tested black block selection module is used to select to-be-tested black blocks that meet a preset squareness among multiple black blocks arranged in the test area; The target black block screening module is used to select target black blocks with an inclination angle meeting a preset angle among the multiple to-be-tested black blocks; The ROI region formation module is used to form an ROI region based on the target black blocks; The to-be-tested black block selection module is further used to sequentially traverse the picture center of the test picture and each of the intersections; select search areas centered on the picture center and each of the intersections; calculate the squareness of each black block within each search area; and respectively select black blocks that meet the preset squareness within each search area as to-be-tested black blocks.

8. A picture card, characterized in that, It includes multiple test areas, the multiple test areas respectively correspond to different focal lengths, multiple black blocks are arranged in each test area, the arrangement density of the black blocks in each test area increases with the increase of the focal length, and the chart is used for the test method for the clarity of the terminal camera as described in any one of claims 1 to 6.

9. The picture card according to claim 8, characterized in that, The multiple test areas include a first test area, a second test area, and a third test area. The first test area is used for testing cameras with a focal length of 0.6 times to 1.5 times, the second test area is used for testing cameras with a focal length of 3 times or more, and the third test area is used for testing cameras with a focal length of 1.5 times to 3 times; The first test area is an X shape composed of two diagonal areas, the two diagonal areas extend along the diagonal of the chart, the second test area is two upper and lower triangular areas divided by the two diagonal areas, and the third test area is two left and right triangular areas divided by the two diagonal areas; The length of the right-angled side intersecting with each side of the chart in the first test area is not greater than 1 / 5 of the length of the corresponding side of the chart.

10. The picture card according to claim 9, wherein In the first test area, each diagonal area has multiple rows of black blocks extending along their respective corresponding diagonals; The multi-row black blocks have rotation angles relative to the respective sides of the graphics card, wherein the rotation angle of the row of black blocks closest to the diagonal is the same as the preset rotation angle, and the rotation angles of the remaining rows of black blocks are the preset rotation angle plus or minus additional angles, and the plus or minus angles of the black blocks on the same side of the diagonal are the same.

11. A terminal device, characterized in that, Comprising: A memory and a processor: The memory is used for storing a computer program; The processor is used for executing the computer program stored in the memory, so that the terminal device executes the method for testing the clarity of the terminal camera as described in any one of claims 1 to 6.

12. A computer-readable storage medium, characterized in that, Comprising a program or an instruction, when the program or the instruction runs on a computer, the method for testing the clarity of the terminal camera as described in any one of claims 1 to 6 is executed.

Citation Information

Patent Citations

  • Camera definition detection method and definition detection image card

    CN110049319A

  • Resolution test method for three-camera shooting and application thereof

    CN110896469A