Triple depth module matching method and device, mobile terminal, medium and chip

By analyzing and matching the error characteristics of the depth module, the shooting quality problems caused by error in the depth module combination are solved, and higher-quality panoramic photo shooting is achieved.

CN115695679BActive Publication Date: 2024-11-22BEIJING YOUZHUJU NETWORK TECH CO LTD
View PDF 20 Cites 0 Cited by

Patent Information

Application Number
CN202211304233.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-10-24
Publication Date
2024-11-22
Estimated Expiration
2042-10-24

AI Technical Summary

Technical Problem

When taking panoramic photos, due to the limited field angle of a single depth module and the large absolute error between the depth modules, the depth point clouds of the triple combination are not neat, which reduces the shooting quality.

Method used

By determining the depth data of each module for multiple shooting distances in multiple depth modules, analyzing its error characteristics, and matching and arranging three matching depth modules according to the error characteristics to determine their relative positions, optimized Shooting quality.

Benefits of technology

The shooting quality of the triple depth module combination is improved, ensuring the neatness and shooting effect of the depth point cloud.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115695679B_ABST
    Figure CN115695679B_ABST
Patent Text Reader

Abstract

The present application discloses a triple depth module matching method and device, a mobile terminal, a medium and a chip, belonging to the field of module matching technology, wherein the triple depth module matching method comprises: determining the depth data of each depth module shooting at multiple shooting distances among multiple depth modules; determining the error characteristics of each depth module based on the multiple depth data; determining three mutually matching depth modules based on the error characteristics and determining the relative position of each depth module.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of module matching, and specifically relates to a triple depth module matching method, a triple depth module matching device, a mobile terminal, a readable storage medium and a chip. Background Art

[0002] With the development of technology, the technology of taking panoramic photos with VR cameras has gradually matured. However, when producing VR cameras, due to the limited field of view of a single depth module, three depth modules are usually spliced ​​together as the camera lens. However, for the depth modules, the individual differences in the absolute error of the depth captured are large. If the current triple combination is performed, the depth point cloud of the entire camera will be uneven, reducing the shooting quality. Summary of the invention

[0003] The purpose of the embodiments of the present application is to provide a triple depth module matching method and device, a mobile terminal, a readable storage medium and a chip, which can solve the problem of poor shooting quality caused by the error characteristics of each of the three depth modules when taking panoramic photos.

[0004] In a first aspect, an embodiment of the present application provides a triple depth module matching method, the method comprising: determining, among multiple depth modules, depth data of each depth module shooting at multiple shooting distances; determining an error characteristic of each depth module based on the multiple depth data; and determining three mutually matching depth modules based on the error characteristics and determining the relative position of each depth module.

[0005] In a second aspect, an embodiment of the present application provides a triple depth module matching device, comprising: a data detection module, used to determine the depth data of each depth module shooting at multiple shooting distances among multiple depth modules; an error determination module, used to determine the error characteristics of each depth module based on the multiple depth data; a matching module, used to determine three mutually matching depth modules based on the error characteristics and determine the relative position of each depth module.

[0006] In a third aspect, an embodiment of the present application provides a mobile terminal, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, and the program or instruction, when executed by the processor, implements the steps of the method of the first aspect.

[0007] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.

[0008] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the steps of the method of the first aspect.

[0009] In an embodiment of the present application, for multiple depth modules, it is first necessary to obtain the basic data of each depth module in order to facilitate subsequent screening, classification and matching. Specifically, each depth module is photographed at multiple shooting distances to obtain multiple depth data of the shots. Then, by analyzing the multiple depth data, the error characteristics of each depth module can be obtained, so that the multiple depth modules can be matched and selected according to the error characteristics of each depth module, and three matching depth modules and the relative positions of the combination can be determined to complete the matching.

[0010] It should be noted that for each depth module, multiple depth data will be generated according to different shooting distances. There are multiple depth data corresponding to each shooting distance. Based on the analysis of the depth data, the error characteristics of the depth module at a certain shooting distance can be determined, or the error characteristics of the depth module at any shooting distance can be determined, which makes it easier to classify the depth modules according to the error characteristics.

[0011] It can be understood that for the triple depth module, its relative position is divided into three positions: upper, middle and lower. The middle depth module detects a wider field of view, so the one with better shooting quality will be used as the middle shooting depth module. For the upper and lower positions, the quality requirements will be slightly lower than that of the middle depth module. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 A schematic diagram of the process of a triple depth module matching method according to an embodiment of the present application is shown;

[0013] Figure 2 A schematic diagram of the process of a triple depth module matching method according to an embodiment of the present application is shown;

[0014] Figure 3 A schematic diagram of the process of a triple depth module matching method according to an embodiment of the present application is shown;

[0015] Figure 4 A schematic diagram of the process of a triple depth module matching method according to an embodiment of the present application is shown;

[0016] Figure 5 A schematic diagram of the structure of a triple depth module matching device according to an embodiment of the present application is shown;

[0017] Figure 6A schematic diagram of the structure of a mobile terminal according to an embodiment of the present application is shown;

[0018] Figure 7 A schematic structural diagram of a mobile terminal according to an embodiment of the present application is shown.

[0019] in, Figures 5 to 7 The corresponding relationship between the reference numerals and the component names is as follows:

[0020] 100: mobile terminal; 101: radio frequency unit; 102: network module; 103: audio output unit; 104: input unit; 1041: graphics processor; 1042: microphone; 105: sensor; 106: display unit; 1061: display panel; 107: user input unit; 1071: touch panel; 1072: other input devices; 108: interface unit; 1109: memory; 1110: processor; 900: triple depth module matching device; 901: data detection module; 902: error determination module; 903: matching module. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0022] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0023] The following is combined with Figures 1 to 7 , the triple depth module matching method and device, mobile terminal, readable storage medium and chip provided in the embodiments of the present application are described in detail through specific embodiments and their application scenarios.

[0024] This embodiment provides a triple depth module matching method, such as Figure 1 As shown, including:

[0025] Step S102: determining depth data of each depth module shooting at multiple shooting distances among multiple depth modules;

[0026] Step S104: determining the error characteristics of each depth module according to the plurality of depth data;

[0027] Step S106: determining three mutually matching depth modules according to the error characteristics and determining the relative position of each depth module.

[0028] The triple depth module matching method provided in the present embodiment first needs to obtain the basic data of each depth module for the subsequent screening, classification and matching for the convenience of subsequent screening, classification and matching. Specifically, each depth module is photographed at multiple shooting distances to obtain multiple depth data of the photographs. Then, by analyzing the multiple depth data, the error characteristics of each depth module can be obtained, so that the multiple depth modules can be matched and selected according to the error characteristics of each depth module, and three matching depth modules and the relative positions of the combination can be determined to complete the matching.

[0029] It should be noted that for each depth module, multiple depth data will be generated according to different shooting distances. There are multiple depth data corresponding to each shooting distance. Based on the analysis of the depth data, the error characteristics of the depth module at a certain shooting distance can be determined, or the error characteristics of the depth module at any shooting distance can be determined, which makes it easier to classify the depth modules according to the error characteristics.

[0030] It can be understood that for the triple depth module, its relative position is divided into three positions: upper, middle and lower. The middle depth module detects a wider field of view, so the one with better shooting quality will be used as the middle shooting depth module. For the upper and lower positions, the quality requirements will be slightly lower than that of the middle depth module.

[0031] In a specific embodiment, the depth module needs to be powered on and preheated before shooting, so as to reduce the possibility of depth deflection caused by subsequent temperature influence.

[0032] Alternatively, if Figure 2 As shown, determining the depth data of each depth module shooting at multiple shooting distances in multiple depth modules specifically includes:

[0033] Step S1022: placing the depth module in the calibration space, shooting towards the wall at each shooting distance, and obtaining corresponding shooting images;

[0034] Step S1024: determining a plurality of sampling areas in the captured image;

[0035] Step S1026: Obtain depth data of the pixel points in each sampling area measured against the wall at the shooting distance.

[0036] When detecting the basic data of the depth module, the depth module is first placed in a pre-set calibration space. At this time, it will be placed away from the wall according to the preset shooting distance. At this time, the depth module is fixed in position and the wall is photographed to obtain a captured image. By analyzing the captured image, multiple sampling areas are first determined. By measuring the depth of the pixels in each sampling area, the absolute error of the sampling area of ​​each depth module can be obtained. On this basis, it is convenient to match multiple depth modules later.

[0037] It is understandable that the sampling area can be selected at a fixed or random location. It should be noted that the fixed sampling area reduces the probability that the data of multiple depth modules are affected by random factors, thereby improving the accuracy of error judgment for each depth module.

[0038] Alternatively, if Figure 3 As shown, further, multiple sampling areas are determined in the captured image, specifically including: Step S1025: determining an up-sampled image located above the image center of the captured image, a down-sampled image located below the image center, a left-sampled image located to the left of the image center, and a right-sampled image located to the right of the image center.

[0039] As for the selection of the sampling area, the up-sampled image, down-sampled image, left-sampled image and right-sampled image in the captured image can be determined respectively. For each sampling image, the depth parameter value measured at each pixel point can be averaged to realize the data judgment of the sampling image, which is convenient for the subsequent judgment of the absolute error of the entire depth module.

[0040] In a specific embodiment, the resolution of the captured image is 640×480. During processing, the image data of 50 pixels wide at the edge may be deleted first, retaining the position of 540×380, and a 50×50 range is selected in the central area directly above the center point as the up-sampled image, that is, the lower left corner of the captured image is used as the origin, the center point of the up-sampled image is (270, 285), the center point of the down-sampled image is (270, 95), the center point of the left sampled image is (135, 190), and the center point of the right sampled image is (405, 190).

[0041] Alternatively, if Figure 4As shown, the shooting distance includes a first distance and a second distance. According to a plurality of depth data, the error characteristics of each depth module are determined, specifically including: step S1042: determining a theoretical ratio of the first distance and the second distance and an actual ratio of the two depth data; step S1044: determining a deviation ratio between the theoretical ratio and the actual ratio.

[0042] In a specific embodiment, only basic measurements are performed on two distances, namely the first distance and the second distance. When the error characteristics are detected, the theoretical ratio is first obtained, namely the ratio of the first distance to the second distance. The depth module compares the actual depth data captured at the first distance and the second distance to generate an actual ratio. By comparing the actual ratio with the theoretical ratio, the relevant parameters corresponding to the absolute error of the depth module, namely the deviation ratio, can be obtained.

[0043] In a specific embodiment, the first distance is 3m, the second distance is 1m, and the theoretical ratio is 3:1. If the actual ratio is 2.7:1, the deviation ratio is 90%. If the actual ratio is 3.3:1, the deviation ratio is 110%.

[0044] Furthermore, three depth modules that match each other are determined according to the error characteristics and the relative position of each depth module is determined, specifically including: screening a depth module whose deviation ratio satisfies a first ratio range among multiple depth modules; determining three depth modules with closest differences according to the deviation ratio; placing the one with the best deviation ratio among the three depth modules in the middle, the worst one at the bottom, and the remaining one at the top.

[0045] When finally selecting three matching depth modules and their specific placement positions, a preliminary screening will be carried out first, that is, only the depth modules whose deviation ratio meets the first ratio range will be retained among multiple depth modules, so that the depth modules with large absolute errors and that do not meet the depth module selection requirements can be eliminated. On this basis, the three closest depth modules are matched into a group according to the specific deviation ratio for installation. During installation, there will also be position selection, that is, which depth module is placed in the middle, top and bottom. From the perspective of shooting requirements, the depth module in the middle has the widest field of view, and most users will pay attention to the shooting effect within this field of view. Therefore, the one with the best deviation ratio, that is, the one closest to 100%, is placed in the middle, the worst one is placed at the bottom to shoot towards the ceiling, and the remaining one is placed at the top to shoot the ground.

[0046] In a specific embodiment, the first ratio ranges from 90% to 110%, and depth modules with a ratio less than 90% or greater than 110% will be eliminated.

[0047] like Figure 5As shown, the embodiment of the present application provides a triple depth module matching device 900. The triple depth module matching device includes a data detection module 901, an error determination module 902, and a matching module 903.

[0048] Among them, the data detection module 901 is used to determine the depth data of each depth module shooting at multiple shooting distances among multiple depth modules; the error determination module 902 is used to determine the error characteristics of each depth module based on the multiple depth data; the matching module 903 is used to determine three mutually matching depth modules based on the error characteristics and determine the relative position of each depth module.

[0049] Optionally, the data detection module is also used to place the depth module in a calibration space, shoot towards the wall at each shooting distance, and obtain corresponding captured images; determine multiple sampling areas in the captured images; and obtain depth data measured by pixel points in each sampling area relative to the wall at the shooting distance.

[0050] Optionally, the data detection module is also used to determine an up-sampled image located above the image center of the captured image, a down-sampled image located below the image center, a left-sampled image located to the left of the image center, and a right-sampled image located to the right of the image center.

[0051] Optionally, the error determination module is used to determine a theoretical ratio of the first distance to the second distance and an actual ratio of two depth data; and determine a deviation ratio between the theoretical ratio and the actual ratio.

[0052] Optionally, the matching module is also used to screen a depth module whose deviation ratio satisfies a first ratio range from multiple depth modules; determine three depth modules with closest differences according to the deviation ratio; place the one with the best deviation ratio among the three depth modules in the middle, the worst one at the bottom, and the remaining one at the top.

[0053] The triple depth module matching device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile terminal or a non-mobile terminal. Exemplarily, the mobile terminal can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted mobile terminal, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile terminal can be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0054] The triple depth module matching device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0055] The triple depth module matching device provided in the embodiment of the present application can achieve Figures 1 to 4 To avoid repetition, the various processes implemented by the method embodiment are not described here.

[0056] Alternatively, if Figure 6 As shown, an embodiment of the present application also provides a mobile terminal 100, including a processor 1110, a memory 1109, and a program or instruction stored in the memory 1109 and executable on the processor 1110. When the program or instruction is executed by the processor 1110, each process of the embodiment of the above-mentioned triple depth module matching method is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0057] It should be noted that the mobile terminal in the embodiments of the present application includes the above-mentioned mobile terminal and non-mobile terminal.

[0058] Figure 7 A schematic diagram of the hardware structure of a mobile terminal for implementing an embodiment of the present application.

[0059] The mobile terminal 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 1109, and a processor 1110.

[0060] Those skilled in the art will appreciate that the mobile terminal 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Figure 7 The mobile terminal structure shown in the figure does not constitute a limitation on the mobile terminal. The mobile terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0061] Among them, the processor 1110 is used to determine the depth data of each depth module shooting at multiple shooting distances in multiple depth modules; determine the error characteristics of each depth module based on the multiple depth data; determine three mutually matching depth modules based on the error characteristics and determine the relative position of each depth module.

[0062] Through the above scheme, for multiple depth modules, it is first necessary to obtain the basic data of each depth module in order to facilitate subsequent screening, classification and matching. Specifically, each depth module is photographed at multiple shooting distances to obtain multiple depth data of the shots. Then, by analyzing the multiple depth data, the error characteristics of each depth module can be obtained, so that the multiple depth modules can be matched and selected according to the error characteristics of each depth module, and three matching depth modules and the relative positions of the combination can be determined to complete the matching.

[0063] Optionally, the processor 1110 is also used to implement the following steps: placing the depth module in a calibration space, shooting towards the wall at each shooting distance, and obtaining corresponding captured images; determining multiple sampling areas in the captured images; and obtaining depth data measured by the pixel points in each sampling area relative to the wall at the shooting distance.

[0064] Optionally, the processor 1110 is further used to determine an up-sampled image located above the image center of the captured image, a down-sampled image located below the image center, a left-sampled image located to the left of the image center, and a right-sampled image located to the right of the image center.

[0065] Optionally, the processor 1110 is further configured to determine a theoretical ratio of the first distance to the second distance and an actual ratio of two depth data; and determine a deviation ratio between the theoretical ratio and the actual ratio.

[0066] Optionally, the processor 1110 is further used to screen a depth module whose deviation ratio satisfies a first ratio range from multiple depth modules; determine three depth modules with closest differences according to the deviation ratio; place the one with the best deviation ratio among the three depth modules in the middle, the worst one at the bottom, and the remaining one at the top.

[0067] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 1109 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 1110 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1110.

[0068] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned triple depth module matching method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0069] The processor is the processor in the mobile terminal in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0070] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned triple depth module matching method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0071] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0072] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0073] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0074] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A triple depth module matching method, characterized in that: include: Determine, among a plurality of depth modules, depth data of each depth module photographed at a plurality of photographing distances, wherein each of the photographing distances corresponds to a plurality of the depth data; Determining an error characteristic of each of the depth modules according to the plurality of depth data; Determine three mutually matching depth modules according to the error characteristic and determine the relative position of each depth module; The error characteristic is an absolute error of the depth module during shooting, and the absolute errors of three mutually matching depth modules are close.

2. The triple depth module matching method according to claim 1, characterized in that: The step of determining the depth data of each depth module photographing at multiple shooting distances among the multiple depth modules specifically includes: The depth module is placed in the calibration space, and is photographed toward each wall at the shooting distance to obtain a corresponding photographed image; determining a plurality of sampling areas in the captured image; Depth data of each pixel point in the sampling area measured against the wall at the shooting distance is obtained.

3. The triple depth module matching method according to claim 2, characterized in that: The determining of a plurality of sampling areas in the captured image specifically includes: An up-sampled image located above the image center of the captured image, a down-sampled image located below the image center, a left-sampled image located to the left of the image center, and a right-sampled image located to the right of the image center are determined.

4. The triple depth module matching method according to any one of claims 1 to 3, characterized in that: The shooting distance includes a first distance and a second distance, and determining the error characteristics of each of the depth modules according to the plurality of depth data specifically includes: Determine a theoretical ratio of the first distance to the second distance and an actual ratio of the two depth data; The deviation ratio between the theoretical ratio and the actual ratio is determined.

5. The triple depth module matching method according to claim 4, characterized in that: Determining three mutually matching depth modules according to the error characteristics and determining the relative position of each depth module specifically includes: Selecting a depth module whose deviation ratio satisfies a first ratio range from the plurality of depth modules; Determine the three depth modules with the closest difference values ​​according to the deviation ratio; The one with the best deviation ratio among the three depth modules is placed in the middle, the worst one is placed at the bottom, and the remaining one is placed at the top.

6. A triple depth module matching device, characterized in that: include: A data detection module, used for determining, among a plurality of depth modules, depth data captured by each depth module at a plurality of shooting distances; An error determination module, used for determining an error characteristic of each of the depth modules according to a plurality of depth data; A matching module, used for determining three mutually matching depth modules according to the error characteristic and determining a relative position of each of the depth modules; The error characteristic is an absolute error of the depth module during shooting, and the absolute errors of three mutually matching depth modules are close.

7. The triple depth module matching device according to claim 6, characterized in that: The data detection module is also used to place the depth module in a calibration space, shoot towards each wall at the shooting distance, and obtain a corresponding captured image; determine multiple sampling areas in the captured image; and obtain depth data measured by pixel points in each sampling area against the wall at the shooting distance.

8. The triple depth module matching device according to claim 7, characterized in that: The data detection module is also used to determine an up-sampled image located above the image center of the captured image, a down-sampled image located below the image center, a left-sampled image located to the left of the image center, and a right-sampled image located to the right of the image center.

9. The triple depth module matching device according to any one of claims 6 to 8, characterized in that: The shooting distance includes a first distance and a second distance, and the error determination module is used to determine a theoretical ratio of the first distance to the second distance and an actual ratio of the two depth data; and determine a deviation ratio between the theoretical ratio and the actual ratio.

10. The triple depth module matching device according to claim 9, characterized in that: The matching module is also used to screen a depth module whose deviation ratio satisfies a first ratio range from the multiple depth modules; determine three depth modules with closest differences according to the deviation ratio; and place the one with the best deviation ratio among the three depth modules in the middle, the worst one at the bottom, and the remaining one at the top.

11. A mobile terminal, characterized in that: It includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the triple depth module matching method as described in any one of claims 1 to 5.

12. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by the processor, the steps of the triple depth module matching method as described in any one of claims 1 to 5 are implemented.

13. A chip, characterized in that: The chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the steps of the triple depth module matching method as described in any one of claims 1 to 5.

Citation Information

Patent Citations

  • Double-pick-up-head assembling method

    CN106873112A

  • Detection method and device, electronic device, computer equipment and readable storage medium

    CN108931202A

  • Detection method and apparatus, terminal, computer device and readable storage medium

    CN108965525A

  • Camera calibration method and device, electronic equipment and computer readable storage medium

    CN109598763A

  • Automatic depth information camera module precision detection system and precision detection method thereof

    CN109990734A