Terminal device and shooting method

Abstract

The embodiment of the invention provides terminal equipment and a shooting method, and is applied to the technical field of shooting imaging. The terminal equipment comprises a camera module and a radar module. And the radar module and the camera module are arranged on the same side surface of the equipment body of the terminal equipment. The radar module is provided with a plurality of signal emission direction areas. The terminal equipment is used for transmitting a first signal to the first signal transmitting direction area based on the radar module when the camera module performs shooting. Receiving a first echo signal, wherein the first echo signal corresponds to the first signal; and transmitting a second signal to at least one second signal transmitting direction area based on the radar module, wherein the at least one second signal transmitting direction area is partially overlapped or not overlapped with the first signal transmitting direction area. And receiving a second echo signal, wherein the second echo signal corresponds to the second signal. And adjusting shooting parameters of the camera module according to the first echo signal and the second echo signal. According to the embodiment of the invention, the shooting quality of the terminal equipment is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of photographing imaging technology, and in particular to a terminal device and a photographing method. BACKGROUND

[0002] A camera module can be usually arranged on a terminal device. Based on the camera module, a photographing imaging area required by a user can be photographed to obtain a photographing image or a video of the photographing imaging area. The photographing imaging area is a three-dimensional space area. There are different relative distances and relative angles between objects existing in the three-dimensional space area and the camera module. The camera module is provided with a photographing adjustment structure for adjusting photographing parameters, such as a focusing motor and an aperture. In actual photographing, the terminal device needs to detect a to-be-photographed target in a target photographing area and adjust the photographing parameters of the camera module according to the detection result. Therefore, in actual photographing, the detection accuracy of the to-be-photographed target determines the photographing quality of the photographing image or the video to a great extent. In actual application, the photographing imaging area of the camera module has uncertainty. Different photographing imaging areas in different photographing scenes require different photographing parameters. However, how to accurately detect the to-be-photographed target in a complex and changing photographing scene is a difficult problem. SUMMARY

[0003] Embodiments of the present application provide a terminal device and a photographing method, which improve the detection accuracy of a to-be-photographed target in a complex and changing photographing scene.

[0004] To achieve the above object, embodiments of the present application adopt the following technical solutions:

[0005] In a first aspect, a terminal device is provided, which includes a camera module and a radar module. The radar module and the camera module are arranged on the same side of a device body of the terminal device. The radar module has a plurality of signal emission direction areas. The terminal device is configured to: when the camera module is photographing, emit a first signal to a first signal emission direction area based on the radar module; receive a first echo signal corresponding to the first signal; emit a second signal to at least one second signal emission direction area based on the radar module, the at least one second signal emission direction area partially overlapping or not overlapping with the first signal emission direction area; receive a second echo signal corresponding to the second signal; and adjust photographing parameters of the camera module according to the first echo signal and the second echo signal.

[0006] To address the limitation of existing technologies in accurately detecting targets in complex scenarios, this embodiment adds a second signal transmission process to the existing method of using a narrow-beam first signal for detection in the first signal transmission direction region. The second signal is transmitted towards other second signal transmission direction regions. Multiple second signals can be used to obtain second echo signals about these other second signal transmission direction regions. First, global parameters of the imaging region can be constructed based on the multiple second echo signals and the first echo signal. Second, although the multiple second signals are transmitted towards other second signal transmission direction regions, they also, to some extent, reach the first signal transmission direction region. By fusing the first echo signal with the second echo signals corresponding to the multiple second signals, interference noise can be removed from the first echo signal, and coherence enhancement of the echo signal can be achieved. Furthermore, the first and second signals have a certain time difference in transmission. Based on the first and second echo signals, more detection information about the imaging region can be obtained to meet the requirements for accurate target detection. Finally, the radar module detects the target based on electromagnetic wave signals. Compared to laser signals, electromagnetic waves have a wider coverage area and stronger penetrating power, and can detect more types of parameters. Laser signals can only detect distance to assist in focusing, while radar modules can measure distance, speed, and angle. Laser signals have poor penetrating power, while electromagnetic waves attenuate after passing through a target. However, with optimization measures, such as improving the accuracy of algorithm processing or the detection accuracy of echo signals, electromagnetic waves can still assist in target detection even after penetrating multiple targets. Therefore, compared to using laser sensors for ranging adjustment, using radar modules to emit first and second signals can obtain more detection information about the target while improving detection accuracy, enabling adjustments to shooting parameters in more complex and changing scenarios.

[0007] In one possible implementation, shooting parameters may include focal length and exposure parameters. Shooting scenes may also include night scene mode, single-target mode, multi-target mode, macro mode, and sports mode, etc. The following are some common examples:

[0008] In one example, the shooting parameters include focal length. The aforementioned adjustment of the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when a first target exists within the area in the direction of the first signal transmission, adjusting the focal length of the camera module based on the first echo signal and the second echo signal to focus on the first target. In this embodiment, when a first target exists within the area in the direction of the first signal transmission, the first target can be detected based on the first echo signal and the second echo signal, and the focal length with respect to the first target can be adjusted based on the detection result to achieve focusing.

[0009] In one example, in a multi-target mode scenario, adjusting the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when multiple first targets exist within the area of ​​the first signal transmission direction, adjusting the camera module's focal length based on the first echo signal and the second echo signal to focus on at least one of the multiple first targets. In this embodiment, in a multi-target scenario, if multiple first targets exist within the area of ​​the first signal transmission direction, the detection of multiple first targets can be achieved based on the first echo signal and the second echo signal, and the focal length about at least one first target can be adjusted based on the detection results to achieve focusing. Specifically, in practical applications, the terminal device can determine which of the multiple first targets to focus on based on different algorithms. For example, it can focus on a human body among the multiple first targets instead of other non-human bodies based on a human body recognition algorithm; it can also focus on the closest first target among the multiple first targets based on an algorithm; or it can focus on all the first targets among the multiple first targets, etc. This embodiment does not limit this approach.

[0010] In one example, when in a multi-target mode scenario, adjusting the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when a first target exists in the area of ​​the first signal transmission direction and at least one second target exists in at least one area of ​​the second signal transmission direction, adjusting the camera module's focal length based on the first echo signal and the second echo signal to focus on the first target and at least one second target. In this embodiment, emitting only the first signal allows detection of the first target within the area of ​​the first signal transmission direction. However, combining the second signal allows detection of other areas of the second signal transmission direction outside the area of ​​the first signal transmission direction. Based on the first echo signal and the second echo signal, detection of at least one second target can be achieved. According to the design of the terminal device, in a multi-target mode scenario where both the first and second targets are detected, focus adjustment can be performed on both targets.

[0011] In one example, when in a motion mode scenario (including at least one of terminal device movement and target movement), adjusting the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when the first target or terminal device is in motion, dynamically adjusting the camera module's focal length based on the first echo signal and the second echo signal to continuously focus on the first target for a period of time. In this embodiment, when in a motion mode scenario, the first echo signal and the second echo signal can be used to detect parameters such as changes in the target's speed, relative movement angle, and relative distance, thereby calculating or predicting the focus value of the moving first target. Based on the obtained results, the focal length is dynamically adjusted over a period of time to achieve continuous focusing in a motion scenario. For example, dynamically adjusting the camera module's focal length means that, over a period of time, as the relative distance between the first target and the terminal device changes by a amount greater than a certain value, the focus value of the camera module's focusing motor also changes. Continuous focusing means that, over a period of time, based on the aforementioned dynamic adjustment of the camera module's focal length, the focus value of the camera module's focusing motor changes more than once. Two adjacent focus values ​​correspond to different captured images, and among the captured images corresponding to different focus values, the difference in image sharpness of the first target is within a certain error range.

[0012] In one example, the terminal device also includes a laser sensor. When in a night scene mode, adjusting the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when the brightness of the area captured by the camera module is lower than a brightness threshold, adjusting the camera module's focal length based on the laser sensor's sensing data, the first echo signal, and the second echo signal to focus on the first target. In this embodiment, in a night scene, the camera module can also be adjusted using the laser sensor's sensing data, the first echo signal, and the second echo signal to check parameters such as the relative distance to the first target, thereby improving detection accuracy and better adjusting shooting parameters such as the focal length.

[0013] In one example, the shooting parameters include exposure parameters. When in a motion mode scenario, adjusting the camera module's shooting parameters based on the first echo signal and the second echo signal includes: dynamically adjusting the camera module's exposure parameters based on the first echo signal and the second echo signal when the first target or terminal device is in motion. In this embodiment, when in a motion mode scenario, the captured image may exhibit fluctuating brightness due to changes in the relative position between the first target and the terminal device. In this case, by detecting information about the first target and the current shooting environment based on the first and second echo signals, the exposure parameters can be adjusted during motion to improve shooting quality.

[0014] In one possible implementation, the terminal device is further configured to: determine or update the first signal transmission direction area in response to user input. In this embodiment, the user can determine or update the first signal transmission direction area according to their actual shooting needs, in order to achieve higher quality shooting results that meet the user's requirements.

[0015] In one possible implementation, the radar module includes at least one transmitting antenna and at least one receiving antenna; the at least one transmitting antenna is used to transmit a first signal and a second signal; the at least one receiving antenna is used to receive a first echo signal and a second echo signal. The first echo signal is an echo signal generated by the reflection of the first signal from an object located in the region where the first signal is transmitted, and the second echo signal is an echo signal generated by the reflection of the second signal from an object located in the region where the second signal is transmitted. In this embodiment, the radar module can transmit the first signal and the second signal based on the transmitting antenna. When the first signal is transmitted to the region where the first signal is transmitted, it will generate a corresponding first echo signal due to reflection from an object located in the region where the first signal is transmitted. Similarly, a corresponding second echo signal can also be generated based on the second signal. The terminal device can receive the first echo signal and the second echo signal based on the receiving antenna.

[0016] Exemplarily, a camera module, at least one transmitting antenna, or at least one receiving antenna is disposed on the back cover of the terminal device. In embodiments of this application, a camera module can typically be designed on the back cover side of the terminal device to perform shooting when the terminal device is in use. In this case, at least one transmitting antenna and at least one receiving antenna can be disposed on the back cover of the terminal device.

[0017] For example, the relative distance between any two of the camera module, at least one transmitting antenna, and at least one receiving antenna on the back cover of the terminal device is less than half the length of the back cover. In practical applications, the correspondence between the imaging area of ​​the camera module and multiple signal transmission direction areas of the transmitting antenna is usually preset in the terminal device. The physical distance between the camera module and the transmitting antenna can be set closer. In this way, the conversion between the imaging area of ​​the camera module and the signal transmission direction areas of the transmitting antenna can be more easily calculated. In addition, setting the transmitting antenna, receiving antenna, and camera module closer together also makes it easier to realize the conversion between the received echo signal and the transmitted signal, as well as the conversion between the received echo signal and the imaging area. For example, the transmitting antenna, receiving antenna, and camera module can all be set in the upper half of the back cover of the terminal device.

[0018] In one possible implementation, the transmitting antenna includes a switching circuit structure; the terminal device is also used to: switch the signal transmission direction region of at least one transmitting antenna by means of the switching circuit structure.

[0019] In one example, the radar module includes at least one transmitting antenna. A transmitting antenna may include multiple antenna stubs (i.e., multiple radiators), and these multiple antenna stubs may correspond to multiple different signal transmission direction regions. In this case, a switching circuit structure is connected to multiple antenna stubs of the same transmitting antenna. The switching circuit structure is used to switch between different antenna stubs of the same transmitting antenna to switch the signal transmission direction region of at least one transmitting antenna. Furthermore, one or more transmitting antennas may be provided in the radar module.

[0020] In another example, the radar module includes multiple transmitting antennas and a phase-shifting network. The multiple transmitting antennas are connected to a signal transmission channel via the phase-shifting network. Within the terminal device, the signal transmission channel provides a first signal or a second signal. After the first or second signal undergoes phase-shifting processing by the phase-shifting network, the phase-shifted multiple first or second signals are transmitted to the multiple transmitting antennas. Each of the multiple transmitting antennas can transmit the first signal followed by the second signal of the corresponding phase. The multiple transmitting antennas can form radio frequency (RF) signal clusters from the transmitted multiple first or second signals based on beamforming principles, thus directing the transmitted first or second signals towards a specific signal transmission direction area. During this process, the RF signal clusters generated by multiple first or second signals of different phases have different directions. At this point, a switching circuit structure is connected to the phase-shifting network, and this switching circuit structure is used to change the phase-shifting network to switch the signal transmission direction areas of the multiple transmitting antennas.

[0021] In another example, the radar module includes at least one transmitting antenna. Each transmitting antenna includes a radiator, a grounding structure, and a feeding structure. A switching circuit structure is connected to the feeding structure of the transmitting antenna, and the switching circuit structure is used to switch the feeding mode of the transmitting antenna to switch the signal transmission direction area of ​​at least one transmitting antenna. Alternatively, the switching circuit structure is connected to the grounding structure. The switching circuit structure is used to switch the grounding mode of the transmitting antenna to switch the signal transmission direction area of ​​at least one transmitting antenna.

[0022] In one possible implementation, multiple signal transmission direction regions correspond to multiple imaging sub-regions within the imaging area of ​​the camera module. In this embodiment, when the relative positions of the camera module's lens and the radar module are fixed, each signal transmission direction region of the radar module corresponds to a fixed position within the imaging area of ​​the camera module. The multiple signal transmission direction regions of the radar module can correspond to different sub-regions of the imaging area; in actual shooting, switching between signal transmission direction regions only requires considering a determined first signal transmission direction region. Exemplarily, multiple signal transmission direction regions can correspond one-to-one with multiple sub-regions (including a first signal transmission direction region and at least one second signal transmission direction region). Exemplarily, each signal transmission direction region can also correspond to more than one sub-region, or one sub-region can correspond to more than one signal transmission direction region.

[0023] Secondly, embodiments of this application also provide a shooting method applied to a terminal device, the terminal device including a camera module and a radar module. The radar module and the camera module are disposed on the same side of the device body of the terminal device. The radar module has multiple signal transmission direction areas. The method includes: when the camera module is shooting, transmitting a first signal to a first signal transmission direction area based on the radar module; receiving a first echo signal, the first echo signal corresponding to the first signal; transmitting a second signal to at least one second signal transmission direction area based on the radar module, the at least one second signal transmission direction area partially overlapping or not overlapping with the first signal transmission direction area; receiving a second echo signal, the second echo signal corresponding to the second signal; and adjusting the shooting parameters of the camera module according to the first echo signal and the second echo signal.

[0024] In one example, the shooting parameters include focal length. The aforementioned adjustment of the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when a first target exists within the area in the direction of the first signal transmission, adjusting the camera module's focal length based on the first echo signal and the second echo signal to focus on the first target.

[0025] In one example, adjusting the shooting parameters of the camera module according to the first echo signal and the second echo signal includes: when there are multiple first targets in the area of ​​the first signal transmission direction, adjusting the focal length of the camera module according to the first echo signal and the second echo signal to focus on at least one of the multiple first targets.

[0026] In one example, adjusting the shooting parameters of the camera module according to the first echo signal and the second echo signal includes: when there is a first target in the area of ​​the first signal transmission direction and at least one second target in the area of ​​at least one second signal transmission direction, adjusting the focal length of the camera module according to the first echo signal and the second echo signal to focus on the first target and at least one second target.

[0027] In one possible implementation, the above-mentioned adjustment of the focal length of the camera module according to the first echo signal and the second echo signal to focus on the first target includes: when the first target or terminal device is in motion, dynamically adjusting the focal length of the camera module according to the first echo signal and the second echo signal to continuously focus on the first target for a period of time.

[0028] In one possible implementation, the terminal device further includes a laser sensor. The aforementioned adjustment of the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when the brightness of the area to be captured by the camera module is lower than a brightness threshold, adjusting the focal length of the camera module based on the sensing data from the laser sensor, the first echo signal, and the second echo signal to focus on the first target.

[0029] In one possible implementation, the shooting parameters include exposure parameters. The aforementioned adjustment of the camera module's shooting parameters based on the first echo signal and the second echo signal includes: dynamically adjusting the camera module's exposure parameters based on the first echo signal and the second echo signal when the first target or terminal device is in motion.

[0030] In one possible implementation, the method further includes: determining or updating a first signal transmission direction region in response to user input.

[0031] In one possible implementation, the first echo signal is an echo signal generated by the reflection of a first signal by an object located in the region where the first signal is emitted, and the second echo signal is an echo signal generated by the reflection of a second signal by an object located in the region where the second signal is emitted.

[0032] In one possible implementation, the terminal device further includes a display screen. The method further includes: controlling the camera module to frame an image of the captured area in response to a first operation acting on the display screen. Multiple signal transmission direction areas respectively correspond to multiple sub-regions within the captured image area of ​​the camera module. An image of the captured area is displayed on the display screen, and a target frame is also displayed on the display screen to select the corresponding first signal transmission direction area within the captured image area.

[0033] Thirdly, embodiments of this application also provide a shooting method applied to a terminal device, the terminal device including a display screen, a camera module, and a radar module. The radar module has multiple signal transmission direction areas. The method includes: responding to a first operation acting on the display screen, controlling the camera module to frame an imaging area, and displaying an image of the imaging area on the display screen, the display screen also displaying a target frame used to select the first signal transmission direction area in the imaging area; transmitting a first signal from the radar module to the first signal transmission direction area in the imaging area of ​​the camera module; receiving a first echo signal, the first echo signal corresponding to the first signal; transmitting a second signal from the radar module to at least one second signal transmission direction area; receiving a second echo signal, the second echo signal corresponding to the second signal; and adjusting the shooting parameters of the camera module according to the first echo signal and the second echo signal.

[0034] In one example, the shooting parameters include focal length. The aforementioned adjustment of the camera module's shooting parameters based on the first echo signal and the second echo signal includes: when a first target exists within the area in the direction of the first signal transmission, adjusting the camera module's focal length based on the first echo signal and the second echo signal to focus on the first target.

[0035] In one example, a first mode selection option is also displayed on the screen. The aforementioned adjustment of the camera module's shooting parameters based on the first echo signal and the second echo signal includes: in response to the selection operation of the first mode selection option, when there are multiple first targets in the first signal transmission direction area, adjusting the focal length of the camera module based on the first echo signal and the second echo signal to focus on at least one of the multiple first targets.

[0036] In one example, a first mode selection option is also displayed on the screen. The above-mentioned adjustment of the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: in response to the selection operation of the first mode selection option, when at least one second target exists in at least one of the at least two second signal transmission direction regions, adjusting the focal length of the camera module based on the first echo signal and the second echo signal to focus on the first target and at least one second target.

[0037] In one example, a second mode selection option is also displayed on the screen. The above-mentioned adjustment of the camera module's focal length to focus on the first target based on the first echo signal and the second echo signal includes: in response to the selection operation of the second mode selection option, when the first target or terminal device is in motion, dynamically adjusting the camera module's focal length based on the first echo signal and the second echo signal to continuously focus on the first target for a period of time.

[0038] In one example, a third mode selection option is also displayed on the screen. The terminal device also includes a laser sensor. The aforementioned adjustment of the camera module's focal length to focus on the first target based on the first echo signal and the second echo signal includes: in response to the selection operation of the third mode selection option, when the brightness of the area to be captured is lower than a brightness threshold, adjusting the camera module's focal length to focus on the first target based on the sensing data of the laser sensor, the first echo signal, and the second echo signal.

[0039] In one example, the shooting parameters include exposure parameters. A second mode selection option is displayed on the screen. The above-mentioned adjustment of the camera module's focal length to focus on the first target based on the first echo signal and the second echo signal includes: in response to the selection operation of the second mode selection option, when the first target or terminal device is in motion, dynamically adjusting the exposure parameters of the camera module based on the first echo signal and the second echo signal.

[0040] In one possible implementation, the method further includes: determining or updating a first signal transmission direction region in response to user input on a display screen.

[0041] Fourthly, embodiments of this application also provide a computer-readable storage medium including instructions that, when executed on a terminal device, cause the terminal device to perform the shooting method as described in the second aspect above, or to perform the shooting method as described in the third aspect above.

[0042] The technical principles and beneficial effects of the second, third and fourth aspects mentioned above can be referred to the relevant description of the first aspect above, and will not be repeated here. Attached Figure Description

[0043] Figure 1 This is a schematic diagram of the structure of a first terminal device provided in an embodiment of this application;

[0044] Figure 2 A schematic diagram of the structure of a second terminal device provided in this application embodiment. Figure 1 ;

[0045] Figure 3 This is a schematic diagram illustrating a second terminal device performing target detection in a region where the signal transmission direction is switched, as provided in an embodiment of this application.

[0046] Figure 4 A schematic diagram of the structure of a second terminal device provided in this application embodiment. Figure 2 ;

[0047] Figure 5 A schematic diagram of the structure of a second terminal device provided in this application embodiment. Figure 3 ;

[0048] Figure 6 A schematic diagram of the structure of a second terminal device provided in this application embodiment. Figure 4 ;

[0049] Figure 7 A schematic diagram of the structure of a second terminal device provided in this application embodiment. Figure 5 ;

[0050] Figure 8 A schematic diagram of the structure of a second terminal device provided in this application embodiment. Figure 6 ;

[0051] Figure 9 A schematic diagram of an imaging target frame on the display screen of a second terminal device provided in an embodiment of this application;

[0052] Figure 10 A schematic flowchart illustrating a shooting method provided in an embodiment of this application;

[0053] Figure 11 A schematic diagram of the interface operation of a shooting method provided in this application embodiment. Figure 1 ;

[0054] Figure 12 A schematic diagram of target detection intensity based on a first echo signal and a second echo signal, provided as an embodiment of this application;

[0055] Figure 13 A schematic diagram of the interface operation of a shooting method provided in this application embodiment. Figure 2 ;

[0056] Figure 14 This application provides a schematic diagram of the control flow of a second terminal device according to an embodiment of the present application.

[0057] Figure 15 A schematic diagram of the interface operation of a shooting method provided in this application embodiment. Figure 3 ;

[0058] Figure 16 This application provides a schematic diagram of a control flow for a second terminal device to perform cyclic detection based on a configured target frame, as shown in the embodiments of this application.

[0059] Figure 17 A schematic diagram of the interface operation of a shooting method provided in this application embodiment. Figure 4 . Detailed Implementation

[0060] It should be noted that the terms "first" and "second" used in the embodiments of this application are only used to distinguish features of the same type and should not be construed as indicating relative importance, quantity, order, etc.

[0061] The terms "exemplary" or "for example" used in the embodiments of this application are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0062] The terms "coupling" and "connection" used in the embodiments of this application should be interpreted broadly. For example, they can refer to a physical direct connection or an indirect connection implemented through electronic devices, such as a connection implemented through a resistor, inductor, capacitor, transmission line, coupler or other electronic devices.

[0063] First, some basic concepts involved in the embodiments of this application will be explained:

[0064] Radar is a technology that uses electromagnetic waves for detection and measurement. It detects the position, velocity, direction, and other characteristics of a target by emitting electromagnetic waves and receiving their reflected signals. Radar detection technology, used for detecting single or multiple targets, is widely applied in many fields. The working principle of radar utilizes the propagation characteristics of electromagnetic waves in space. When the emitted electromagnetic wave encounters a target, some of its energy is absorbed or reflected back. After receiving the reflected signal, the target's position, velocity, and other characteristics can be determined by measuring information such as the signal's time delay, frequency changes, and amplitude changes. Depending on the application, radar can emit electromagnetic wave signals in different frequency bands, as long as they comply with relevant frequency band specifications. Similar to communication equipment, radar typically requires a transmitter (or transmitting antenna) to emit electromagnetic wave signals and a receiver (or receiving antenna) to receive them. However, in communication equipment, the transmitting antenna emits a first electromagnetic wave signal towards the target communication device; this first electromagnetic wave signal carries the communication information transmitted from the communication device to the target communication device. The communication device receives a second electromagnetic wave signal from the target communication device via a receiving antenna. This second electromagnetic wave signal carries the communication information transmitted from the target communication device to the communication device. Therefore, in scenarios where communication is based on electromagnetic wave signals, the electromagnetic wave signal received by the communication device originates from an external signal source. However, in radar detection applications, the received electromagnetic wave signal is the echo signal generated by the reflection of the electromagnetic wave signal emitted by the radar device itself from the target. This electromagnetic wave signal is generated by the radar device itself as a signal source and does not depend on an external signal source.

[0065] For example, to improve the target detection accuracy of radar, some related technologies have improved the radar signal transmission method: First, a wide-beam first detection signal is emitted by the radar, and the signal transmission direction area of ​​this wide-beam signal covers a large area. Detection is performed on the large coverage area based on the first detection signal. The first detection signal will generate an echo signal due to reflection from objects within the coverage area. Therefore, after receiving the echo signal of the first detection signal, if the signal strength of the echo signal returned from a certain sub-region covered by the first detection signal is greater than a certain value, it indicates that there is a certain object in that sub-region, and this sub-region can be designated as a region of interest. One or more regions of interest can be obtained through the detection processing based on the echo signal of the first detection signal. Then, a narrow-beam second detection signal can be emitted for each different region of interest. The narrower signal coverage of the second detection signal results in higher detection accuracy of its echo signal. By using the echo signal of each second detection signal to perform more precise detection on the corresponding region of interest, target detection within the region of interest can be achieved. During target detection, the echo signals of multiple second detection signals can be time-domain stitched together. This time-domain stitching yields a fused signal that is temporally correlated. The amplitude of the echo signal is increased by using this fused signal. Furthermore, the beam range of the second detection signal can be narrowed, and the signal can be transmitted multiple times to achieve more precise target detection within the region of interest.

[0066] Regarding the signal transmission direction area, it can be understood that a radar transmitting antenna can transmit radio frequency (RF) signals within a certain range, but the signal strength varies within that range. If a certain signal strength threshold is set, it's possible to detect RF signals with higher signal strength emitted by the radar transmitting antenna into a concentrated directional area. Since radar target detection requires specific signal strength for both the transmitted and echo signals, the RF signals with higher signal strength emitted by the radar transmitting antenna within a concentrated directional area can be considered valid transmission signals. Based on this, we can determine the signal transmission direction area of ​​the transmitting antenna based on the radiation direction and intensity of the radar's transmitted signal.

[0067] This application provides a terminal device, which typically includes a camera module. The camera module captures images or videos of a desired imaging area, resulting in a three-dimensional spatial region. Objects within this three-dimensional spatial region have different relative distances and angles to the camera module. The camera module incorporates shooting adjustment structures, such as a focus motor and aperture, for adjusting shooting parameters. By adjusting the parameters of these shooting adjustment structures, the shooting parameters of the captured image or video can be adjusted.

[0068] During actual shooting, the terminal device needs to detect the target within the target shooting area and adjust the camera module's shooting parameters based on the detection results. Therefore, in actual shooting, the accuracy of target detection largely determines the quality of the captured image or video. However, in practical applications, the imaging area of ​​the camera module is uncertain. Different shooting scenarios require different shooting parameters. Manually adjusting these parameters demands a high level of expertise from the user. Typically, terminal devices with shooting capabilities use automatic adjustment to modify some shooting parameters. This requires the terminal device to accurately detect the target in different shooting scenarios to ensure the accuracy of parameter adjustments. Achieving accurate target detection in complex and changing shooting scenarios is a significant challenge.

[0069] To achieve the detection of the target D to be photographed, a related technology proposes a first terminal device based on laser detection focusing, such as... Figure 1As shown, the first terminal device 1000A includes a camera module 100 and a first laser sensor 200A. The infrared laser emission direction of the first laser sensor 200A is partially or entirely located within the imaging area of ​​the camera module 100. The first terminal device 1000A emits a laser signal towards the target D to be photographed via the first laser sensor 200A and receives the laser echo signal reflected by the target D. The relative distance between the target D and the camera module 100 is detected based on the laser echo signal. The focal length of the camera module 100 is adjusted based on the ranging result to achieve focusing of the camera module 100 on the target D. However, this laser-sensor-based ranging method has the following problems: Problem 1: It has high environmental requirements; in strong light environments, the detection distance of laser ranging is limited. Problem 2: Laser signals are usually highly focused linear signals with a narrow angular range, resulting in a small detectable coverage area, making it impossible to achieve full coverage detection of the entire imaging area of ​​the camera module 100. Issue 3: Laser signals have weak penetrating power, typically only detecting the first target in the direction the laser signal travels. Subsequently, the first target blocks the laser signal, preventing detection of subsequent targets along the same flight path. Issue 4: Laser signals can only detect the distance to a target, not the speed, angle, or other information of a moving target. Issue 5: To ensure the accuracy of laser signal detection, an opening is usually required on the first terminal device 1000A to ensure good light transmission of the laser signal, which affects the aesthetics of the first terminal device 1000A.

[0070] To improve the detection accuracy of the target D to be photographed, embodiments of this application provide a second terminal device, such as... Figure 2 As shown, the second terminal device 1000B includes a camera module 100 and a radar module 200B. The radar module 200B and the camera module 100 are disposed on the same side of the device body of the terminal device 1000B. The radar module 200B has multiple signal transmission direction regions. The second terminal device 1000B is used to: transmit a first signal to a first signal transmission direction region in the imaging area of ​​the camera module 100 based on the radar module 200B when the camera module 100 is taking a picture; receive a first echo signal, the first echo signal corresponding to the first signal; transmit a second signal to at least one second signal transmission direction region based on the radar module 200B, the at least one second signal transmission direction region partially overlapping or not overlapping with the first signal transmission direction region; receive a second echo signal, the second echo signal corresponding to the second signal; and adjust the shooting parameters of the camera module 100 according to the first echo signal and the second echo signal.

[0071] For example, the first echo signal is an echo signal generated by the reflection of the first signal by an object located in the region where the first signal is emitted, and the second echo signal is an echo signal generated by the reflection of the second signal by an object located in the region where the second signal is emitted.

[0072] For example, such as Figure 3 As shown, when the second terminal device 1000B activates the camera module 100 to take pictures, it determines that a target D to be photographed exists in a certain shooting sub-region, and designates the shooting sub-region where the target D is located as the first signal transmission direction region. The second terminal device 1000B first transmits a first signal to the first signal transmission direction region via the radar module 200B and receives the corresponding first echo signal. Then, the second terminal device 1000B transmits a second signal to at least one second signal transmission direction region in the imaging region based on the radar module 200B, and receives the second echo signal. The at least one second signal transmission direction region can be a shooting sub-region that does not overlap with the first signal transmission direction region, or it can be a shooting sub-region that partially overlaps with the first signal transmission direction region. Compared to transmitting a wide-beam detection signal covering the entire imaging region, transmitting a narrow-beam first signal about the first signal transmission direction region allows for more accurate detection of the parameters of the target D at the first signal transmission direction region, but it results in a loss of detection of the entire imaging region. In many shooting scenarios, interference objects may exist outside the area where the first signal is emitted. These interference objects can affect the adjustment of shooting parameters obtained based on the first signal. Furthermore, in some complex scenarios, the information obtained solely from detecting the area where the first signal is emitted is insufficient to calculate the shooting parameters for the target D. For example, in moving scenes, the position, angle, and speed of the target D may change. Information from the area where the first signal is emitted alone cannot accurately calculate the position of the target D in moving scenes, often resulting in out-of-focus images or videos, or sudden exposure flicker.

[0073] exist Figure 2 and Figure 3In the illustrated embodiment, to address the problem described above that accurate detection of the target D in complex scenarios cannot be achieved solely based on the first signal, a second signal transmission process is added to the existing method of using a narrow-beam first signal for detection in the first signal transmission direction region. The second signal is a signal transmitted towards at least one second signal transmission direction region. Through multiple second signals, second echo signals regarding the second signal transmission direction regions can be obtained. First, global parameters of the imaging region can be constructed based on multiple second echo signals and the first echo signal. Second, although the multiple second signals are transmitted towards other second signal transmission direction regions, they also, to some extent, reach the first signal transmission direction region. By fusing the first echo signal with the second echo signals corresponding to multiple second signals, interference noise removal and coherent enhancement of the echo signal can be achieved. Therefore, based on the first and second echo signals, more detection information about the imaging region can be obtained to meet the requirements for accurate detection of the target D. Finally, the radar module 200B detects the target based on electromagnetic wave signals. Compared to laser signals, electromagnetic waves have a wider coverage area and stronger penetrating power, and can detect more types of parameters. While laser sensors can only detect distance to assist in focusing, the Radar Module 200B can measure distance, speed, and angle. Although laser signals have poor penetrating power, and electromagnetic waves attenuate after passing through a target, optimization measures, such as improving algorithm processing accuracy or echo signal detection accuracy, can ensure that electromagnetic waves can still assist in target detection even after penetrating multiple targets. Therefore, compared to using laser sensors for ranging adjustments, using the Radar Module 200B for target detection to assist in adjusting shooting parameters allows for adjustments in more complex and changing scenarios.

[0074] For example, the second terminal device 1000B can be a mobile phone, tablet computer, smart camera, smart door lock, webcam, and vehicle trip recorder, etc.

[0075] In some possible implementations, such as Figure 4As shown, the second terminal device 1000B also includes a processing system 300B and a sensor group 400B. The sensor group 400B includes at least one device status sensor 410B and a sensor hub 420B. The at least one device status sensor 410B may include one or more of the following: a second laser sensor, a gyroscope sensor, an accelerometer, a distance sensor, a proximity sensor, an ambient light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, a bone conduction sensor, a specific absorption rate (SAR) sensor, a barometric pressure sensor, a magnetic sensor, or a Hall sensor. The at least one device status sensor 410B is connected to the processing system 300B via the sensor hub 420B. The processing system 300B is also connected to the radar module 200B and the camera module 100, respectively. In this embodiment, after the processing system 300B controls the camera module 100 to start shooting, it can receive a first echo signal and a second echo signal from the radar module 200B. In addition, the processing system 300B can also acquire sensor data from at least one device status sensor 410B (e.g., acquire detection laser data of the imaging area by the second laser sensor), and determine the imaging parameters based on the sensor data, the first echo signal, and the second echo signal. The sensor data enhances the detection capabilities of the second terminal device 1000B for different shooting scenarios, thereby improving the detection accuracy of the target.

[0076] For example, taking the second terminal device 1000B as a mobile phone or tablet computer, the processing system 300B can be a system on chip (SOC).

[0077] In one possible implementation, such as Figure 5As shown, the radar module 200B includes at least one transmitting antenna 210B, at least one receiving antenna 220B, at least one signal transmitting channel 230B, and at least one signal receiving channel 240B. The at least one signal transmitting channel 230B is connected to the processing system 300B and the at least one transmitting antenna 210B, respectively. The at least one signal receiving channel 240B is connected to the at least one receiving antenna 220B in a one-to-one correspondence, and is also connected to the processing system 300B. The signal transmitting communication 230B is used to provide a first signal and a second signal to the at least one transmitting antenna 210B. The at least one transmitting antenna 210B is used to transmit the first signal and the second signal. The at least one receiving antenna 220B is used to receive the first echo signal and the second echo signal. The at least one signal receiving channel 240B is used to process the received first echo signal and second echo signal and then transmit them to the processing system 300B. The processing system 300B is used to control the shooting parameters of the camera module 100 based on the processed first echo signal and second echo signal. In this application, when only one receiving antenna 220B is set, the speed and distance of the target can be detected. When multiple receiving antennas 220B are set, the different positions of the multiple receiving antennas 220B result in different angles at which the multiple receiving antennas 220B receive the echo signals, thereby enabling the detection of the target's relative angle in addition to detecting the target's speed and distance.

[0078] For example, the transmitting antenna 210B includes a switching circuit structure. The second terminal device 1000B is also used to switch the signal transmission direction region of at least one transmitting antenna 210B by means of the switching circuit structure.

[0079] In one example, radar module 200B includes at least one transmitting antenna 210B. A transmitting antenna 210B may include multiple antenna stubs (i.e., multiple radiators), and these multiple antenna stubs may correspond to multiple different signal transmission direction regions. In this case, a switching circuit structure is connected to multiple antenna stubs of the same transmitting antenna 210B. The switching circuit structure is used to switch between different antenna stubs of the same transmitting antenna 210B to switch the signal transmission direction region of at least one transmitting antenna 210B. Furthermore, radar module 200B may include one or more transmitting antennas 210B.

[0080] In another example, radar module 200B includes multiple transmitting antennas 210B and a phase-shifting network. The multiple transmitting antennas 210B are connected to signal transmission channel 230B via the phase-shifting network. Within the second terminal device 1000B, signal transmission channel 230B provides a first signal or a second signal. After the first signal or second signal undergoes phase-shifting processing by the phase-shifting network, the phase-shifted multiple first signals or multiple second signals are transmitted to the multiple transmitting antennas 210B respectively. Each of the multiple transmitting antennas 210B can transmit the first signal followed by the second signal of the corresponding phase. The multiple transmitting antennas 210B can form radio frequency signal clusters from the transmitted first signal or multiple second signals based on beamforming principles, thus directing the transmitted first signal or second signal towards a specific signal transmission direction region. In this process, the radio frequency signal clusters generated by multiple first signals or multiple second signals of different phases have different directions. At this time, the switching circuit structure is connected to the phase shifting network. The switching circuit structure is used to change the phase shift amount of the phase shifting network with respect to different transmitting antennas 210B, so as to switch the signal transmission direction area of ​​multiple transmitting antennas 210B.

[0081] In another example, radar module 200B includes at least one transmitting antenna 210B. Each transmitting antenna 210B includes a radiator, a grounding structure, and a feeding structure. A switching circuit structure is connected to the feeding structure of the transmitting antenna 210B. The switching circuit structure is used to switch the feeding mode of the transmitting antenna 210B to switch the signal transmission direction region of at least one transmitting antenna 210B. Alternatively, the switching circuit structure is connected to the grounding structure. The switching circuit structure is used to switch the grounding mode of the transmitting antenna 210B to switch the signal transmission direction region of at least one transmitting antenna 210B.

[0082] For example, such as Figure 6 As shown, each signal transmission channel 230B includes a signal source 231B. The signal source 231B generates a first signal and a second signal, which are then provided to the transmitting antenna 210B. In one example, the signal transmission channel 230B may also include a power amplifier 232B, through which the signal source 231B is connected to the transmitting antenna 210B. In some scenarios, the signal power of the first and second signals generated by the signal source 231B is high enough to meet application requirements, thus eliminating the need for the power amplifier 232B. However, in other scenarios where higher signal strength is required, the power amplifier 232B can amplify the power of the first or second signal generated by the signal source before transmission through the transmitting antenna 210B. In this case, the power amplifier 232B can improve the quality of the transmitted signal. For example, the signal source 231B can be a pulse generator.

[0083] For example, such as Figure 6 As shown, each signal receiving channel 240B includes a mixer 241B and an analog-to-digital converter (ADC) 242B. The receiving antenna 220B is connected to the processing system 300B via the mixer 241B and the ADC 242B. The mixer 241B is used to down-convert the first echo signal or the second echo signal. The ADC 242B is used to convert the analog first echo signal and the second echo signal into a digital signal form that can be processed by the processing system 300B. In this embodiment, the frequencies of the first echo signal and the second echo signal are typically high. Down-conversion by the mixer 241B can reduce the frequencies of the first echo signal and the second echo signal. Lowering the frequency reduces the data processing load of the processing system 300B. Simultaneously, the processing system 300B and other processing devices operate in the digital domain, typically performing operations on signals that are represented as binary-like digital signals. The first and second echo signals are electromagnetic wave signals, which are analog signals that the processing system 300B cannot directly process. Analog-to-digital conversion is required to obtain digital signals that the processing system 300B can process.

[0084] In one example, such as Figure 6 As shown, each signal receiving channel 240B may further include at least one of a low noise amplifier (LNA) 243B and a filter 244B. The receiving antenna 220B is connected to the mixer 241B via the LNA 243B. The mixer 241B is connected to the analog-to-digital converter 242B via the filter 244B. In this embodiment, the echo signal received by the receiving antenna 220B is amplified by the LNA to improve processing accuracy. The filter 244B filters out clutter signals other than the echo signal received by the receiving antenna 220B to further improve processing accuracy.

[0085] In some possible implementations, both the camera module 100 and the radar module 200B are mounted on the rear cover of the second terminal device 1000B. For example... Figure 7As shown, the second terminal device 1000B includes a display screen 500B, a mid-frame 600B, and a rear cover 700B. The display screen 500B is mounted on the front of the mid-frame 600B, and the rear cover 700B is mounted on the back of the mid-frame 600B, forming the body of the second terminal device 1000B. Signal processing devices such as the signal transmission channel 230B and signal reception channel 240B of the radar module 200B, the processing system 300B, and the sensor group 400B can be disposed in the body. The camera module 100 can be disposed on the rear cover 700B of the second terminal device 1000B. As described in this application... Figure 7 In the illustrated embodiment, the camera module 100 captures images by aligning the rear cover 700B of the second terminal device 1000B with the target D to be photographed. The display screen 500B located on the front of the second terminal device 1000B can display the captured images of the camera module 100 in real time regarding the imaging area for the user to view.

[0086] For example, such as Figure 7 As shown, the second terminal device 1000B has a cover opening 710B on its rear cover 700B, and the camera module 100 has a certain thickness. Therefore, the camera module 100 can extend from inside the mid-frame 600B to outside the rear cover 700B through the cover opening 710B on the rear cover 700B. The lens assembly 110 of the camera module 100 is distributed on the structure of the camera module 100 extending out of the rear cover 700B.

[0087] In some possible examples, such as Figure 8 As shown in Figure (a), the transmitting antenna 210B can be configured as a frame antenna on the mid-frame 600B of the second terminal device 1000B. In some possible examples, such as Figure 8 As shown in Figure (b), the transmitting antenna 210B can be mounted as a rear cover antenna on the rear cover 700B of the second terminal device 1000B.

[0088] In some possible examples, such as Figure 8 As shown in Figure (a), the receiving antenna 220B can be configured as a frame antenna on the mid-frame 600B of the second terminal device 1000B. In some possible examples, such as Figure 8As shown in Figure (b), the receiving antenna 220B can be mounted as an antenna on the rear cover 700B of the second terminal device 1000B. For example, the relative distance between any two of the camera module 100, at least one transmitting antenna 210B, and at least one receiving antenna 220B on the rear cover 700B of the second terminal device 1000B is less than half the length of the rear cover 700B. In this embodiment, in practical applications, the correspondence between the imaging area of ​​the camera module 100 and multiple signal transmission direction areas of the transmitting antenna 210B is usually preset in the second terminal device 1000B. The physical distance between the camera module 100 and the transmitting antenna 210B can be set closer. In this way, the conversion between the imaging area of ​​the camera module 100 and the signal transmission direction areas of the transmitting antenna 210B can be calculated more easily. In addition, placing the transmitting antenna 210B, the receiving antenna 220B, and the camera module 100 closer together makes it easier to convert the correspondence between the received echo signal and the transmitted signal, as well as the correspondence between the received echo signal and the image area. For example, the transmitting antenna 210B, the receiving antenna 220B, and the camera module 100 can all be placed in the upper half of the rear cover 700B of the second terminal device 1000B.

[0089] For example, such as Figure 8 As shown in Figure (b), when both the transmitting antenna 210B and the receiving antenna 220B are disposed on the rear cover 700B of the second terminal device 1000B, the transmitting antenna 210B, the receiving antenna 220B, and the camera module 100 can be disposed in the upper half of the rear cover 700B. In this embodiment, the transmitting antenna 210B and the receiving antenna 220B being disposed on the rear cover 700B means that the transmitting antenna 210B or the receiving antenna 220B can be disposed in the cover area of ​​the rear cover 700B that is separate from the camera module 100, or it can be disposed in the cover area of ​​the rear cover 700B used for mounting the camera module 100. For example, in Figure 8 In Figure (b), the transmitting antenna 210B is illustrated in the area of ​​the cover 700B that is separate from the camera module 100, while the receiving antenna 220B is illustrated in the area of ​​the cover 700B used to mount the camera module 100. Meanwhile, although... Figure 8 Although not shown in the diagram, in some examples, the transmitting antenna 210B or the receiving antenna 220B may also be located at a position such as on the side of the cover 710B. Additionally, Figure 8 The diagram illustrates the use of one transmitting antenna 210B and multiple receiving antennas 220B. Although not shown in... Figure 8 As shown in the figure, but according to the above Figure 5As illustrated in the embodiment, both the transmitting antenna 210B and the receiving antenna 220B can be configured as at least one. When designing the transmitting antenna 210B and the receiving antenna 220B, it is sufficient to ensure a relatively fixed distance and positional relationship between the transmitting antenna 210B, the receiving antenna 220B, and the camera module 100. This guarantees that the second terminal device 1000B can adjust the shooting parameters based on the first echo signal and the second echo signal. Similarly, when there are multiple receiving antennas 220B, it is also necessary to ensure that the relative positions of the multiple receiving antennas 220B are fixed.

[0090] For example, such as Figure 8 Figure (a) and Figure 8 As shown in Figure (b), the second laser sensor 411B within the sensor group 400B can also be mounted on the structure of the camera module 100 extending out of the rear cover 700B. In this embodiment, the second laser sensor 411B can be used to perform auxiliary ranging on the target D to be photographed within the imaging area, thereby enhancing the detection accuracy of the target D and the detection and recognition accuracy of the current shooting scene.

[0091] exist Figure 8 Figure (a) and Figure 8 In Figure (b), the position of each antenna is only an example. In actual applications, the antenna can be flexibly designed according to the area and position of the designable antennas of the second terminal device 1000B.

[0092] In some possible implementations, such as Figure 9 As shown, when the camera module 100 is taking pictures, the captured image of the imaging area can be displayed on the display screen 500B. The display screen 500 also displays a target frame, which is used to select the first signal transmission direction area in the imaging area.

[0093] Based on the above Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6 , Figure 7 , Figure 8 and Figure 9 The second terminal device 1000B with the structure shown can perform the following: Figure 10 The shooting method shown:

[0094] S100: Based on radar module 200B, transmit the first signal to the area in the direction of the first signal transmission.

[0095] In this embodiment of the application, when the camera module 100 starts taking pictures, a first signal can be transmitted through at least one transmitting antenna 210B in the radar module 200B.

[0096] For example, such as Figure 11 As shown, the display screen 500B displays a camera selection element X, which the user can select. At this time, the second terminal device 1000B can respond to the first operation acting on the display screen 500B and control the camera module 100 to capture images of the imaging area. After the camera module 100 starts capturing images, the captured image of the imaging area will be displayed in real time on the display screen 500B. Furthermore, a target frame will be displayed on the display screen 500B, which selects the target D to be captured within the imaging area. Then, based on the radar module 200B, the second terminal device 1000B transmits a first signal to the first signal transmission direction area of ​​the imaging area of ​​the camera module 100, in the direction of the entity area corresponding to the image area selected by the target frame.

[0097] For example, the target bounding box on the display screen 500B of the second terminal device 1000B can be determined based on an algorithm. In one example, the second terminal device 1000B can determine the position of the target bounding box based on an object detection algorithm, a human face detection algorithm, or a moving body detection algorithm, etc.

[0098] For example, the target frame on the display screen 500B of the second terminal device 1000B can also be determined by the user.

[0099] For example, the target frame on the display screen 500B of the second terminal device 1000B can also be an initialized fixed position frame.

[0100] For example, the target frame on the display screen 500B of the second terminal device 1000B can also be the last position frame determined by the camera module 100 during the last shooting operation.

[0101] S200, Receive the first echo signal.

[0102] In this embodiment, after the radar module 200B transmits a first signal to a region in the first signal transmission direction, the first signal is reflected by objects within that region, generating a first echo signal. The receiving antenna 220B of the radar module 200B acquires the first echo signal returned.

[0103] S300, based on radar module 200B, transmits a second signal to at least one area in the direction of second signal transmission.

[0104] In the embodiments of this application, such as Figure 3As shown, after receiving the first echo signal, the radar module 200B can also transmit second signals to at least one second signal transmission direction region in the imaging area other than the region in which the first signal is transmitted. Multiple second signals are transmitted to their corresponding signal transmission direction regions, and each second signal can generate a corresponding second echo signal through reflection from objects within its corresponding signal coverage area.

[0105] In one example, multiple signal transmission direction regions of the transmitting antenna 210B of the radar module 200B can have a fixed correspondence with at least one second signal transmission direction region. By transmitting second signals to different signal transmission direction regions, the radar module 200B can scan at least one second signal transmission direction region within the imaging area.

[0106] S400, receives the second echo signal.

[0107] In this embodiment of the application, the second echo signal is the echo signal generated by the reflection of the second signal by an object located in the corresponding signal transmission direction region.

[0108] S500 adjusts the shooting parameters of camera module 100 based on the first echo signal and the second echo signal.

[0109] In many complex shooting scenarios, achieving high-precision shooting parameter adjustment requires high accuracy in detecting various information parameters of the target D. In this embodiment, combining the first and second echo signals improves the detection accuracy of the target D. First, global parameters of the imaging area can be constructed based on multiple second echo signals and the first echo signal. Second, although the multiple second signals are emitted towards other second signal emission directions, they also, to some extent, reach the first signal emission direction. By fusing the first echo signal with the second echo signals corresponding to multiple second signals, interference noise can be removed from the first echo signal, and coherent enhancement of the echo signal can be achieved. Therefore, based on the first and second echo signals, more detection information about the imaging area can be obtained to meet the requirements for accurate detection of the target D. Figure 12 The diagram shows the benefit of detection intensity of the target as the relative distance increases. Figure 12 In the diagram, the dashed line represents the detection intensity when detection is based solely on the first signal, while the solid line represents the detection intensity when detection is based on a combination of the first and second signals. Point A in the diagram represents the relative distance between the target to be detected and the radar module 200B, and the detection intensity at point A represents the detection accuracy of the target.

[0110] In some possible implementations, the shooting parameters of the camera module 100 adjusted according to the first echo signal and the second echo signal may include one or more of the following parameters: focal length and exposure value, etc. In one example, taking the focal length as the shooting parameter, when a first target is present in the area in the direction of the first signal transmission, the focal length of the camera module 100 is adjusted according to the first echo signal and the second echo signal to focus on the first target.

[0111] In some possible implementations, the shooting scene changes according to the environment in which the second terminal device 1000B is located. In some examples, relevant scene modes can be set on the second terminal device 1000B, with different scene modes corresponding to the current environment of the second terminal device 1000B. For example, night scene mode, sports mode, portrait mode, or multi-target mode can be designed. In other examples, the second terminal device 1000B may not provide users with relevant scene mode options. However, regardless of the application of the above implementation examples, the second terminal device 1000B detects the actual shooting scene based on echo signals, and the shooting method of the embodiments of this application can be applied.

[0112] In one possible example, when the current shooting scene of the second terminal device 1000B is a motion mode scene, taking the focal length as an example, exemplarily, when there are multiple first targets in the first signal transmission direction area, the focal length of the camera module 100 is adjusted according to the first echo signal and the second echo signal to focus on at least one of the multiple first targets. Exemplarily, when there is at least one second target in at least one of the at least two second signal transmission direction areas, the focal length of the camera module 100 is adjusted according to the first echo signal and the second echo signal to focus on both the first target and at least one second target.

[0113] For example, taking the second terminal device 1000B as having a multi-target mode scene option as an example, when the display screen 500B is a touch screen, the display screen 500B also displays a first mode selection item X1, which is used to indicate shooting in multi-target mode. In multi-target mode, the camera module 100 can be designed to focus on one or more targets within the target frame, or it can be designed to focus on multiple targets both inside and outside the target frame. Figure 13As shown, the user can select the first mode selection item X1 on the display screen 500B. Taking focal length as an example, in response to the selection of the first mode selection item X1, when multiple first targets exist within the first signal transmission direction area, the second terminal device 100B adjusts the focal length of the camera module 100 based on the first echo signal and the second echo signal to focus on at least one of the multiple first targets. In one example, if a second target exists in at least one second signal transmission direction area outside the first signal transmission direction area, the camera module 100 may not focus on the second target. In another example, when at least one second target exists in at least one of the at least two second signal transmission direction areas, the second terminal device 1000B may also adjust the focal length of the camera module 100 based on the first echo signal and the second echo signal to focus on both the first target and at least one second target.

[0114] For example, such as Figure 14 The diagram shows the control flow of the second terminal device 1000B. Taking a photo taken using the camera module 100 as an example: When the camera module 100 starts taking pictures, the target to be photographed is first determined. Then, the relative position between the camera module 100 and the target is determined, thereby determining the corresponding first signal transmission direction area and other second signal transmission direction areas outside the first signal transmission direction area. Next, based on the determined first signal transmission direction area and other second signal transmission direction areas, the corresponding signal transmission direction area is adjusted to transmit the first or second signal. Finally, the relevant detection information of the target to be detected (including the number of targets, relative distance, moving speed, and relative angle, etc.) is determined based on the echo signal. In practical applications, the above processing flow can be performed in real time or multiple times.

[0115] In one possible example, when the current shooting scene of the second terminal device 1000B is a motion scene mode, for example, taking the focal length as the shooting parameter, when the first target or the second terminal device 1000B is in motion, the focal length of the camera module 100 is dynamically adjusted according to the first echo signal and the second echo signal to continuously focus on the first target for a period of time. Dynamically adjusting the focal length of the camera module means that, within a certain period of time, as the relative distance between the first target and the terminal device changes by a amount greater than a certain value, the focus value of the camera module's focusing motor also changes. Continuous focusing means that, within a certain period of time, based on the above-mentioned dynamic adjustment of the camera module's focal length, the focus value of the camera module's focusing motor changes more than once. Two adjacent focus values ​​correspond to different captured images, and in the captured images corresponding to different focus values, the difference in image sharpness regarding the first target is within a certain error range.

[0116] For example, taking the shooting parameters including exposure parameters as an example, when the first target or the second terminal device 1000B is in motion, the exposure parameters of the camera module 100 are dynamically adjusted according to the first echo signal and the second echo signal. For example, the second terminal device 1000B can determine whether it is in motion based on the gyroscope sensor in the sensor group 400B. In this embodiment, when at least one of the first target and the second terminal device 1000B is in motion, the relative distance between the first target and the second terminal device 1000B will dynamically change. The focal length parameter value is determined by this relative distance. Therefore, under existing detection methods, it is difficult to detect this dynamic position in real time and accurately, which will result in a situation of out-of-focus (i.e., not focused on the first target). In addition, when the relative distance changes, the relative angle between the first target and the camera module 100 will also change. By detecting parameters such as the relative angle and speed of motion between the first target and the camera module 100, continuous focusing on the first target over a period of time can be achieved more accurately. In this process, the calculation of relative distance, relative angle, and speed is based on a combination of the first and second echo signals, resulting in more precise calculations that improve the accuracy of the focusing parameters.

[0117] For example, taking the second terminal device 1000B as having a motion mode option, when the display screen 500B is a touch screen, the display screen 500B also displays a second mode selection item X2, which is used to indicate shooting in a motion mode scenario. Figure 15As shown, the user can select the second mode selection option X2 on the display screen 500B. Taking focal length as an example, in response to the selection of the second mode selection option X2, when the first target or the second terminal device 1000B is in motion, the focal length of the camera module 100 is dynamically adjusted based on the first echo signal and the second echo signal to continuously focus on the first target for a period of time. Similarly, taking exposure parameters as an example, in response to the selection of the second mode selection option X2, when the first target or the second terminal device 1000B is in motion, the exposure parameters of the camera module 100 are dynamically adjusted based on the first echo signal and the second echo signal.

[0118] For example, the second terminal device 1000B can periodically transmit a first signal and a second signal to the target frame to periodically detect the target D to be photographed and adjust the shooting parameters. For example, the second terminal device 1000B can also transmit the first signal and the second signal to the target frame after each target frame position update to detect the target D to be photographed and adjust the shooting parameters for the target frame after the current update position.

[0119] For example, when the target D or the second terminal device 1000B is in motion, as the target D moves on the display screen 500B, the corresponding target frame will also update its position on the display screen 500B. After each target frame position update, the operations described in steps S100-S500 above can be performed to adjust and update the shooting parameters corresponding to the current target frame. Figure 16 As shown, taking photo shooting based on camera module 100 as an example: After camera module 100 starts shooting, the second terminal device 1000B first configures the target frame on the display screen 500B. It controls the radar module 200B to start transmitting the first and second signals, and receives the first and second echo signals through the radar module 200B. Then, the second terminal device 1000B calculates relevant detection information (including target quantity, relative distance, moving speed, and relative angle) of the target D to be photographed based on the first and second echo signals. The second terminal device 1000B determines the shooting mode scene based on the relevant parameters of the target D to be photographed (and may also combine relevant sensor parameters from the device status sensor 410B). For example, if it is determined to be a motion mode scene, it calculates the focal length of the focusing motor and the exposure value of the camera aperture based on relevant parameters. After a single shot is completed, the above shooting parameter adjustment operation is repeated cyclically according to the next configured target frame.

[0120] In one possible example, when the current shooting scene of the second terminal device 1000B is a night scene mode, target detection can be assisted by the second laser sensor. For example, taking focal length as the shooting parameter, when the brightness of the area being captured is lower than a brightness threshold, the second terminal device 1000B adjusts the focal length of the camera module 100 based on the sensing data of the second laser sensor 411B, the first echo signal, and the second echo signal to focus on the first target. In another example, taking exposure parameters as the shooting parameter, when the brightness of the area being captured is lower than a brightness threshold, the second terminal device 1000B adjusts the exposure parameters of the camera module 100 based on the sensing data of the second laser sensor 411B, the first echo signal, and the second echo signal. Although not explicitly stated, focal length adjustment can also be achieved based on the second laser transmitter 411B in night scene mode.

[0121] For example, taking the second terminal device 1000B as having a night scene mode option, when the display screen 500B is a touch screen, the display screen 500B also displays a third mode selection item X3, which is used to indicate shooting in night scene mode. Figure 17 As shown, the user can select the third mode selection option X3 on the display screen 500B. At this time, taking the shooting parameter as the focal length as an example, in response to the selection operation of the third mode selection option X3, when the brightness of the area to be captured is lower than the brightness threshold, the second terminal device 100B adjusts the focal length of the camera module 100 to focus on the first target based on the sensing data of the second laser sensor 411B, the first echo signal and the second echo signal.

[0122] In some possible implementations, the second terminal device 1000B is further configured to: determine or update the first signal transmission direction area in response to user input on the display screen 500B. In this embodiment, the user can also input on the display screen 500B according to their own shooting needs to determine or update the target frame, and select the desired target D based on the target frame to improve user interactivity.

[0123] This application also provides a computer-readable storage medium including instructions. When the instructions are executed on a second terminal device 1000B, the second terminal device 1000B causes the second terminal device 1000B to perform the shooting method described in the above embodiments (e.g., Figure 10 , Figure 11 , Figure 12 , Figure 13 , Figure 14 , Figure 15 , Figure 16 and Figure 17 (The shooting method described).

[0124] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0125] Those skilled in the art will recognize that the modules and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0126] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and modules described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0127] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or modules may be electrical, mechanical, or other forms.

[0128] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical modules; that is, they may be located on one device or distributed across multiple devices. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0129] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented using software programs, implementation can be, in whole or in part, in the form of a computer program product. This computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device containing one or more servers, data centers, etc., that can be integrated with the medium. The available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).

[0130] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A terminal device, characterized in that, A camera module and a radar module; the radar module and the camera module are disposed on the same side of the terminal device body; the radar module has multiple signal transmission direction areas; the terminal device is used for: When the camera module takes a picture, the radar module transmits a first signal to the first signal transmission direction area; and receives a first echo signal, which corresponds to the first signal. The radar module transmits a second signal to at least one second signal transmission direction region, the at least one second signal transmission direction region partially overlapping or not overlapping with the first signal transmission direction region; and receives a second echo signal, the second echo signal corresponding to the second signal; The camera module's shooting parameters are adjusted based on the first echo signal and the second echo signal.

2. The terminal device according to claim 1, characterized in that, The shooting parameters include focal length; adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When a first target is present in the area oriented by the first signal transmission direction, the focal length of the camera module is adjusted according to the first echo signal and the second echo signal to focus on the first target; or... When multiple first targets exist within the area oriented by the first signal transmission direction, the focal length of the camera module is adjusted according to the first echo signal and the second echo signal to focus on at least one of the multiple first targets; or... When the first target is present in the first signal transmission direction area and at least one second target is present in the at least one second signal transmission direction area, the focal length of the camera module is adjusted according to the first echo signal and the second echo signal to focus on the first target and the at least one second target.

3. The terminal device according to claim 2, characterized in that, The step of adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When the first target or the terminal device is in motion, the focal length of the camera module is dynamically adjusted according to the first echo signal and the second echo signal to continuously focus on the first target for a period of time.

4. The terminal device according to claim 2 or 3, characterized in that, The terminal device further includes a laser sensor; adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When the brightness of the imaging area captured by the camera module is lower than the brightness threshold, the focal length of the camera module is adjusted according to the sensing data of the laser sensor, the first echo signal and the second echo signal to focus on the first target.

5. The terminal device according to any one of claims 1-4, characterized in that, The shooting parameters include exposure parameters; adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When the first target or the terminal device is in motion, the exposure parameters of the camera module are dynamically adjusted according to the first echo signal and the second echo signal.

6. The terminal device according to any one of claims 1-5, characterized in that, The terminal device is also used for: In response to user input, determine or update the first signal transmission direction region.

7. The terminal device according to any one of claims 1-6, characterized in that, The radar module includes at least one transmitting antenna and at least one receiving antenna; the at least one transmitting antenna is used to transmit the first signal and the second signal; the at least one receiving antenna is used to receive the first echo signal and the second echo signal, wherein the first echo signal is an echo signal generated by the reflection of the first signal by an object located in the region of the first signal transmission direction, and the second echo signal is an echo signal generated by the reflection of the second signal by an object located in the region of the second signal transmission direction.

8. The terminal device according to claim 7, characterized in that, The camera module, the at least one transmitting antenna, or the at least one receiving antenna are disposed on the back cover of the terminal device.

9. The terminal device according to claim 8, characterized in that, The relative distance between any two of the camera module, the at least one transmitting antenna, and the at least one receiving antenna on the back cover of the terminal device is less than half the length of the back cover.

10. The terminal device according to any one of claims 7-9, characterized in that, The transmitting antenna includes a switching circuit structure; the terminal device is further configured to: switch the signal transmission direction region of the at least one transmitting antenna through the switching circuit structure.

11. The terminal device according to any one of claims 1-10, characterized in that, The multiple signal transmission direction regions correspond to multiple shooting sub-regions in the shooting imaging area of ​​the camera module.

12. A shooting method, characterized in that, The invention is applied to a terminal device, which includes a camera module and a radar module; the radar module and the camera module are disposed on the same side of the device body of the terminal device. The radar module has multiple signal transmission direction regions; the method includes: When the camera module takes a picture, the radar module transmits a first signal to the first signal transmission direction area; and receives a first echo signal, which corresponds to the first signal. The radar module transmits a second signal to at least one second signal transmission direction region, the at least one second signal transmission direction region partially overlapping or not overlapping with the first signal transmission direction region; and receives a second echo signal, the second echo signal corresponding to the second signal; The camera module's shooting parameters are adjusted based on the first echo signal and the second echo signal.

13. The shooting method according to claim 12, characterized in that, The shooting parameters include focal length; adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When a first target is present in the area oriented by the first signal transmission direction, the focal length of the camera module is adjusted according to the first echo signal and the second echo signal to focus on the first target; or... When multiple first targets exist within the area oriented by the first signal transmission direction, the focal length of the camera module is adjusted according to the first echo signal and the second echo signal to focus on at least one of the multiple first targets; or... When the first target is present in the first signal transmission direction area and at least one second target is present in the at least one second signal transmission direction area, the focal length of the camera module is adjusted according to the first echo signal and the second echo signal to focus on the first target and the at least one second target.

14. The shooting method according to claim 13, characterized in that, The step of adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When the first target or the terminal device is in motion, the focal length of the camera module is dynamically adjusted according to the first echo signal and the second echo signal to continuously focus on the first target for a period of time.

15. The shooting method according to claim 13 or 14, characterized in that, The terminal device further includes a laser sensor; adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When the brightness of the imaging area captured by the camera module is lower than the brightness threshold, the focal length of the camera module is adjusted according to the sensing data of the laser sensor, the first echo signal and the second echo signal to focus on the first target.

16. The shooting method according to any one of claims 12-15, characterized in that, The shooting parameters include exposure parameters; adjusting the shooting parameters of the camera module based on the first echo signal and the second echo signal includes: When the first target or the terminal device is in motion, the exposure parameters of the camera module are dynamically adjusted according to the first echo signal and the second echo signal.

17. The shooting method according to any one of claims 12-16, characterized in that, The method further includes: In response to user input, determine or update the first signal transmission direction region.

18. The shooting method according to any one of claims 12-17, characterized in that, The first echo signal is the echo signal generated by the reflection of the first signal by an object located in the region where the first signal is emitted, and the second echo signal is the echo signal generated by the reflection of the second signal by an object located in the region where the second signal is emitted.

19. The shooting method according to any one of claims 12-18, characterized in that, The terminal device further includes a display screen; the method further includes: In response to a first operation applied to the display screen, the camera module is controlled to frame the image area; the plurality of signal transmission direction areas respectively correspond to the plurality of shooting sub-areas in the image area of ​​the camera module. The display screen shows an image of the captured imaging area, and the display screen also shows a target frame, which is used to select the area in the first signal transmission direction corresponding to the captured imaging area.

20. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on a terminal device, cause the terminal device to perform the shooting method as described in any one of claims 12-19.

Images