Shooting control method and device, electronic equipment and medium

Abstract

The invention relates to a shooting control method and device, electronic equipment and a medium, the shooting control method is applied to the electronic equipment with a camera, and the shooting control method comprises the following steps: obtaining target distance measurement information of a target object based on a distance measurement device and a positioning device; adjusting shooting parameters of the camera based on the target distance measurement information; and shooting based on the adjusted shooting parameters. The distance between the target object and the electronic equipment is accurately identified by using the distance measuring device and the positioning device, the distance measuring requirements in various scenes are met, the shooting parameters of the camera are automatically adjusted based on the target distance measuring information, the automatic focusing of the target object is realized, the quality of the shot image is effectively improved, the shooting requirements of a user are met, and the user experience is improved. And the shooting experience of the user is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of photographing of electronic devices, and in particular to a photographing control method, device, electronic device and medium. Background Art

[0002] With the rapid development of modern technology, electronic devices with shooting functions such as smart phones, tablets, and laptops are widely used in daily life. Electronic devices need to accurately measure distance in order to achieve accurate focus on the target object in the shooting picture. At present, when shooting a target object in motion, electronic devices can use RGB images, depth of field lenses or TOF (Time Of Flight) modules for auxiliary focus and distance judgment. Among them, TOF sensors are easily affected by the environment. The intensity and direction of light will affect the accuracy of TOF sensors. Therefore, TOF sensors cannot achieve the effect of accurate distance measurement in some scenarios. In addition, since electronic devices cannot turn off the TOF module in time when the TOF sensor fails, the power consumption of electronic devices during shooting will increase. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a shooting control method, device, electronic device and medium.

[0004] According to a first aspect of an embodiment of the present disclosure, a shooting control method is provided, which is applied to an electronic device having a camera, and the shooting control method includes:

[0005] Acquiring target distance measurement information of a target object based on a distance measurement device and a positioning device, wherein the target object is a focus object of the camera;

[0006] Adjusting the shooting parameters of the camera based on the target ranging information;

[0007] Based on the adjusted shooting parameters, shooting is performed.

[0008] In some exemplary embodiments of the present disclosure, the step of acquiring target ranging information of a target object based on a ranging device and a positioning device includes:

[0009] Determine first ranging information of the target object based on the ranging device;

[0010] Determine second ranging information of the target object based on the positioning device;

[0011] adjusting a ranging parameter of the ranging device and / or a ranging parameter of the positioning device according to the first ranging information and the second ranging information;

[0012] The target ranging information is determined according to the adjusted ranging parameters.

[0013] In some exemplary embodiments of the present disclosure, determining the second ranging information of the target object based on the positioning device includes:

[0014] When the positioning device scans multiple objects, based on the ranging information of the multiple objects by the ranging device, determining the ranging angle and / or ranging range of the positioning device;

[0015] Based on the ranging angle and / or the ranging range, second ranging information of the target object is determined.

[0016] In some exemplary embodiments of the present disclosure, determining the second ranging information of the target object based on the positioning device includes:

[0017] Acquiring first auxiliary information based on a motion sensor, where the first auxiliary information is used to characterize posture information of the electronic device, where the posture information includes at least one of the following: motion information and angle information;

[0018] Adjusting the ranging parameters of the positioning device based on the first auxiliary information;

[0019] The second ranging information of the target object is determined based on the adjusted ranging parameters.

[0020] In some exemplary embodiments of the present disclosure, determining the second ranging information of the target object based on the positioning device includes:

[0021] Acquire second auxiliary information, where the second auxiliary information is used to represent information of the target object;

[0022] Adjusting the ranging parameters of the positioning device based on the first auxiliary information and the second auxiliary information;

[0023] The second ranging information of the target object is determined based on the adjusted ranging parameters.

[0024] In some exemplary embodiments of the present disclosure, the ranging parameter of the positioning device includes at least one of the following: a second sampling frequency, a second signal interval frequency, and a second signal timing, and the adjusting the ranging parameter of the positioning device based on the first auxiliary information and the second auxiliary information includes:

[0025] Acquire a movement speed of the electronic device based on the first auxiliary information;

[0026] Acquire a moving speed of the target object based on the second auxiliary information;

[0027] Adjusting the second sampling frequency, the second signal interval frequency, and the second signal timing based on the movement speed of the electronic device and / or the movement speed of the target object;

[0028] The second sampling frequency, the second signal interval frequency, and the second signal timing are positively correlated with the movement speed of the electronic device and the movement speed of the target object.

[0029] In some exemplary embodiments of the present disclosure, the first ranging information includes a first ranging distance, the second ranging information includes a second ranging distance, and the ranging parameter of the ranging device includes at least one of the following: a first integration time length and a first sampling time. Adjusting the ranging parameter of the ranging device and / or the ranging parameter of the positioning device according to the first ranging information and the second ranging information includes:

[0030] Adjusting the first integration time and the first sampling time based on a difference between the first ranging distance and the second ranging distance;

[0031] The first integration time and the first sampling time are positively correlated with the difference.

[0032] In some exemplary embodiments of the present disclosure, the distance measuring device is provided with a first accuracy value, and the step of determining the target distance measurement information according to the adjusted distance measurement parameter includes:

[0033] Based on the adjustment of the ranging parameter, reducing the first accuracy value;

[0034] If the first accuracy value is less than a first preset threshold value, the target ranging information is determined based on the first ranging information of the target object determined based on the adjusted ranging parameters.

[0035] In some exemplary embodiments of the present disclosure, the positioning device is provided with a second accuracy value, and the step of determining the target ranging information according to the adjusted ranging parameter includes:

[0036] Based on the adjustment of the ranging parameter, reducing the second accuracy value;

[0037] If the second accuracy value is less than a second preset threshold value, the target ranging information is determined based on the second ranging information of the target object determined based on the adjusted ranging parameters.

[0038] In some exemplary embodiments of the present disclosure, after the target ranging information is determined, the ranging device and / or the positioning device is turned off.

[0039] In some exemplary embodiments of the present disclosure, the distance measuring device is a TOF sensor, and the positioning device is a UWB sensor.

[0040] According to a second aspect of an embodiment of the present disclosure, there is provided a shooting control device, which is applied to an electronic device having a camera, and the shooting control device includes:

[0041] An acquisition module, used for acquiring target distance measurement information of a target object based on a distance measurement device and a positioning device, wherein the target object is a focus object of the camera;

[0042] An adjustment module, used for adjusting the shooting parameters of the camera based on the target ranging information;

[0043] The execution module is used to perform shooting based on the adjusted shooting parameters.

[0044] According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0045] sensor;

[0046] Camera;

[0047] processor;

[0048] a memory for storing processor-executable instructions;

[0049] Among them, the processor is configured to execute the executable instructions in the memory to implement the shooting control method provided in the first aspect of the present disclosure.

[0050] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided, on which executable instructions are stored. When the executable instructions are executed by a processor, the shooting control method provided by the first aspect of the present disclosure is implemented.

[0051] The above method of the present invention has the following beneficial effects: the present invention uses a ranging device and a positioning device to accurately identify the distance between a target object and an electronic device, meets the ranging requirements in various scenarios, automatically adjusts the shooting parameters of the camera based on the target ranging information, realizes automatic focusing on the target object, effectively improves the captured image quality, meets the user's shooting requirements, and enhances the user's shooting experience.

[0052] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0054] Figure 1 is a flowchart of a shooting control method according to an exemplary embodiment.

[0055] Figure 2 is a flowchart of a shooting control method according to an exemplary embodiment.

[0056] Figure 3 is a block diagram of a shooting control device according to an exemplary embodiment.

[0057] Figure 4 is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0058] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0059] TOF (Time Of Flight) is a distance measurement method that calculates the distance between an emitter and a reflector by measuring the "flight time" of ultrasonic, microwave, light and other signals between the emitter and the reflector. A TOF sensor is a sensor that can achieve TOF distance measurement. There are many types of TOF sensors, among which the most commonly used ones are TOF sensors that measure distance through infrared light or laser. A TOF sensor uses a transmitter to emit infrared light or laser, and the light generated will be reflected from any object back to the TOF sensor. The TOF sensor measures the distance between the object and the TOF sensor based on the time difference between the emission of light and the reflection of the light back to the sensor by the object.

[0060] Since the distance measurement of the TOF sensor depends on the emission and reception of the reverse reflection of its own light, in scenes with strong light (such as an outdoor environment with glaring sunlight), other light sources will interfere with the light emitted by the TOF sensor, so the TOF sensor cannot perform accurate distance measurement. If the electronic device only relies on the distance information of the focused object in the shooting picture obtained by the TOF sensor to adjust the shooting parameters, since the TOF sensor cannot meet the distance measurement requirements of the electronic device in various scenes, the distance measurement information of the TOF sensor is not accurate in some scenes, resulting in poor shooting quality of the electronic device. In addition, when the focused object is in motion, it is more difficult to focus based on the distance measurement information obtained by the TOF sensor, and the photos taken are prone to blurring, deformation, etc.

[0061] In order to solve the above problems, the present disclosure provides a shooting control method, which is applied to an electronic device with a camera. The electronic device uses a ranging device and a positioning device to accurately identify the distance between the target object and the electronic device. The integration of multiple ranging technologies can meet the ranging needs of the electronic device in various scenarios. The shooting parameters of the camera are automatically adjusted based on the target ranging information to achieve automatic focus on the target object, effectively improve the image quality of the shot, meet the user's shooting needs, and enhance the user's shooting experience.

[0062] The exemplary embodiments of the present disclosure provide a shooting control method, which is applied to an electronic device with a camera, and the electronic device can be a mobile phone, a tablet computer, a notebook, an intelligent robot, and other intelligent electronic devices with shooting functions. The shooting method is implemented by a control device of the electronic device, which is also a control chip of the electronic device, and has a data processing function, as well as information and instruction sending and receiving functions, etc. The control device includes a shooting control device involved in the following text.

[0063] like Figure 1 As shown, the shooting control method shown in the present disclosure includes:

[0064] S101, acquiring target ranging information of a target object based on a ranging device and a positioning device;

[0065] S102, adjusting the shooting parameters of the camera based on the target ranging information;

[0066] S103: Perform shooting based on the adjusted shooting parameters.

[0067] In step S101, the target object is the focus object of the camera, and the target object can be a person, animal, plant, scenery, etc. in a static or dynamic state in the captured image. When there are multiple objects in the captured image, the target object can be determined by the electronic device according to the focus level, or the target object can be selected by the user based on personal shooting needs. The target object can be a single person or object, or a collection of multiple people or objects. For example, when there are three people A, B, and C standing separately in the captured image, the electronic device can select person A as the target object according to the focus level; when people A and B stand side by side in the captured image, the user can choose to use people A and B together as the target object.

[0068] When the electronic device turns on the camera function, the distance measuring device and the positioning device are both started synchronously. The control device maintains a communication connection with the distance measuring device to obtain the distance between the target object and the electronic device in the shooting picture. The distance measuring device can be a photoelectric sensor, an ultrasonic sensor, a TOF sensor, etc., wherein the photoelectric sensor uses the characteristics of light to measure the distance between the target object and the sensor; the ultrasonic sensor uses the propagation speed of sound waves to measure the distance between the target object and the sensor; the TOF sensor uses the time of laser or infrared light flying in space to convert the time into the distance between the object and the sensor in the shooting picture through calculation. When the electronic device is in an environment without interference from waves emitted by other light sources, the accuracy of the distance measuring device will not be affected, and the control device can obtain a more accurate distance measurement information of the target object fed back by the distance measuring device. When the electronic device is in an environment with interference from other light sources, the accuracy of the distance measuring device will be affected, and accurate distance measurement information cannot be fed back, and the distance measurement information of the target object obtained by the control device from the distance measuring device is relatively vague.

[0069] The control device will also maintain communication connection with the positioning device to obtain the distance between the target object and the electronic device in the shooting picture. The positioning device can be a visual sensor, UWB (Ultra Wide Band) sensor, etc., wherein the visual sensor obtains the image of the target object through the camera and uses the visual algorithm to calculate the position of the target object; the UWB sensor has a radar perception function and can obtain the precise distance information and angle information of the target object through the perception algorithm at the application layer of the electronic device. Compared with laser and infrared, UWB has low requirements on the environment and high accuracy. UWB is an ideal positioning technology.

[0070] When the electronic device is in an environment with many light sources, the control device can obtain the target distance information of the target object through a preset comprehensive calculation based on the distance information obtained by the distance measuring device and the positioning device to improve the accuracy of the distance information of the target object; the control device can also use the distance information obtained based on the positioning device as the target distance information of the target object. In addition, the control device can also continuously adjust the distance parameters of the distance measuring device and the positioning device through an interactive iteration based on the distance information obtained by the distance measuring device and the positioning device to improve the distance accuracy of the distance measuring device and the positioning device, and ensure that the distance measuring device and the positioning device can feedback accurate distance information.

[0071] When the electronic device is in an environment without light source interference, the control device can use the distance measurement information based on the distance measuring device or the positioning device as the target distance measurement information of the target object. Of course, it is understandable that in order to improve the accuracy of the target distance measurement information of the target object, even in an environment without light source interference, the control device can also use the distance measurement information of the distance measuring device and the positioning device to jointly determine the target distance measurement information of the target object to obtain the distance between the target object and the electronic device.

[0072] In step S102, the shooting parameters include exposure parameters and focus parameters, and the control device adjusts the exposure parameters and focus parameters based on the target distance information of the target object, so that the target object as the focus object can be accurately focused in the shooting picture. Since the target distance information is determined based on the distance measuring device and the positioning device, for the target object in motion, the control device can also obtain the accurate distance information between the target object and the electronic device, so the control device can assist the automatic adjustment of the camera parameters through the position change of the target object. Among them, the focus parameter includes the focal length, and the exposure parameter includes the exposure time, the exposure amount, etc. For example, when the target distance information reflects that the target object is far away from the electronic device, and the target distance information is constantly changing, that is, the target object is in motion, the focal length of the camera can be increased, the exposure time can be increased, and the exposure amount can be increased.

[0073] In step S103, the electronic device automatically focuses on the target object and photographs the target object using the adjusted photographing parameters. The user does not need to manually adjust the photographing parameters and can photograph high-quality images.

[0074] In the present disclosure, a ranging device and a positioning device are used to accurately identify the distance between a target object and an electronic device, thereby meeting the ranging requirements in various scenarios. The shooting parameters of the camera are automatically adjusted based on the target ranging information to achieve automatic focus on the target object, effectively improve the captured image quality, meet the user's shooting requirements, and enhance the user's shooting experience.

[0075] According to an exemplary embodiment, Figure 2 As shown, the shooting control method in this embodiment includes:

[0076] S201, determining first ranging information of a target object based on a ranging device;

[0077] S202, judging whether there are multiple objects based on the scanning of the positioning device, if there are multiple objects, executing step S203; if there are no multiple objects, executing step S205;

[0078] S203, determining a ranging angle and / or a ranging range of a positioning device based on ranging information of a plurality of objects by the ranging device;

[0079] S204, determining second ranging information of the target object based on the ranging angle and / or the ranging range;

[0080] S205, determining second ranging information of the target object based on the positioning device;

[0081] S206. Adjusting the ranging parameters of the ranging device and / or the ranging parameters of the positioning device according to the first ranging information and the second ranging information;

[0082] S207, determining target ranging information according to the adjusted ranging parameters;

[0083] S208, adjusting the shooting parameters of the camera based on the target ranging information;

[0084] S209: Perform shooting based on the adjusted shooting parameters.

[0085] Among them, steps S208 and S209 are the same as those in the above embodiment and will not be repeated here.

[0086] In step S201, when the electronic device turns on the shooting function, the distance measuring device is turned on synchronously. The distance measuring device will measure the distance of all objects in the shooting picture. Since the target object is automatically determined by the electronic device or specified by the user, the control device can obtain the distance between the target object and the electronic device based on the distance measuring device, and use the distance measuring information of the target object determined by the distance measuring device as the first distance measuring information. Since the distance measuring device is affected by the ambient light source, the farthest distance that the distance measuring device can complete the distance measurement in different scenes is different, and the farthest distance that can be measured is determined by the chip specifications of the distance measuring device. In addition, the accuracy of the distance measuring device is strongly related to the distance of the distance measurement. The closer the object is to the electronic device, the lower the accuracy of the distance measuring device. For example, electronic devices have built-in TOF sensors as ranging devices. The TOF sensor uses a 990nm laser to measure the distance to an object. The maximum distance that the TOF sensor can measure in indoor scenarios is 30m, and the maximum distance that it can measure in outdoor scenarios is 20m. For objects at a distance of [0, 10m] from the electronic device, the ranging accuracy of the TOF sensor is 5cm; for objects at a distance of (10m, 20m] from the electronic device, the ranging accuracy of the TOF sensor is 10cm; for objects at a distance of (20m, 30m] from the electronic device, the ranging accuracy of the TOF sensor is 20cm.

[0087] In step S202, since the positioning device has a radar sensing function, it can be determined by scanning whether there are multiple objects within the shooting range of the electronic device. When the positioning device determines that there are multiple objects, since the positioning device will measure the distance of all objects, the obtained ranging information is redundant, which is not conducive to accurate identification and measurement of the target object. Therefore, step S203 is executed, and the ranging information of multiple objects obtained by the ranging device in step S201 is used to screen the approximate position of the target object according to the specific distance values ​​between the multiple objects and the electronic device, and determine the ranging angle and / or ranging range of the positioning device. In step S204, the positioning device performs ranging based on the determined ranging angle and / or ranging range to obtain the distance between the target object and the electronic device, and the control device uses the ranging information of the target object determined by the positioning device as the second ranging information. For example, the electronic device uses the UWB sensor as a positioning device, and takes the front of the electronic device as 0° as a reference. During the shooting process, the UWB sensor scans the range of [-45°, 45°]. Based on the radar perception function of the UWB sensor, it is determined that there are three people in the shooting picture. Based on the ranging device, the distance between person A and the electronic device is 5m, the distance between person B and the electronic device is 8m, and the distance between person C and the electronic device is 10m. Person A, person B, and person C stand in the directions of 0°, 10°, and -30° respectively. Since person A is the target object, the UWB sensor determines the ranging angle to be [-5°, 5°] and the ranging range to be [2m, 8m]. Distance measurement is no longer performed for other angles and distances, that is, the UWB sensor will not measure the distance between person B and person C.

[0088] If step S202 determines based on the positioning device that there is only one object within the shooting range of the electronic device, that is, the only object is the target object, step S205 is executed, and the ranging information obtained based on the positioning device is the second ranging information of the target object.

[0089] In some embodiments, step S205 determines the second distance measurement information of the target object based on the positioning device, including:

[0090] Acquiring first auxiliary information based on the motion sensor, where the first auxiliary information is used to represent posture information of the electronic device;

[0091] Adjusting the ranging parameters of the positioning device based on the first auxiliary information;

[0092] Second distance measurement information of the target object is determined based on the adjusted distance measurement parameters.

[0093] In order to enable the positioning device to lock the target object more efficiently and accurately, the control device obtains the first auxiliary information based on the motion sensor, and the first auxiliary information is used to characterize the posture information of the electronic device, and the posture information includes at least one of motion information and angle information. The motion sensor can specifically be a gyroscope, accelerometer or other device, and the control device obtains the posture information of the electronic device, such as the moving speed and tilt angle of the electronic device, through a communication connection with the motion sensor. When the electronic device changes compared to the initial state of turning on the shooting function, for example, the user carries the electronic device in a moving vehicle to shoot a distant mountain, in order to avoid the movement or shaking of the electronic device affecting the ranging accuracy of the positioning device, the control device adjusts the ranging parameters of the positioning device based on the first auxiliary information to improve the ranging accuracy of the positioning device.

[0094] In some embodiments, step S205 determines the second distance measurement information of the target object based on the positioning device, including:

[0095] Acquire second auxiliary information, where the second auxiliary information is used to represent information of the target object;

[0096] Adjusting the ranging parameters of the positioning device based on the first auxiliary information and the second auxiliary information;

[0097] Second distance measurement information of the target object is determined based on the adjusted distance measurement parameters.

[0098] During the shooting process, there are often situations where dynamic objects are shot. If the positioning device always measures the distance of the dynamic object according to the default distance measurement parameters, it is easy to cause the target object to be blurred or deformed in the final captured image. Therefore, the control device obtains the second auxiliary information that characterizes the target object. The second auxiliary information may include the height of the target object, the movement speed of the target object, etc. For example, the control device can obtain the height of the target object by performing image recognition and ratio calculation on the preview image during the shooting process, and obtain the movement speed of the target object through the moving distance of the target object in multiple frames of preview images. In addition, the control device can also determine the height information of the electronic device and the ground through the preview image. The control device adjusts the distance measurement parameters of the positioning device based on the first auxiliary information and the second auxiliary information. The positioning device measures the distance of the target object based on the adjusted distance measurement parameters, so that the positioning device can meet the distance measurement requirements of different shooting scenes and improve the distance measurement accuracy of the positioning device.

[0099] In some embodiments, adjusting the ranging parameters of the positioning device based on the first auxiliary information and the second auxiliary information includes:

[0100] Acquire a movement speed of the electronic device based on the first auxiliary information;

[0101] acquiring a moving speed of the target object based on the second auxiliary information;

[0102] Based on the movement speed of the electronic device and / or the movement speed of the target object, the second sampling frequency, the second signal interval frequency, and the second signal timing are adjusted.

[0103] When the electronic device is in motion, the control device can obtain the first auxiliary information based on the motion sensor to determine the motion speed of the electronic device; when the target object is in motion, the control device can obtain the second auxiliary information based on the preview screen to determine the motion speed of the target object. When the electronic device is static and the target object is dynamic, or the electronic device is dynamic and the target object is static, the control device can adjust the distance measurement parameters of the positioning device based on the motion speed of the target object or the motion speed of the electronic device. When both the electronic device and the target object are dynamic, the control device needs to consider the motion speeds of both and adjust the distance measurement parameters of the positioning device based on the motion speeds of the electronic device and the motion speeds of the target object.

[0104] The ranging parameters of the positioning device include the second sampling frequency, the second signal interval frequency, and the second signal timing, wherein the second sampling frequency, the second signal interval frequency, and the second signal timing are all positively correlated with the movement speed. When the movement speed of the electronic device or the target object is relatively high, that is, the movement amplitude of the electronic device or the target object is relatively large, and the position and movement change in a relatively short period of time, in order to improve the accuracy of the ranging and ensure the quality of the final captured image, it is necessary to increase the second sampling frequency, increase the second signal interval frequency, and speed up the change of the second signal timing, so that the positioning device can perform multiple scans and ranging of the target object within a fixed time.

[0105] In step S206, the control device will adjust the ranging parameters of the ranging device based on the second ranging information of the target object obtained by the positioning device. At the same time, the control device will also adjust the ranging parameters of the positioning device based on the first ranging information of the target object obtained by the ranging device. The two ranging technologies are integrated to improve the ranging accuracy of the ranging device and the positioning device through multiple rounds of feedback and adjustment to obtain more accurate ranging information.

[0106] In some embodiments, step S206 adjusts the ranging parameters of the ranging device and / or the ranging parameters of the positioning device according to the first ranging information and the second ranging information, including:

[0107] Based on the difference between the first ranging distance and the second ranging distance, the first integration time and the first sampling time are adjusted.

[0108] The first ranging information includes a first ranging distance between the target object and the electronic device, and the second ranging information includes a second ranging distance between the target object and the electronic device. The control device calculates the difference between the first ranging distance and the second ranging distance. If the difference is larger, it means that there is a ranging difference between the positioning device and the ranging device, which may be due to inaccurate ranging of the positioning device or the ranging device, so it is necessary to further adjust the ranging parameters according to the difference.

[0109] When there is a large difference between the first ranging distance obtained by the ranging device and the second ranging distance obtained by the positioning device, that is, the ranging accuracy of the ranging device is poor, it is necessary to adjust the ranging parameters of the ranging device based on the difference between the first ranging distance and the second ranging distance. The ranging parameters of the ranging device include at least one of the first integration time and the first sampling time, wherein the first integration time and the first sampling time are positively correlated with the difference, that is, if the difference is large, the sampling time and the integration time of the ranging device are increased to improve the ranging accuracy of the ranging device. When the difference between the first ranging distance and the second ranging distance is less than the preset difference threshold, it means that the distance values ​​of the target object and the electronic device determined respectively based on the ranging device and the positioning device are close. Due to the performance differences between the ranging device and the positioning device, the error between the first ranging distance and the second ranging distance can be ignored, so there is no need to adjust the ranging parameters.

[0110] In addition, it can be understood that when the second ranging distance obtained by the positioning device is significantly different from the first ranging distance obtained by the ranging device, that is, the ranging accuracy of the positioning device is poor, the ranging parameters of the positioning device can also be adjusted based on the difference between the first ranging distance and the second ranging distance.

[0111] In step S207, the distance between the target object and the object is measured based on the adjusted ranging parameters with high accuracy. The control device can determine the target ranging information based on the ranging device after the ranging parameters are adjusted, or can determine the target ranging information based on the positioning device after the ranging parameters are adjusted, or can jointly determine the target ranging information based on the ranging device and the positioning device after the ranging parameters are adjusted.

[0112] In some embodiments, step S207 determines the target ranging information according to the adjusted ranging parameters, including:

[0113] Based on the adjustment of the ranging parameters, the first accuracy value is reduced;

[0114] If the first accuracy value is less than the first preset threshold value, the target ranging information is determined based on the first ranging information of the target object determined based on the adjusted ranging parameters.

[0115] The ranging device has a first accuracy value, and the first accuracy value is different for different ranging distances. Since the ranging device adjusts the ranging parameters according to the second ranging information determined by the positioning device, the ranging performance of the ranging device is continuously improved during the iteration of the first ranging information and the second ranging information, and its accuracy is continuously reduced. In order to improve the ranging accuracy of the ranging device, it is also necessary to judge the first accuracy value. When the first accuracy value is less than the first preset threshold value, it is considered that the ranging parameter adjustment of the ranging device is completed, and the first ranging information and the second ranging information do not need to be iterated. For example, the first preset threshold value is 8cm. For an object at a distance of [10m, 20m] from the electronic device, the initial first accuracy value of the ranging device is 10cm. As the ranging parameters are adjusted, the first accuracy value is continuously reduced. After the ranging parameters are adjusted, the first accuracy value is 5cm, which is less than 8cm, that is, the first accuracy value is less than the first preset threshold value, and the accuracy of the ranging device meets the ranging requirements. When the electronic device is in an environment without interference from light sources, the ranging device after the ranging parameters are adjusted can reflect relatively accurate ranging information. Therefore, the control device can be supplemented by the positioning device and mainly based on the ranging device, that is, the target ranging information is determined by the first ranging information of the target object determined by the ranging device. It should be noted that if the first accuracy value of the ranging device does not decrease with the adjustment of the ranging parameters, but increases instead, it means that the adjustment of the ranging parameters of the ranging device based on the second ranging information of the positioning device has a negative effect, making the ranging accuracy of the ranging device worse, so the second ranging information of the positioning device is no longer used to adjust the ranging parameters of the ranging device.

[0116] In some embodiments, step S207 determines the target ranging information according to the adjusted ranging parameters, including:

[0117] Based on the adjustment of the ranging parameters, the second accuracy value is reduced;

[0118] If the second accuracy value is less than the second preset threshold value, the target ranging information is determined based on the second ranging information of the target object determined based on the adjusted ranging parameters.

[0119] The positioning device has a second precision value, and the second precision value is different for different ranging distances. Since the positioning device adjusts the ranging parameters according to the first ranging information and the movement speed determined by the ranging device, the ranging performance of the positioning device is continuously improved during the iteration of the first ranging information and the second ranging information, and its precision is continuously reduced. In order to improve the ranging accuracy of the positioning device, it is also necessary to judge the second precision value. When the second precision value is less than the second preset threshold value, it is considered that the ranging parameter adjustment of the positioning device is completed, and it is no longer necessary to iterate the first ranging information and the second ranging information. For example, the second preset threshold value is 5cm. For an object at a distance of [0, 10m] from the electronic device, the initial second precision value of the positioning device is 8cm. As the ranging parameters are adjusted, the second precision value is continuously reduced. After the ranging parameters are adjusted, the second precision value is 4cm, which is less than 5cm, that is, the second precision value is less than the second preset threshold value, and the precision of the positioning device meets the ranging requirements. Since the positioning device is not affected by the environment, the control device can be mainly based on the positioning device and supplemented by the ranging device in any scenario, and the target ranging information is determined by the second ranging information of the target object determined by the positioning device after the ranging parameters are adjusted. It should be noted that if the second accuracy value of the positioning device does not decrease with the adjustment of the ranging parameters, but increases instead, it means that the adjustment of the ranging parameters of the positioning device based on the first ranging information of the ranging device has a negative effect, making the ranging accuracy of the positioning device worse, so the first ranging information of the ranging device is no longer used to adjust the ranging parameters of the positioning device.

[0120] In some embodiments, after the target ranging information is determined, the ranging device and / or the positioning device is turned off.

[0121] When the electronic device turns on the camera function, the control device turns on the distance measuring device and the positioning device synchronously. After the distance measuring parameters of the distance measuring device and the positioning device are adjusted, and the distance measuring device or the positioning device after the distance measuring parameters are adjusted determines the target distance measuring information of the target object, the control device turns off the distance measuring device and / or the positioning device. If the target object needs to be re-distanced during the shooting process, or the distance measuring parameters of the distance measuring device or the positioning device need to be adjusted, the distance measuring device or the positioning device is turned on again. Compared with the prior art in which the distance measuring device is in a normally open state during the shooting process, turning off the distance measuring device and the positioning device after determining the target distance measuring information can effectively reduce the power consumption of the electronic device during the shooting process.

[0122] For example, an electronic device uses a TOF sensor as a distance measuring device and a UWB sensor as a positioning device. The power consumption of the TOF sensor is 50mW and the power consumption of the UWB sensor is 10mW. The process of a user using the electronic device to shoot takes a total of 30s, while the control device only needs 5ms to adjust the distance measuring parameters and determine the target distance measuring information through multiple rounds of iterations of the first distance measuring information of the distance measuring device and the second distance measuring information of the positioning device, that is, the distance measuring device and the positioning device only need to be turned on for 5ms and turned off after determining the target distance measuring information. The power consumption of the TOF sensor and the UWB sensor within 5ms is much less than the power consumption of the TOF sensor in the normally open state within 30s.

[0123] In the present disclosure, the control device performs multiple rounds of iterations based on the first ranging information of the ranging device and the second ranging information of the positioning device to achieve the integration of multiple ranging technologies, improve the ranging accuracy of the target object, and enable the control device to automatically adjust the shooting parameters based on the target ranging information, effectively improve the shooting quality of dynamic objects, and reduce power consumption during the shooting process, so as to meet the product design goals and enhance the user experience.

[0124] The exemplary embodiment of the present disclosure provides a shooting control device, which is applied to an electronic device with a camera. Figure 3 As shown, a block diagram of a shooting control device shown in the present disclosure.

[0125] The block diagram includes: an acquisition module 31, an adjustment module 32, and an execution module 33. The acquisition module 31 is used to acquire target distance measurement information of a target object based on a distance measurement device and a positioning device, and the target object is a focus object of a camera; the adjustment module 32 is used to adjust the shooting parameters of the camera based on the target distance measurement information; and the execution module 33 is used to shoot based on the adjusted shooting parameters.

[0126] In an exemplary embodiment of the present disclosure, the acquisition module 31 is also used to: determine first ranging information of the target object based on the ranging device; determine second ranging information of the target object based on the positioning device; adjust the ranging parameters of the ranging device and / or the ranging parameters of the positioning device according to the first ranging information and the second ranging information; and determine the target ranging information according to the adjusted ranging parameters.

[0127] In an exemplary embodiment of the present disclosure, the acquisition module 31 is also used to: determine the ranging angle and / or ranging range of the positioning device based on the ranging information of the ranging device on the multiple objects when the positioning device scans multiple objects; determine the second ranging information of the target object based on the ranging angle and / or ranging range.

[0128] In an exemplary embodiment of the present disclosure, the acquisition module 31 is also used to: acquire first auxiliary information based on a motion sensor, the first auxiliary information is used to characterize posture information of the electronic device, the posture information includes at least one of the following: motion information, angle information; based on the first auxiliary information, adjust the ranging parameters of the positioning device; based on the adjusted ranging parameters, determine the second ranging information of the target object.

[0129] In an exemplary embodiment of the present disclosure, the acquisition module 31 is also used to: acquire second auxiliary information, the second auxiliary information is used to characterize information of the target object; adjust the ranging parameters of the positioning device based on the first auxiliary information and the second auxiliary information; and determine the second ranging information of the target object based on the adjusted ranging parameters.

[0130] In an exemplary embodiment of the present disclosure, the ranging parameters of the positioning device include at least one of the following: a second sampling frequency, a second signal interval frequency, and a second signal timing. The acquisition module 31 is also used to: acquire the movement speed of the electronic device based on the first auxiliary information; acquire the movement speed of the target object based on the second auxiliary information; adjust the second sampling frequency, the second signal interval frequency, and the second signal timing based on the movement speed of the electronic device and / or the movement speed of the target object; wherein the second sampling frequency, the second signal interval frequency, and the second signal timing are positively correlated with the movement speed of the electronic device and the movement speed of the target object.

[0131] In an exemplary embodiment of the present disclosure, the first ranging information includes a first ranging distance, the second ranging information includes a second ranging distance, and the ranging parameters of the ranging device include at least one of the following: a first integration time and a first sampling time. The acquisition module 31 is further used to: adjust the first integration time and the first sampling time based on the difference between the first ranging distance and the second ranging distance; wherein the first integration time and the first sampling time are positively correlated with the difference.

[0132] In an exemplary embodiment of the present disclosure, the acquisition module 31 is also used to: reduce the first accuracy value based on the adjustment of the ranging parameters; if the first accuracy value is less than the first preset threshold value, determine the target ranging information based on the first ranging information of the target object determined based on the adjusted ranging parameters.

[0133] In an exemplary embodiment of the present disclosure, the acquisition module 31 is also used to: reduce the second accuracy value based on the adjustment of the ranging parameters; if the second accuracy value is less than the second preset threshold value, determine the target ranging information based on the second ranging information of the target object determined based on the adjusted ranging parameters.

[0134] In an exemplary embodiment of the present disclosure, the execution module 33 is further configured to: turn off the distance measuring device and / or the positioning device after the target distance measuring information is determined.

[0135] In an exemplary embodiment of the present disclosure, the distance measuring device is a TOF sensor, and the positioning device is a UWB sensor.

[0136] Regarding the shooting control device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0137] Figure 4 4 is a block diagram of an electronic device 400 according to an exemplary embodiment. For example, the electronic device 400 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0138] Reference Figure 4 , the electronic device 400 may include one or more of the following components: a processing component 402 , a memory 404 , a power component 406 , a multimedia component 408 , an audio component 410 , an input / output (I / O) interface 412 , a sensor component 414 , and a communication component 416 .

[0139] The processing component 402 generally controls the overall operation of the electronic device 400, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 420 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 402 may include one or more modules to facilitate the interaction between the processing component 402 and other components. For example, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.

[0140] The memory 404 is configured to store various types of data to support operations on the electronic device 400. Examples of such data include instructions for any application or method operating on the electronic device 400, contact data, phone book data, messages, pictures, videos, etc. The memory 404 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0141] The power supply component 406 provides power to the various components of the electronic device 400. The power supply component 406 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 400.

[0142] The multimedia component 408 includes a screen that provides an output interface between the electronic device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 408 includes a front camera and / or a rear camera. When the electronic device 400 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0143] The audio component 410 is configured to output and / or input audio signals. For example, the audio component 410 includes a microphone (MIC), and when the electronic device 400 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 404 or sent via the communication component 416. In some embodiments, the audio component 410 also includes a speaker for outputting audio signals.

[0144] I / O interface 412 provides an interface between processing component 402 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0145] The sensor assembly 414 includes one or more sensors for providing various aspects of status assessment for the electronic device 400. For example, the sensor assembly 414 can detect the open / closed state of the electronic device 400, the relative positioning of components, such as the display and keypad of the electronic device 400, and the sensor assembly 414 can also detect the position change of the electronic device 400 or a component of the electronic device 400, the presence or absence of user contact with the electronic device 400, the orientation or acceleration / deceleration of the electronic device 400, and the temperature change of the electronic device 400. The sensor assembly 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 414 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 414 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0146] The communication component 416 is configured to facilitate wired or wireless communication between the electronic device 400 and other devices. The electronic device 400 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 416 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0147] In an exemplary embodiment, the electronic device 400 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0148] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 404 including instructions, and the instructions can be executed by a processor 420 of an electronic device 400 to complete the above-mentioned shooting control method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0149] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables a processing device of the electronic device to execute a shooting control method provided by an exemplary embodiment of the present disclosure.

[0150] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0151] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A shooting control method, characterized in that: Applied to an electronic device having a camera, the shooting control method includes: Acquiring target distance measurement information of a target object based on a distance measurement device and a positioning device, wherein the target object is a focus object of the camera; Adjusting the shooting parameters of the camera based on the target ranging information; Based on the adjusted shooting parameters, shooting is performed.

2. The shooting control method according to claim 1, characterized in that: The method of obtaining target distance measurement information of the target object based on the distance measurement device and the positioning device includes: Determine first ranging information of the target object based on the ranging device; Determine second ranging information of the target object based on the positioning device; adjusting a ranging parameter of the ranging device and / or a ranging parameter of the positioning device according to the first ranging information and the second ranging information; The target ranging information is determined according to the adjusted ranging parameters.

3. The shooting control method according to claim 2, characterized in that: The determining the second ranging information of the target object based on the positioning device includes: When the positioning device scans multiple objects, based on the ranging information of the multiple objects by the ranging device, determining the ranging angle and / or ranging range of the positioning device; Based on the ranging angle and / or the ranging range, second ranging information of the target object is determined.

4. The shooting control method according to claim 2, characterized in that: The determining the second ranging information of the target object based on the positioning device includes: Acquiring first auxiliary information based on a motion sensor, where the first auxiliary information is used to characterize posture information of the electronic device, where the posture information includes at least one of the following: motion information and angle information; Adjusting the ranging parameters of the positioning device based on the first auxiliary information; The second ranging information of the target object is determined based on the adjusted ranging parameters.

5. The shooting control method according to claim 4, characterized in that: The determining the second ranging information of the target object based on the positioning device includes: Acquire second auxiliary information, where the second auxiliary information is used to represent information of the target object; Adjusting the ranging parameters of the positioning device based on the first auxiliary information and the second auxiliary information; The second ranging information of the target object is determined based on the adjusted ranging parameters.

6. The shooting control method according to claim 5, characterized in that: The ranging parameters of the positioning device include at least one of the following: a second sampling frequency, a second signal interval frequency, and a second signal timing. The adjusting the ranging parameters of the positioning device based on the first auxiliary information and the second auxiliary information includes: Acquire a movement speed of the electronic device based on the first auxiliary information; Acquire a moving speed of the target object based on the second auxiliary information; Adjusting the second sampling frequency, the second signal interval frequency, and the second signal timing based on the movement speed of the electronic device and / or the movement speed of the target object; The second sampling frequency, the second signal interval frequency, and the second signal timing are positively correlated with the movement speed of the electronic device and the movement speed of the target object.

7. The shooting control method according to claim 2, characterized in that: The first ranging information includes a first ranging distance, the second ranging information includes a second ranging distance, and the ranging parameter of the ranging device includes at least one of the following: a first integration time, a first sampling time, and adjusting the ranging parameter of the ranging device and / or the ranging parameter of the positioning device according to the first ranging information and the second ranging information includes: Adjusting the first integration time and the first sampling time based on a difference between the first ranging distance and the second ranging distance; The first integration time and the first sampling time are positively correlated with the difference.

8. The shooting control method according to claim 2, characterized in that: The distance measuring device is provided with a first accuracy value, and the target distance measuring information is determined according to the adjusted distance measuring parameter, including: Based on the adjustment of the ranging parameter, reducing the first accuracy value; If the first accuracy value is less than a first preset threshold value, the target ranging information is determined based on the first ranging information of the target object determined based on the adjusted ranging parameters.

9. The shooting control method according to claim 2, characterized in that: The positioning device is provided with a second accuracy value, and the target ranging information is determined according to the adjusted ranging parameter, including: Based on the adjustment of the ranging parameter, reducing the second accuracy value; If the second accuracy value is less than a second preset threshold value, the target ranging information is determined based on the second ranging information of the target object determined based on the adjusted ranging parameters.

10. The shooting control method according to any one of claims 1 to 9, characterized in that: When the target distance measurement information is determined, the distance measurement device and / or the positioning device is turned off.

11. The shooting control method according to any one of claims 1 to 10, characterized in that: The distance measuring device is a TOF sensor, and the positioning device is a UWB sensor.

12. A shooting control device, characterized in that: Applied to an electronic device having a camera, the shooting control device comprises: An acquisition module, used for acquiring target distance measurement information of a target object based on a distance measurement device and a positioning device, wherein the target object is a focus object of the camera; An adjustment module, used for adjusting the shooting parameters of the camera based on the target ranging information; The execution module is used to perform shooting based on the adjusted shooting parameters.

13. An electronic device, characterized in that: The electronic device comprises: sensor; Camera; processor; a memory for storing processor-executable instructions; The processor is configured to execute executable instructions in the memory to implement the shooting control method according to any one of claims 1 to 11.

14. A non-transitory computer-readable storage medium having executable instructions stored thereon, characterized in that: When the executable instruction is executed by the processor, the shooting control method according to any one of claims 1 to 11 is implemented.

Images