Processing method, processing device and electronic equipment

Abstract

The invention provides a processing method, a processing device and electronic equipment, and the processing method comprises the steps: obtaining a target parameter which represents that the electronic equipment with an image collection device generates jitter; determining a compensation distance based on the target parameter; in response to a control instruction used for indicating the target focusing distance, the image acquisition device obtains an acquisition image according to the first focusing distance, the acquisition image is used for display output and is a clear image, and the first focusing distance is the sum of the target focusing distance and the compensation distance.

Description

Technical Field

[0001] The present disclosure relates to the field of camera and machine vision technology, specifically to the field of optical image stabilization technology, and more specifically to a processing method, a processing device, and an electronic device. Background Art

[0002] Electronic devices, especially photographic devices and video cameras, are prone to shaking when capturing images or recording videos, resulting in blurred images or jittery videos. For this reason, anti-shake technology is applied to electronic devices. By setting an anti-shake system in electronic devices, this shaking is reduced, the shooting quality is improved, and the clarity and stability of the image or video are ensured. Summary of the invention

[0003] A first aspect of an embodiment of the present disclosure provides a processing method, including: obtaining a target parameter, the target parameter characterizing that an electronic device having an image acquisition device has generated jitter; determining a compensation distance based on the target parameter; in response to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a first focus distance, the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

[0004] According to an embodiment of the present disclosure, the method further includes: in response to the target parameter satisfying a trigger condition, determining a compensation distance based on the target parameter.

[0005] According to an embodiment of the present disclosure, the method also includes: determining anti-shake compensation based on target parameters, the anti-shake compensation is used to adjust the first focusing distance of the image acquisition device to obtain a captured image; in response to a control instruction used to indicate the target focusing distance, the image acquisition device obtains the captured image at a second focusing distance, wherein the second focusing distance is the sum of the first focusing distance and the anti-shake compensation.

[0006] According to an embodiment of the present disclosure, determining a compensation distance based on target parameters includes: determining position information of an anti-shake device of an image acquisition device in a first direction based on the target parameters; determining a compensation distance for focusing the image acquisition device in a second direction based on the position information; wherein the first direction is orthogonal to the second direction, and the second direction is a focusing direction of the image acquisition device.

[0007] According to an embodiment of the present disclosure, in response to a control instruction for indicating a target focus distance, an image acquisition device obtains a captured image at a first focus distance, including: after the image acquisition device completes focusing based on the target focus distance, a target parameter indicates that the electronic device has generated jitter, and the image acquisition device is compensated for focusing based on the compensation distance, so that the image acquisition device obtains the captured image at the first focus distance.

[0008] According to an embodiment of the present disclosure, in response to a control instruction for indicating a target focus distance, an image acquisition device obtains a captured image at a first focus distance, and also includes: in response to the electronic device moving from a first position to a second position, determining a first focus distance corresponding to the second position based on a compensation distance and the target focus distance corresponding to the first position; focusing the image acquisition device based on the first focus distance corresponding to the second position, so that the image acquisition device obtains a captured image corresponding to the second position at the first focus distance corresponding to the second position.

[0009] The second aspect of the embodiments of the present disclosure also provides a processing device, including: an acquisition module, configured to obtain a target parameter, the target parameter characterizing that an electronic device having an image acquisition device has generated jitter; a determination module, configured to determine a compensation distance based on the target parameter; a response module, configured to respond to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a first focus distance, the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

[0010] The third aspect of the embodiments of the present disclosure also provides an electronic device, including: a first sensor, configured to obtain a target parameter, the target parameter characterizing that the electronic device has generated a jitter; an image acquisition device, including a processor, a second sensor and a lens, the processor being communicatively coupled to the first sensor, the second sensor and the lens; the processor being configured to: determine a compensation distance based on the target parameter; and in response to a control instruction for indicating a target focus distance, adjust the relative position between the second sensor and the lens so that the image acquisition device obtains a captured image at a first focus distance, the captured image being used for display output, and the captured image being a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

[0011] According to an embodiment of the present disclosure, the image acquisition device also includes: an anti-shake device, which is communicatively coupled to the lens, and the anti-shake device is configured to control the lens to move in a first direction when the electronic device shakes; the processor is also configured to: determine anti-shake compensation based on target parameters, and adjust the image acquisition device according to the anti-shake compensation to obtain a first focusing distance of the captured image.

[0012] According to an embodiment of the present disclosure, it also includes: a display device, which is communicatively coupled to the image acquisition device and is configured to display the acquired image obtained by the image acquisition device.

[0013] The fourth aspect of the embodiments of the present disclosure also provides a computer-readable storage medium on which executable instructions are stored. When the instructions are executed by a processor, the processor executes the above-mentioned audio information recognition method.

[0014] The fifth aspect of the embodiments of the present disclosure also provides a computer program product, including a computer program, which implements the above-mentioned audio information recognition method when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0016] Figure 1 A diagram schematically shows an application scenario of a processing method, a device, and an electronic device according to an embodiment of the present disclosure;

[0017] Figure 2 The working principle diagram of the image acquisition device according to the embodiment of the present disclosure is schematically shown;

[0018] Figure 3 A flowchart of a processing method according to an embodiment of the present disclosure is schematically shown;

[0019] Figure 4 A flowchart schematically shows a processing method according to another embodiment of the present disclosure;

[0020] Figure 5 A flowchart schematically shows a processing method according to another embodiment of the present disclosure;

[0021] Figure 6 Schematically showing a fitting curve diagram of different positions of an OIS device and corresponding simulation signals according to an embodiment of the present disclosure;

[0022] Figure 7 Schematically showing a fitting curve diagram of different positions of an OIS device and corresponding compensation signals according to an embodiment of the present disclosure;

[0023] Figure 8 The structure block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown;

[0024] Fig. 9 The structure block diagram of an electronic device according to another embodiment of the present disclosure is schematically shown;

[0025] Fig.10 A block diagram schematically shows a structure of a processing device according to an embodiment of the present disclosure; and

[0026] Fig.11 A block diagram of an electronic device suitable for implementing an audio information recognition method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0028] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0029] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.

[0030] Some block diagrams and / or flow charts are shown in the accompanying drawings. It should be understood that some blocks or combinations thereof in the block diagrams and / or flow charts may be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that these instructions, when executed by the processor, may create a device for implementing the functions / operations described in these block diagrams and / or flow charts.

[0031] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and features of different embodiments or examples, unless they are contradictory.

[0032] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0033] In the technical solution of the present disclosure, the data involved (including but not limited to data used for analysis, stored data, displayed data, etc.) are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0034] Figure 1 The application scenario diagram of the processing method, device and electronic device according to the embodiments of the present disclosure is schematically shown.

[0035] like Figure 1 As shown, the electronic device 110 may be an electronic device having an image acquisition device. It is understood that the electronic device 110 provided in some embodiments of the present disclosure may include but is not limited to a camera, a tablet computer, a smart phone, a wearable electronic device, a head-mounted electronic device, etc. The electronic device 110 may obtain a captured image through an image acquisition device. The image acquisition device may be a part of the electronic device 110. The data connection of each component in the electronic device 110 may include various connection types, such as wired, wireless communication links, etc.

[0036] The image acquisition device may be provided with an anti-shake device. The anti-shake device may be used to offset the movement of the image acquisition device during exposure by adjusting the position of the lens or image sensor when the image acquisition device acquires the acquired image, thereby maintaining the stability and clarity of the acquired image.

[0037] Figure 2 The working principle diagram of the image acquisition device according to an embodiment of the present disclosure is schematically shown.

[0038] like Figure 2 As shown, the anti-shake device 211 of the image acquisition device 210 can be an OIS device using a suspension wire and a spring. When the electronic device 110 shakes and causes the OIS device to move left and right (X / Y direction), the lens 212 will move left and right with the displacement of the OIS device. Ideally, when the OIS device moves left and right, the lens 212 will not be offset in the Z direction, and the distance between the lens and the sensor 213 should be fixed. In fact, due to the system deformation of the suspension wire and the spring itself, after the focus of the lens is locked in the software, as the OIS device moves left and right, the distance between the lens and the sensor in the Z direction may change.

[0039] For example, when a user holds an image acquisition device to shoot an object in front (for example, 50 meters in front), the shaking of the user's hand can be output to the OIS device. When the OIS device starts working, as the OIS device moves left and right, the distance between the lens and the sensor in the Z direction may change. When this displacement exceeds the depth of field range of the image acquisition device, it may cause the preview clarity of the image acquisition device to change, causing the image acquisition device 210 to need to focus repeatedly, making the focus slower and requiring longer time to stabilize the clarity. In this case, the user level obtains blurry captured images with a low filming rate. For example, the user obtains 10 captured images, and 3 of them are blurry.

[0040] In view of this, embodiments of the present disclosure provide a processing method, a processing device, and an electronic device.

[0041] Understandably, Figure 1 The number and type of electronic devices, image acquisition devices, and anti-shake devices are only illustrative. Depending on the implementation requirements, any number and type of electronic devices, image acquisition devices, and anti-shake devices may be provided.

[0042] The following will be based on Figure 1 and Figure 2 The scene described by Figure 3~Figure 7 The processing method of the disclosed embodiment is described in detail.

[0043] Figure 3 The flowchart schematically shows a processing method according to an embodiment of the present disclosure.

[0044] like Figure 3 As shown, the processing method 300 of this embodiment may include S310 to S330, for example.

[0045] At S310 , target parameters are obtained.

[0046] At S320 , a compensation distance is determined based on the target parameter.

[0047] In S330 , in response to a control instruction for indicating a target focus distance, the image acquisition device obtains an acquired image at a first focus distance.

[0048] According to an embodiment of the present disclosure, the target parameter may be a parameter that indicates that an electronic device having an image acquisition device has jittered, such as when a user shakes a mobile phone when taking a photo. When the electronic device has jittered, the jitter may be sensed based on the sensor of the electronic device and converted into a target parameter. The target parameter may be the obtained angle of displacement of the OIS device, or the acceleration, speed, etc. of the movement of the OIS device.

[0049] According to the embodiments of the present disclosure, the focus distance can be understood as the distance between the lens and the imaging surface (photosensitive element, also referred to as image sensor) in the image acquisition device (i.e., image distance), and the focusing process can be understood as the process of adjusting the image distance. Focusing completion can be understood as adjusting the image distance so that the image distance, the distance between the lens of the image acquisition device and the photographed object (i.e., object distance), and the focal length of the lens meet the imaging conditions. At this time, the captured image obtained by the image acquisition device can be referred to as a clear image. The clear image is presented at the user level so that the user's naked eyes can clearly see the faces, lines, scenery, etc. of the characters in the captured image.

[0050] It should be noted that since the focus is completed when the distance between the lens of the image acquisition device and the photographed object and the focal length of the lens meet the imaging condition, the focus distance can be understood as the distance between the lens of the image acquisition device and the photographed object, the focusing process can be understood as the process of adjusting the object distance, and the focus completion can be understood as adjusting the object distance so that the image distance, the object distance and the focal length of the lens meet the imaging condition. The imaging condition can be that the sum of the reciprocal of the object distance and the reciprocal of the image distance is equal to the reciprocal of the focal length.

[0051] The target focus distance can be understood as the focus distance required for the image acquisition device to obtain a clear captured image under ideal conditions, that is, when the electronic device does not shake during the shooting process or even if it shakes, the focus distance is not affected.

[0052] The compensation distance can be used to compensate for the deviation of the target focus distance caused by the shaking of the electronic device. The first focus distance is obtained by compensating the target focus distance with the compensation distance, which can offset the influence of the shaking of the electronic device on the focus of the image acquisition device.

[0053] According to an embodiment of the present disclosure, the captured image obtained by the image capture device at the first focusing distance can be used for display output.

[0054] In some examples, the electronic device may be an electronic device having a display device, and after the image acquisition device acquires the acquired image, the acquired image is displayed on the display device.

[0055] In other examples, the electronic device can send the acquired captured image to other devices with display devices that are communicatively coupled to the electronic device for display, for example, transferring photos taken by the user's mobile phone to a computer for display. For another example, the user sends photos taken by the mobile phone to a friend's mobile phone through a chat software for display. The communication coupling method can include various connection types, such as wired, wireless communication links or fiber optic cables, etc. Among them, the wired method can be, for example, connected by a cable and any of the following multiple interfaces: fiber channel, infrared interface, D-type data interface, serial interface, USB interface, USB Type-C interface or Dock interface, and the wireless method can be, for example, connected by wireless communication, wherein the wireless communication can be, for example, any of multiple wireless technology standards such as Bluetooth, Wi-Fi, Infrared, ZigBee, etc.

[0056] Through the processing method of this embodiment, in the process of the image acquisition device acquiring an image, the compensation distance for compensating the focus is determined according to the target parameter characterizing the jitter of the electronic device, so that the image acquisition device can obtain the acquired image according to the compensated focus distance, and there is no need to frequently trigger the focus due to the jitter of the electronic device, thereby improving the stability, clarity and film formation rate of the acquired image obtained by the image acquisition device, and improving the user experience.

[0057] Figure 4 The flowchart schematically shows a processing method according to another embodiment of the present disclosure.

[0058] like Figure 4 As shown, in Figure 3 On the basis of the processing method shown, the processing method 400 of this embodiment may further include S410 to S430, for example.

[0059] At S410 , target parameters are obtained.

[0060] At S420, it is determined whether the target parameter meets the trigger condition.

[0061] In S430 , in response to the target parameter satisfying the trigger condition, a compensation distance is determined based on the target parameter, and S440 is executed.

[0062] In S440, in response to the control instruction for indicating the target focus distance, the image acquisition device obtains an acquired image at a first focus distance.

[0063] At S450, in response to the target parameter not satisfying the trigger condition, the image acquisition device obtains an acquired image at the target focus distance in response to a control instruction for indicating the target focus distance.

[0064] According to the embodiments of the present disclosure, when the electronic device shakes, as the OIS device moves left and right, the distance between the lens and the sensor in the Z direction changes. If this distance change does not exceed the depth of field range of the image acquisition device, it will not cause the preview clarity of the image acquisition device to change. At this time, focus compensation for the target focus distance may not be performed. When the electronic device shakes, although the OIS device moves left and right, the system deformation of the suspension wire and the spring caused by its left and right movement is very small, which is not enough to change the distance between the lens and the sensor in the Z direction, and will not cause the preview clarity of the image acquisition device to change. At this time, focus compensation for the target focus distance may not be performed.

[0065] Based on this, Figure 3 On the basis of the processing method shown, the processing method of this embodiment can also add a trigger logic for the compensation distance, that is, after obtaining the target parameter, it is pre-determined whether the target parameter meets the trigger condition. The trigger condition can cause the jitter of the electronic device to affect the focus distance between the lens and the sensor in the Z direction.

[0066] When the target parameter meets the trigger condition, the compensation distance is determined based on the target parameter, and then the target focus distance is compensated and focused based on the compensation distance, so that the image acquisition device obtains the captured image at the first focus distance.

[0067] When the target parameters do not meet the trigger conditions, there is no need to perform compensation focus, and the image acquisition device obtains the captured image at the target focal distance.

[0068] For example, the target focus distance indicated by the control instruction is 500 code. When the distance between the lens and the photographed object does not change, if the OIS device works to the X-axis -600 DAC position due to hand shaking, the IC of the OIS device automatically compensates for the focus direction according to the compensation value 12code corresponding to the -600 position. That is, when the external control instruction for focusing is 500 code, the IC automatically performs focusing according to the first focus distance 512 code (500code sent by the upper layer + compensation value 12code calculated by the IC). If the OIS device works to the X-axis -502 DAC position due to hand shaking, it will not affect the image clarity. At this time, there is no need to compensate for the focus. The IC of the OIS device automatically performs focusing according to the target focus distance 500code.

[0069] It should be noted that for details not included in the processing method of this embodiment, please refer to Figure 3 The processing method embodiment shown will not be described in detail here.

[0070] Through the processing method of this embodiment, before determining the compensation distance based on the target parameters, a judgment logic is added as to whether the target parameters meet the trigger conditions. When the jitter of the electronic device is not sufficient to affect the clarity of the captured image, the image acquisition device is directly controlled to obtain the captured image at the target focus distance. There is no need to determine the compensation distance and perform compensation focus every time there is jitter, which can save transmission resources and processing resources.

[0071] Figure 5 The flowchart schematically shows a processing method according to another embodiment of the present disclosure.

[0072] like Figure 5 As shown, in Figure 5 On the basis of the processing method shown, the processing method 500 of this embodiment may further include S510 to S540, for example.

[0073] At S510 , target parameters are obtained.

[0074] At S520 , a compensation distance is determined based on the target parameter.

[0075] At S530 , an anti-shake compensation is determined based on the target parameter.

[0076] At S540, in response to the control instruction for indicating the target focus distance, the image acquisition device obtains an acquired image at a second focus distance.

[0077] According to an embodiment of the present disclosure, anti-shake compensation is used to adjust a first focus distance of an image acquisition device to obtain a captured image.

[0078] When an electronic device shakes, for example, when a user moves the electronic device while holding it to take a photo, the object being photographed may deviate from the center of the lens, and may also affect the distance between the lens and the photosensitive element in the focusing direction.

[0079] Based on this, as a feasible implementation method, anti-shake compensation can be determined based on the target parameters. On the one hand, the offset of the photographed object can be compensated based on the anti-shake compensation, and on the other hand, focus compensation can be performed based on the anti-shake compensation. That is, after obtaining the target parameters, the compensation distance and anti-shake compensation are determined based on the target parameters, and then the compensation distance and anti-shake compensation are determined based on the target parameters to compensate for the target focus distance. At this time, the second focus distance of the captured image obtained by the image acquisition device can be the sum of the first focus distance and the anti-shake compensation.

[0080] It should be noted that the processing method of this embodiment may also incorporate the judgment logic of the above-mentioned trigger conditions. For details not provided by the processing method of this embodiment, please refer to the aforementioned embodiment section and will not be repeated here.

[0081] Through the processing method of this embodiment, the anti-shake compensation is further determined based on the target parameters, and the anti-shake compensation is applied to the focus compensation to further improve the focus accuracy and stability. That is, the processing method not only compensates for the offset of the acquired image based on the target parameters, but also performs focus compensation of the acquired image based on the target parameters, thereby improving the accuracy and stability of the acquired image.

[0082] Based on the above embodiments, in some embodiments, determining the compensation distance based on the target parameter may include:

[0083] The position information of the anti-shake device of the image acquisition device in the first direction is determined based on the target parameter, and the compensation distance of the image acquisition device in the second direction is determined based on the position information.

[0084] According to an embodiment of the present disclosure, the second direction may be a focusing direction of the image acquisition device, that is, a direction in which the image sensor points to the lens ( Figure 2 The first direction may be orthogonal to the second direction, such as Figure 2 The X / Y direction is shown. That is, the processing method of this embodiment can not only apply the obtained target parameters in the X / Y direction to the compensation in the X / Y direction, but also apply the obtained target parameters in the X / Y direction to the focus compensation in the Z direction. In the related art, only the obtained target parameters in the X / Y direction are applied to the compensation in the X / Y direction.

[0085] Through the processing method of this embodiment, the target parameter of the electronic device's jitter in one direction is applied to the focus compensation in another direction, which not only takes into account the impact of the electronic device's jitter in one direction on the acquired image obtained in that direction, but also takes into account the impact on the acquired image obtained in another direction, thereby further improving the accuracy of the acquired image and improving the stability of image acquisition.

[0086] In some embodiments of the present disclosure, the processing method may further include: obtaining and storing compensation distances corresponding to different target parameters in advance.

[0087] According to an embodiment of the present disclosure, when an electronic device generates jitters of different amplitudes, the corresponding target parameters may be different. For example, if the jitter amplitude of the electronic device is large, the displacement in the X / Y direction is larger, and the compensation distance determined based on the target parameters may be different. Based on this, the compensation distances corresponding to different target parameters can be obtained in advance and stored, and the storage method can be mapping storage. Later, in the actual process of obtaining the captured image, after obtaining the current target parameters, the compensation distance corresponding to the current target parameters can be directly determined.

[0088] As some feasible implementations, obtaining the compensation distances corresponding to different target parameters may include, for example:

[0089] Fix the distance between the electronic device and the object being photographed and place the OIS device in the center (with Figure 2 The orientation shown in the figure corresponds to X=0, Y=0), and the distance between the lens and the image sensor when the collected image at the center position is a clear image is determined as the focus distance reference.

[0090] On this basis, the OIS device is pushed to different positions of the X-axis or Y-axis (corresponding to different target parameters) with a preset step size, and the best clear position is determined at different positions. The difference between the best clear position and the center position is the compensation distance corresponding to the OIS device at different positions.

[0091] Table 1 schematically shows the compensation distances corresponding to the OIS devices at different positions.

[0092] Table 1

[0093]

[0094] In Table 1, DAC (Digital-to-Analog Converter) is a digital-to-analog converter that can convert digital signals into analog signals. In auto focus (AF), the role of DAC is to convert the calculated digital signal into an analog current or voltage signal to drive the movement of the lens motor. Different positions (shift on) of OIS on the X / Y axis require corresponding different DACs (OIS Position) to achieve control of different positions.

[0095] It should be noted that Table 1 shows the step distances corresponding to different target parameters obtained from -1000 dac to 1000 dac, with every 200 dac as a step. In actual application scenarios, the jitter amplitude of electronic devices can be random, and the OIS moving position can also be random. Therefore, the DAC position and compensation distance corresponding to the discrete OIS device position obtained in Table 1 can be fitted to obtain the relationship between the continuous position of the OIS device and the corresponding compensation distance, and obtain the compensation model.

[0096] Figure 6 The figure schematically shows a fitting curve diagram of different positions of the OIS device and the corresponding simulation signals according to an embodiment of the present disclosure. Figure 7 The figure schematically shows a fitting curve diagram of different positions of the OIS device and the corresponding compensation signals according to an embodiment of the present disclosure.

[0097] like Figure 6 As shown, with the center as the reference point, the horizontal axis represents the position of the OIS device in the X direction and the Y direction, and the vertical axis represents the analog signal size required to control the OIS device to move to the corresponding position. Figure 7 As shown, with the center as the reference point, the horizontal axis represents the position of the OIS device in the X direction and the Y direction, and the vertical axis represents the size of the compensation distance corresponding to controlling the OIS device to be in different positions.

[0098] pass Figure 6 and Figure 7 After processing, the compensation distances corresponding to the OIS device at different positions can be obtained.

[0099] The compensation distances corresponding to the different target parameters obtained in advance can be stored in, for example, a memory of the electronic device 110, or in a memory independent of the electronic device 110, such as a memory independent of the audio acquisition component of the electronic device 110. It can also be stored in an independent storage chip independent of the electronic device 110 and the audio acquisition component. The storage chip can be a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. The storage unit can also use a double-rate synchronous dynamic random access memory chip (DDR), such as DDR3, DDR4, DDR5, etc., or a low-power double data rate memory chip (LPDDR), such as LPDDR3, LPDDR4, LPDDR5, etc., which is not limited by the present disclosure.

[0100] With the processing method of this embodiment, since the compensation distances corresponding to different target parameters are obtained and stored in advance, when actually obtaining the captured image, the compensation distance corresponding to the current target parameter can be quickly obtained, thereby shortening the focusing time.

[0101] In actual applications, when acquiring images based on the above processing method, various application scenarios can be corresponded to, and some scenarios are listed below for illustration.

[0102] Based on the above embodiment, in response to the control instruction for indicating the target focus distance, the image acquisition device obtains the captured image at the first focus distance, which may include:

[0103] After the image acquisition device completes focusing based on the target focusing distance, the target parameter indicates that the electronic device has generated jitter, and the image acquisition device is compensated for focusing based on the compensation distance so that the image acquisition device obtains a captured image at the first focusing distance.

[0104] According to an embodiment of the present disclosure, after the user holds the electronic device and aims it at the object to be photographed and completes the focusing, the captured image previewed on the electronic device is clear. At this time, the OIS device is triggered to work due to the shaking of the user's hand. The movement of the OIS device drives the distance between the lens and the image sensor in the Z-axis direction to change. At this time, the IC of the image acquisition device can directly obtain the corresponding compensation distance based on the position of the OIS device after shaking, compensate the focus of the lens and image sensor that have been focused, control the lens to move to the target position, and obtain the captured image.

[0105] It should be noted that for any unfinished details in the processing method of this embodiment, please refer to the aforementioned embodiment section and will not be repeated here.

[0106] On the basis of the above embodiment, in response to the control instruction for indicating the target focus distance, the image acquisition device obtains the captured image at the first focus distance, and may further include:

[0107] In response to the electronic device moving from the first position to the second position, a first focus distance corresponding to the second position is determined based on the compensation distance and the target focus distance corresponding to the first position.

[0108] The image acquisition device is focused based on the first focusing distance corresponding to the second position, so that the image acquisition device obtains a captured image corresponding to the second position at the first focusing distance corresponding to the second position.

[0109] According to an embodiment of the present disclosure, after a user completes photographing an object with a handheld electronic device, he needs to photograph another object. At this time, the user needs to move the electronic device to another position. At this time, the first focusing distance of the second position can be determined directly based on the target focusing distance of the first position and the compensation distance of the second position relative to the first position, and the focusing can be completed directly to obtain the captured image.

[0110] It should be noted that for any unfinished details in the processing method of this embodiment, please refer to the aforementioned embodiment section and will not be repeated here.

[0111] Through the processing method of the embodiment of the present disclosure, focus compensation for different scenes in the process of actually acquiring images can be achieved, with higher adaptability and flexibility.

[0112] In the above embodiment, the processing method of this embodiment further includes:

[0113] After the focus is completed, the clarity of the image previewed by the electronic device can be checked. In response to the clarity being less than a clarity threshold, the target parameter is re-obtained, the compensation distance is obtained based on the target parameter, and the compensation focus is re-performed based on the compensation distance. In response to the clarity being greater than or equal to the clarity threshold, the lens is locked at the focused target position.

[0114] Through the processing method of the embodiment of the present disclosure, the clarity of the image is detected in real time, and focus compensation is triggered in real time according to the inspection result, thereby ensuring the clarity and film formation rate of the captured image.

[0115] The embodiment of the present disclosure also provides an electronic device, Figure 8 The electronic device provided by the embodiment of the present disclosure is described. Figure 8 The structural block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown.

[0116] like Figure 8 As shown, the electronic device 800 of this embodiment may include a first sensor 810 and an image acquisition device 820. The image acquisition device 820 may include a processor 821, a second sensor 822 and a lens 823. The processor 821 is communicatively coupled with the first sensor 810, the second sensor 822 and the lens 823.

[0117] The first sensor 810 is configured to obtain a target parameter, where the target parameter indicates that the electronic device 800 has generated a shake.

[0118] The processor 821 is configured to:

[0119] The compensation distance is determined based on the target parameter. In response to the control instruction for indicating the target focus distance, the relative position between the second sensor 822 and the lens 823 is adjusted so that the image acquisition device 820 obtains a captured image at the first focus distance, the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

[0120] Fig. 9 The structural block diagram of an electronic device according to another embodiment of the present disclosure is schematically shown.

[0121] Based on the above embodiment, the image acquisition device 820 may further include:

[0122] An anti-shake device 824 is communicatively coupled to the lens 823, and the anti-shake device 824 is configured to control the lens 823 to move in a first direction when the electronic device 800 shakes;

[0123] The processor 821 is further configured to: determine an anti-shake compensation based on the target parameter, and adjust a first focus distance between the second sensor 822 and the lens 823 according to the anti-shake compensation.

[0124] Based on the above embodiment, the electronic device 800 may further include:

[0125] The display device 830 is communicatively coupled to the image acquisition device 820 , and is configured to display the captured image obtained by the image acquisition device 820 .

[0126] In one example, the first sensor 810 may be a gyroscope, and the obtained target parameter may be the offset angle of the anti-shake device 824. In another example, the first sensor 810 may be an accelerometer, and the obtained target parameter may be the acceleration of the displacement of the anti-shake device 824.

[0127] In one example, the second sensor 822 may be an image sensor.

[0128] It should be noted that the unfinished details of the electronic device of this embodiment and the technical effects brought about can be found in the processing method embodiment part, which will not be repeated here.

[0129] Based on the above processing method, the present disclosure also provides a processing device. Fig.10 The processing device is described in detail.

[0130] Fig.10 The structural block diagram of a processing device according to an embodiment of the present disclosure is schematically shown.

[0131] like Fig.10 As shown, the processing device 1000 of this embodiment may include an obtaining module 1010 , a determining module 1020 , and a responding module 1030 .

[0132] The acquisition module 1010 is configured to acquire a target parameter, wherein the target parameter indicates that the electronic device having the image acquisition device has generated a shake. The acquisition module 1010 can be used to execute S310 described above, which will not be described in detail here.

[0133] The determination module 1020 is configured to determine the compensation distance based on the target parameter. The determination module 1020 can be used to execute S320 described above, which will not be described in detail here.

[0134] The response module 1030 is configured to respond to the control instruction for indicating the target focus distance, and the image acquisition device obtains a captured image at a first focus distance, and the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance. The response module 1030 can be used to execute S330 described above, which will not be repeated here.

[0135] According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits, or at least part of the functions of any one of them can be implemented in one module. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be split into multiple modules for implementation. According to the embodiments of the present invention, any one or more of the modules, submodules, units, and subunits can be at least partially implemented as hardware circuits, such as field programmable gate arrays (FPGAs), programmable logic arrays (PLAs), systems on chips, systems on substrates, systems on packages, application specific integrated circuits (ASICs), or can be implemented by hardware or firmware in any other reasonable way of integrating or packaging circuits, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, according to the embodiments of the present invention, one or more of the modules, submodules, units, and subunits can be at least partially implemented as computer program modules, and when the computer program modules are run, the corresponding functions can be performed.

[0136] For example, any multiple of the acquisition module 1010, the determination module 1020, and the response module 1030 can be combined in one module / unit / sub-unit for implementation, or any one of the modules / units / sub-units can be split into multiple modules / units / sub-units. Alternatively, at least part of the functions of one or more of these modules / units / sub-units can be combined with at least part of the functions of other modules / units / sub-units and implemented in one module / unit / sub-unit. According to an embodiment of the present disclosure, at least one of the acquisition module 1010, the determination module 1020, and the response module 1030 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or by any one of the three implementation methods of software, hardware, and firmware, or by a suitable combination of any of them. Alternatively, at least one of the obtaining module 1010 , the determining module 1020 , and the responding module 1030 may be at least partially implemented as a computer program module, and when the computer program module is executed, a corresponding function may be performed.

[0137] It should be noted that the processing device part in the embodiment of the present disclosure corresponds to the processing method part in the embodiment of the present disclosure, and their specific implementation details are also the same, which will not be repeated here.

[0138] Fig.11 A block diagram of an electronic device suitable for implementing an audio information recognition method according to an embodiment of the present disclosure is schematically shown.

[0139] like Fig.11 As shown, the electronic device 1100 according to an embodiment of the present disclosure includes a processor 1101, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1102 or a program loaded from a storage part 1108 to a random access memory (RAM) 1103. The processor 1101 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 1101 may also include an onboard memory for caching purposes. The processor 1001 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0140] In RAM 1103, various programs and data required for the operation of electronic device 1100 are stored. Processor 1101, ROM 1102 and RAM 1103 are connected to each other through bus 1104. Processor 1101 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 1102 and / or RAM 1103. It should be noted that the program can also be stored in one or more memories other than ROM 1102 and RAM 1103. Processor 1101 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0141] According to an embodiment of the present disclosure, the electronic device 1100 may further include an input / output (I / O) interface 1105, which is also connected to the bus 1104. The electronic device 1100 may further include one or more of the following components connected to the I / O interface 1105: an input portion 1106 including a keyboard, a mouse, etc.; an output portion 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 1108 including a hard disk, etc.; and a communication portion 1109 including a network interface card such as a LAN card, a modem, etc. The communication portion 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed, so that a computer program read therefrom is installed into the storage portion 1108 as needed.

[0142] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.

[0143] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus, or a device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 1102 and / or RAM 1103 described above and / or one or more memories other than ROM 1102 and RAM 1103.

[0144] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the audio information recognition method provided by the embodiment of the present disclosure.

[0145] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 1101. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0146] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 1109, and / or installed from a removable medium 1111. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0147] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1109, and / or installed from the removable medium 1111. When the computer program is executed by the processor 1101, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0148] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0149] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0150] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0151] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A processing method comprising: Obtaining a target parameter, wherein the target parameter indicates that the electronic device having the image acquisition device has generated a jitter; determining a compensation distance based on the target parameter; In response to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a first focus distance, the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

2. The method according to claim 1, further comprising: In response to the target parameter satisfying a trigger condition, the compensation distance is determined based on the target parameter.

3. The method according to claim 1, further comprising: Determine an anti-shake compensation based on the target parameter, where the anti-shake compensation is used to adjust a first focus distance for the image acquisition device to obtain the acquired image; In response to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a second focus distance, wherein the second focus distance is the sum of the first focus distance and the anti-shake compensation.

4. The method according to any one of claims 1 to 3, wherein determining the compensation distance based on the target parameter comprises: Determine position information of the anti-shake device of the image acquisition device in the first direction based on the target parameter; Determine the compensation distance for focusing the image acquisition device in the second direction based on the position information; The first direction is orthogonal to the second direction, and the second direction is the focusing direction of the image acquisition device.

5. The method according to any one of claims 1 to 3, wherein in response to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a first focus distance, comprising: After the image acquisition device completes focusing based on the target focusing distance, the target parameter indicates that the electronic device has generated jitter, and the image acquisition device is compensated for focusing based on the compensation distance so that the image acquisition device obtains a captured image at the first focusing distance.

6. The method according to any one of claims 1 to 3, wherein in response to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a first focus distance, further comprising: In response to the electronic device moving from a first position to a second position, determining a first focus distance corresponding to the second position based on the compensation distance and a target focus distance corresponding to the first position; The image acquisition device is focused based on a first focusing distance corresponding to the second position, so that the image acquisition device obtains a captured image corresponding to the second position at the first focusing distance corresponding to the second position.

7. A processing device comprising: An obtaining module is configured to obtain a target parameter, wherein the target parameter indicates that the electronic device having the image acquisition device has generated a shake; a determination module, configured to determine a compensation distance based on the target parameter; The response module is configured to respond to a control instruction for indicating a target focus distance, the image acquisition device obtains a captured image at a first focus distance, the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

8. An electronic device, comprising: A first sensor is configured to obtain a target parameter, wherein the target parameter indicates that the electronic device has generated a jitter; An image acquisition device, comprising a processor, a second sensor and a lens, wherein the processor is communicatively coupled with the first sensor, the second sensor and the lens; The processor is configured to: determining a compensation distance based on the target parameter; In response to a control instruction for indicating a target focus distance, the relative position between the second sensor and the lens is adjusted so that the image acquisition device obtains a captured image at a first focus distance, the captured image is used for display output, and the captured image is a clear image, wherein the first focus distance is the sum of the target focus distance and the compensation distance.

9. The electronic device according to claim 8, wherein the image acquisition device further comprises: an anti-shake device, communicatively coupled to the lens, the anti-shake device being configured to control the lens to move in a first direction when the electronic device shakes; The processor is further configured to: determine an anti-shake compensation based on the target parameter, and adjust the image acquisition device to obtain a first focus distance of the acquired image according to the anti-shake compensation.

10. The electronic device according to claim 8, further comprising: The display device is communicatively coupled to the image acquisition device and is configured to display the acquired image obtained by the image acquisition device.

Images