Camera device and control method therefor
By acquiring information about camera shake, the timing of shooting is optimized, thus solving the problem of camera shake during user operation and improving the clarity and stability of images and videos.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- ARASHI VISION INC
- Filing Date
- 2024-11-22
- Publication Date
- 2026-05-28
AI Technical Summary
In existing technologies, camera shake during user operation can result in insufficient image or video clarity or ghosting, leading to a poor user experience.
By acquiring shake information during the shooting operation, the moment with the minimum shake intensity or less than the preset shake intensity is determined as the start time for shooting or recording, thus optimizing the shooting timing of the shooting equipment.
It improves the clarity and ghosting issues of target images or videos, enhancing the user experience.
Smart Images

Figure CN2024133870_28052026_PF_FP_ABST
Abstract
Description
Filming equipment and its control methods Technical Field
[0001] This disclosure relates to, but is not limited to, a shooting device and its control method. Background Technology
[0002] In recent years, with the rapid development of shooting technology and the continuous iteration of shooting equipment, shooting equipment with image or video shooting functions has been widely used in people's daily lives. Users can control the shooting equipment to shoot by performing specific shooting operations.
[0003] However, when using related technologies to control the shooting equipment, the execution of the shooting operation will cause the shooting equipment to shake, resulting in problems such as insufficient clarity or ghosting in the captured images or videos, leading to a poor user experience. Summary of the Invention
[0004] The following is an overview of the subject matter described in detail in this disclosure. This overview is not intended to limit the scope of the claims.
[0005] This disclosure provides a shooting device and its control method.
[0006] A first aspect of this disclosure provides a method for controlling a shooting device, the method comprising:
[0007] In response to the user's shooting operation on the shooting device, shake information is acquired, and the shake information is used to characterize the shake intensity of the shooting device at different times during the duration of the shooting operation;
[0008] Based on the shaking information, the start time of the shooting device is determined;
[0009] The target image is obtained by taking a picture at the stated start time.
[0010] A second aspect of this disclosure provides a shooting device, including a memory and a processor, the memory storing a computer program, which, when executed by the processor, is configured to acquire shake information in response to a user's shooting operation on the shooting device, the shake information being used to characterize the shake intensity of the shooting device at different times during the duration of the shooting operation;
[0011] Based on the shaking information, the start time of the shooting device is determined;
[0012] The target image is obtained by taking a picture at the stated start time.
[0013] In the shooting device and control method provided in this disclosure, the shaking intensity of the shooting device at different times during the duration of the shooting operation is used as the basis for determining the start shooting time. On the basis of ensuring that the start shooting time is compatible with the shooting operation, the impact of the shaking of the shooting device on the shooting timing is fully considered, which can improve problems such as insufficient clarity or ghosting of the target image, and improve the image quality and user experience of the target image.
[0014] After reading and understanding the accompanying diagrams and detailed descriptions, the other aspects can be understood. Attached Figure Description
[0015] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of these embodiments. In these drawings, similar reference numerals are used to denote similar elements. The drawings described below are some embodiments of the present disclosure, but not all embodiments. Other drawings will be readily available to those skilled in the art based on these drawings without inventive effort.
[0016] Figure 1 is a flowchart illustrating a control method for a shooting device according to an exemplary embodiment.
[0017] Figure 2 is a schematic diagram of a shooting device according to an exemplary embodiment.
[0018] Figure 3 is a schematic diagram illustrating the start of shooting according to an exemplary embodiment.
[0019] Figure 4 is a flowchart illustrating the determination of the start time of shooting by a shooting device based on jitter information according to an exemplary embodiment.
[0020] Figure 5 is a schematic diagram illustrating a first candidate moment according to an exemplary embodiment.
[0021] Figure 6 is a flowchart illustrating, according to another exemplary embodiment, the determination of the start time of shooting by the shooting device based on jitter information.
[0022] Figure 7 is a schematic diagram illustrating a second candidate moment according to an exemplary embodiment.
[0023] Figure 8 is a flowchart illustrating, according to an exemplary embodiment, how to capture a target image based on the start time of the capture.
[0024] Figure 9 is a schematic diagram illustrating a third candidate moment according to an exemplary embodiment.
[0025] Figure 10 is a flowchart illustrating a control method for a shooting device according to another exemplary embodiment.
[0026] Figure 11 is a schematic diagram illustrating the start and end times of recording according to an exemplary embodiment.
[0027] Figure 12 is a flowchart illustrating, according to an exemplary embodiment, the determination of the end recording time of the shooting device based on the jitter information corresponding to the end recording operation.
[0028] Figure 13 is a schematic diagram illustrating a fourth candidate moment according to an exemplary embodiment.
[0029] Figure 14 is a flowchart illustrating, according to another exemplary embodiment, the determination of the end recording time of the shooting device based on the jitter information corresponding to the end recording operation.
[0030] Figure 15 is a schematic diagram illustrating a fifth candidate moment according to an exemplary embodiment.
[0031] Figure 16 is a schematic diagram illustrating a sixth candidate moment according to an exemplary embodiment.
[0032] Figure 17 is a block diagram of a computer device according to an exemplary embodiment.
[0033] Reference numerals: 100, computer equipment; 101, computing unit; 102, ROM; 103, RAM; 104, bus; 105, input / output interface; 106, input unit; 107, output unit; 108, storage unit; 109, communication unit. Detailed Implementation
[0034] The technical solutions of the disclosed embodiments will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure. It should be noted that, unless otherwise specified, the embodiments and features in the embodiments of this disclosure can be arbitrarily combined with each other.
[0035] In recent years, with the rapid development of shooting technology and the continuous iteration of shooting equipment, such as cameras and mobile phones with image or video shooting functions, shooting equipment has been widely used in people's daily lives. Users can control shooting equipment to shoot through interactive methods such as performing specific shooting operations.
[0036] However, when using related technologies to control the shooting equipment, the user's contact with the shooting equipment during the shooting operation will cause the shooting equipment to shake, and the shaking will be transmitted to the image sensor used for imaging. If the shooting equipment starts shooting or generating the image at a moment when the shaking is large, it will result in problems such as insufficient clarity or motion blur in the captured image or video, affecting the image quality and resulting in a poor user experience.
[0037] This disclosure provides an exemplary embodiment of a shooting device and its control method. When a user's shooting operation is detected, the device acquires shake information and determines the start shooting time based on the shake information. This allows for automatic determination of the shooting timing and acquisition of the target image. By using the shake intensity of the shooting device at different times during the shooting operation's duration as the basis for determining the start shooting time, and ensuring that the start shooting time matches the shooting operation, the impact of the shooting device's shake on the shooting timing is fully considered. This improves issues such as insufficient target image clarity or ghosting, enhancing the image quality and user experience.
[0038] In one exemplary embodiment, a control method for a shooting device is provided, applied to the shooting device, which may include, for example, an electronic device with shooting function such as a camera or a mobile phone. As shown in FIG1, the control method for the shooting device includes the following steps:
[0039] Step S100: In response to the user's shooting operation on the shooting device, acquire shake information. The shake information is used to characterize the shake intensity of the shooting device at different times during the duration of the shooting operation.
[0040] In step S100, the user can perform a shooting operation on the shooting device to trigger the shooting function of the shooting device. The shooting operation can be, for example, pressing the shutter button of the shooting device as shown in Figure 2. When the shooting device recognizes the user's shooting operation, the shooting device acquires shake information.
[0041] The duration of the shooting operation is the time range corresponding to the user completing the entire shooting operation. For example, if the shooting operation is a pressing operation of the shutter button of the shooting device, the duration of the shooting operation is from the moment the user starts pressing the shutter button to the moment the shutter button returns to its initial position after the user lifts their finger.
[0042] Shake information can characterize the shake intensity of the shooting device at multiple different moments during the duration of the user's shooting operation. Shake intensity is the degree of drastic change in the shooting device's posture and position caused by shaking. Shake information can be obtained, for example, through the sensors built into the shooting device.
[0043] Step S200: Determine the start time of shooting using the camera based on the shaking information.
[0044] In step S200, the start shooting time of the shooting device can be determined based on the shake information, i.e., the shake intensity corresponding to different moments during the shooting operation duration, as the timing for controlling the shooting device to start shooting. For example, as shown in FIG3, the moment with the minimum shake intensity or the shake intensity below a certain threshold can be selected as the start shooting time during the shooting operation duration.
[0045] Step S300: Take a picture according to the start shooting time to obtain the target image.
[0046] In step S300, the imaging device takes a picture according to the determined start shooting time to obtain the target image corresponding to this shooting task. For example, the imaging device continuously acquires image exposure data through an image sensor and uses the start shooting time as the starting time for cropping the image exposure data, so as to output the cropped image exposure data as the target image.
[0047] Understandably, by using shake information as the basis for determining the start shooting time, the start shooting time can be matched with the timing of the user's shooting operation, ensuring that the target image can meet the user's shooting intention. Furthermore, it can select a time with less shake as the start shooting time, effectively improving problems such as insufficient image clarity or ghosting caused by camera shake.
[0048] In this embodiment, when a user's shooting operation on the camera is detected, the camera acquires shake information and determines the start shooting time based on this information. This allows for automatic determination of the shooting timing and acquisition of the target image. By using the shake intensity of the camera at different times during the shooting operation as the basis for determining the start shooting time, the impact of camera shake on the shooting timing is fully considered, ensuring that the start shooting time matches the shooting operation. This improves the image quality and user experience by addressing issues such as insufficient image sharpness or ghosting.
[0049] In some embodiments, as shown in FIG4, determining the start time of shooting by the shooting device based on the shake information includes the following steps:
[0050] Step S210: Determine at least one first candidate moment during the duration of the shooting operation, the first candidate moment corresponding to the minimum shake intensity.
[0051] In step S210, as shown in Figure 5, during the duration of the shooting operation, one or more first candidate moments are determined. The first candidate moment has the minimum jitter intensity, that is, the shooting device is most stable at the first candidate moment, and the image exposure data acquired by its image sensor at the first candidate moment has less noise and good imaging effect.
[0052] Step S220: Determine the first candidate moment as the start shooting moment.
[0053] In step S220, the first candidate time is determined as the start shooting time so that the shaking intensity corresponding to the start shooting time is minimized, thereby ensuring that when shooting is performed according to the start shooting time, the impact of the camera shake on the target image can be improved or eliminated.
[0054] It should be noted that when the duration of the shooting operation includes multiple first candidate moments, the first candidate moment that is closest to the start moment of the shooting operation, that is, the first candidate moment that best satisfies the user's shooting intention, can be determined as the start shooting moment.
[0055] In this embodiment, by determining at least one first candidate moment with the smallest jitter intensity within the duration of the shooting operation, and determining the first candidate moment as the start shooting moment, the start shooting moment is determined, so that the jitter intensity is minimized within the duration of the shooting operation at the start shooting moment. This improves the problems of insufficient image sharpness or ghosting, and enhances the image quality and user experience of the target image.
[0056] In other embodiments, as shown in Figure 6, determining the start time of shooting by the imaging device based on shake information includes the following steps:
[0057] Step S230: During the duration of the shooting operation, at least one second candidate moment is determined, and the shake intensity corresponding to the second candidate moment is less than the preset shake intensity.
[0058] In step S230, as shown in Figure 7, during the duration of the shooting operation, one or more second candidate moments are determined. The jitter intensity at each second candidate moment is less than a preset jitter intensity. The preset jitter intensity can be set according to the type of shooting device and the requirements for jitter control. When the jitter intensity is less than the preset jitter intensity, the jitter of the shooting device is unlikely to cause problems such as insufficient sharpness or image retention. The shooting device has a relatively stable state at the second candidate moment, and the image exposure data acquired by its image sensor at the second candidate moment has low noise and good imaging effect.
[0059] Step S240: Determine the second candidate moment as the start shooting moment.
[0060] In step S240, the second candidate time is determined as the start shooting time so that the shaking intensity corresponding to the start shooting time will not cause problems such as insufficient sharpness or ghosting, thereby ensuring that when shooting is performed according to the start shooting time, the impact of the shooting device shaking on the target image can be improved or eliminated.
[0061] It should be noted that when the duration of the shooting operation includes multiple second candidate moments, the second candidate moment that is closest to the start moment of the shooting operation, i.e. the second candidate moment that best satisfies the user's shooting intention, can be determined as the start shooting moment.
[0062] In this embodiment, by determining at least one second candidate moment with a shake intensity less than a preset shake intensity during the duration of the shooting operation, and determining the second candidate moment as the start shooting moment, the start shooting moment is determined. This ensures that the shake intensity during the duration of the shooting operation at the start shooting moment is insufficient to affect the shooting, thereby improving problems such as insufficient clarity or ghosting of the target image and enhancing the image quality and user experience of the target image.
[0063] In some embodiments, before determining the start time of shooting based on the shaking information, the control method further includes: obtaining the current exposure duration.
[0064] Before determining the start time of shooting based on camera shake information, the current exposure time of the camera can also be obtained. The current exposure time is the duration of the exposure data captured when the camera takes the picture of the target image. When the current exposure time is short, camera shake has a smaller impact on the sharpness of the target image and is less likely to cause ghosting or other problems. Conversely, when the current exposure time is long, camera shake has a larger impact on the sharpness of the target image and is more likely to cause ghosting or other problems. Therefore, the obtained current exposure time can also be used as a basis for determining the start time of shooting.
[0065] Based on camera shake information, the start time of the shooting device is determined, including: if the current exposure time is longer than the preset exposure time, then the start time of the shooting device is determined based on the camera shake information; or, if the current exposure time is less than or equal to the preset exposure time, then the start time of the shooting operation is determined as the start time of the shooting.
[0066] When determining the start time of shooting based on the shaking information, if the current exposure time is longer than the preset exposure time, it means that the current exposure time is longer and the shaking of the shooting device has a greater impact on the clarity of the target image and is prone to causing problems such as image retention. Therefore, the start time of shooting can be determined based on the shaking information through steps 210 and 220 or steps 230 and 240.
[0067] If the current exposure time is less than or equal to the preset exposure time, it means that the current exposure time is short. The shaking of the shooting device has little impact on the clarity of the target image and is less likely to cause problems such as ghosting. Even without considering the impact of shaking on shooting, it is difficult to have insufficient clarity or ghosting. Therefore, the start time of the shooting operation can be directly determined as the start shooting time so that the start shooting time is best suited to the user's shooting needs.
[0068] In this embodiment, by obtaining the current exposure time, the method for determining the start shooting time can be selected based on the relationship between the current exposure time and the preset exposure time. Thus, when the current exposure time is long, the start shooting time of the shooting device is determined based on the shaking information to improve problems such as insufficient image sharpness or ghosting. When the current exposure time is short, the start time of the shooting operation is determined as the start shooting time. This ensures that the start shooting time is most suitable for the user's shooting needs when problems such as insufficient sharpness or ghosting are unlikely to occur, thereby improving the user experience.
[0069] In some embodiments, the preset exposure duration is negatively correlated with the preset jitter intensity.
[0070] The preset exposure time, which is compared with the current exposure time, is negatively correlated with the preset shake intensity, which is used to determine the second candidate time. That is, the longer the preset exposure time, the lower the corresponding preset shake intensity. As a result, when the current exposure time is longer than the preset exposure time, and the start shooting time needs to be determined based on the preset shake intensity, the longer the current exposure time, the lower the shake intensity of the determined start shooting time.
[0071] For example, a preset exposure time of 10ms corresponds to a preset shake intensity of 2, and a preset exposure time of 20ms corresponds to a preset shake intensity of 1. If the preset exposure time is increased from 10ms to 20ms, the preset shake intensity can be reduced from 2 to 1, ensuring that there is a shake intensity of less than 1 at the start of shooting, thereby improving the effect of insufficient sharpness and image retention.
[0072] In this embodiment, by configuring the preset exposure time and the preset jitter intensity to be negatively correlated, a longer preset exposure time corresponds to a lower preset jitter intensity, thereby improving the effect of reducing insufficient sharpness and ghosting problems.
[0073] In some embodiments, the control method further includes: adjusting the current exposure duration in response to a user's exposure duration adjustment operation.
[0074] In order to achieve different shooting effects by controlling the exposure time, users can also perform exposure time adjustment operations on the shooting device. When the shooting device recognizes the exposure time adjustment operation, it can adjust the current exposure time to the target value required by the user.
[0075] User exposure time adjustment operations may include, for example, the user sliding the exposure time control wheel in the user interface, or the user inputting information into the exposure time input box in the user interface, or the user toggling the exposure time hardware settings of the shooting device.
[0076] In this embodiment, when the user's exposure time adjustment operation is detected, the current exposure time is adjusted, enabling the user to control the current exposure time. This allows the user to pursue different shooting effects by controlling the current exposure time, and the shooting device can adjust its strategy for determining the start shooting time based on the changing current exposure time, thus improving the user experience.
[0077] In some embodiments, capturing a target image based on the start shooting time includes: generating the target image based on image exposure data within the current exposure duration after the start shooting time.
[0078] When capturing a target image based on the start shooting time, the image exposure data continuously acquired and stored by the image sensor of the capturing device is selected. This selection of image exposure data is based on the start shooting time, and the data truncated length corresponds to the current exposure duration. The target image is then generated based on this selected portion of image exposure data, ensuring that the capture time for generating the target image (i.e., the target image) is the start shooting time when the shaking intensity is relatively low.
[0079] In this embodiment, a target image is generated based on the image exposure data within the current exposure time after the start of shooting. This achieves the generation of the target image and ensures that the shooting time for generating the target image is at the start of shooting when the shaking intensity is relatively low. Therefore, while ensuring that the start of shooting time is compatible with the shooting operation, it improves problems such as insufficient sharpness or ghosting in the target image, thereby enhancing the image quality and user experience.
[0080] In other embodiments, the shake information also includes shake intensity at different times during a first preset time period before the duration of the shooting operation and during a second preset time period after the duration of the shooting operation.
[0081] The shake information also includes the shake intensity at different times within a first preset time period before the start of the shooting operation, and the shake intensity at different times within a second preset time period after the start of the shooting operation. In other words, the shake information includes not only the shake intensity of the shooting device from the start to the end of the shooting operation, but also the shake intensity during the period before and after the shooting operation. The duration of the first and second preset times can be set according to the type of shooting device, exposure parameters, and user needs.
[0082] As shown in Figure 8, the process of capturing images based on the start time to obtain the target image includes the following steps:
[0083] Step S310: Determine at least one third candidate moment within the first preset time and the second preset time, where the jitter intensity is the minimum at the third candidate moment.
[0084] In step S310, as shown in Figure 9, one or more third candidate moments are determined within a first preset time and a second preset time before and after the duration of the shooting operation. The third candidate moments have the lowest jitter intensity within the first and second preset time periods. It is understood that because the third candidate moments are determined within the first and second preset time periods—that is, the time before or after the shooting operation—the shooting device is more stable than during the duration of the shooting operation, and the image sensor acquires image exposure data with less noise and better imaging results at the third candidate moments.
[0085] Step S320: Update the start shooting time to the third candidate time.
[0086] In step S320, the start shooting time determined during the duration of the shooting operation is updated to the third candidate time, so that the shaking intensity at the start shooting time is smaller, thereby ensuring that when shooting is performed according to the start shooting time, the impact of the camera shake on the target image can be improved or eliminated.
[0087] It should be noted that when the duration of the shooting operation includes multiple third candidate moments, if the third candidate moment is within the first preset time, the third candidate moment closest to the start moment of the shooting operation can be updated as the start shooting moment; if the third candidate moment is within the second preset time, the third candidate moment closest to the end moment of the shooting operation can be updated as the start shooting moment.
[0088] Step S330: Generate the target image based on the image exposure data within the current exposure duration after the updated start shooting time.
[0089] In step S330, the image exposure data within the current exposure duration after the updated start shooting time is selected, and the target image is generated based on the selected portion of the image exposure data, so that the shooting time of the target image is the start shooting time with less shaking intensity.
[0090] In this embodiment, at least one third candidate moment is determined within a first preset time period and a second preset time period, and the start shooting moment is updated to the third candidate moment. Then, based on the image exposure data within the current exposure duration after the updated start shooting moment, the target image is generated. This achieves the generation of the target image and ensures that the shooting timing of the target image is the updated start shooting moment with less shaking intensity. This further improves problems such as insufficient sharpness or ghosting in the target image, enhancing the image quality and user experience.
[0091] In some embodiments, the shake information is acquired through the inertial measurement unit of the shooting device, or through the accelerometer of the shooting device, or through both the inertial measurement unit and the accelerometer of the shooting device.
[0092] Shake information can be obtained through the inertial measurement unit (IMU) of the shooting device. The inertial measurement unit is a highly integrated sensor used to measure and report dynamic data of the device, which may include motion information of 6 or 9 degrees of freedom. The data obtained by the inertial measurement unit can be used as shake information to characterize the shake intensity of the shooting device through its motion state or trend.
[0093] Shake information can also be obtained through the accelerometer of the shooting device. The accelerometer measures and reports the acceleration of the device. When the device containing the accelerometer moves or changes direction, the displacement of the internal components of the accelerometer is converted into an electrical signal, thereby quantifying the acceleration. The data obtained by the accelerometer can be used as shake information to characterize the shake intensity of the shooting device by measuring the acceleration of the shooting device.
[0094] In this embodiment, the inertial measurement unit and accelerometer of the shooting device can acquire shake information and ensure that the shake information can accurately represent the shake intensity of the shooting device. The inertial measurement unit and accelerometer have the characteristics of real-time detection and reporting, accurate measurement results, and strong adaptability, which makes the shake information timely and accurate. This ensures that the start shooting time determined based on the shake information can improve the problem of insufficient target image sharpness or ghosting.
[0095] In some embodiments, the jitter information includes any one or any combination of velocity, acceleration, angular velocity, angular acceleration, and attitude offset along a plurality of preset axes of the shooting device.
[0096] The jitter information can be any one or any combination of velocity, acceleration, angular velocity, angular acceleration, and attitude offset along multiple preset axes of the shooting device. Velocity, acceleration, angular velocity, and angular acceleration can be acquired by the inertial measurement unit or accelerometer of the shooting device, and can characterize the motion state or trend of the shooting device in multiple directions. Attitude offset can be acquired by the inertial measurement unit of the shooting device, and can characterize the attitude change of the shooting device in multiple directions. For example, the multiple preset axes can be, for instance, three axes that simultaneously intersect within the shooting device and are mutually perpendicular to each other.
[0097] In this embodiment, any one or any combination of velocity, acceleration, angular velocity, angular acceleration, and attitude offset along multiple preset axes of the shooting device is used as jitter information. The data reflecting the motion state, trend, or attitude change of the shooting device, such as velocity, acceleration, angular velocity, angular acceleration, and attitude offset, can intuitively and accurately characterize the jitter intensity of the shooting device in multiple directions. This ensures the accuracy of the jitter information and guarantees that the start shooting time determined based on the jitter information can improve the sharpness of the target image or the problem of ghosting.
[0098] In some embodiments, the shooting operation includes a user pressing the shutter button of the shooting device, or a user clicking the shutter control in the user interface of the shooting device, or a shooting operation including both a user pressing the shutter button of the shooting device and a user clicking the shutter control in the user interface of the shooting device.
[0099] The shooting operation can be the user pressing the shutter button on the shooting device. Since pressing the shutter button causes the device to shake, when the shooting device detects this action, it acquires the shake information and determines the start time to capture the target image. In this case, the duration of the shooting operation is from the moment the user presses the shutter button until the shutter button returns to its initial position after the user releases their finger.
[0100] The shooting operation can also be a user's click on the shutter control in the shooting device's user interface. Since this click causes the shooting device to shake, when the user's click is detected, the shake information is acquired and the start time for shooting is determined to capture the target image. In this case, the duration of the shooting operation is from the moment the user starts clicking the shutter control to the moment the user lifts their finger off the shutter control.
[0101] In this embodiment, the user's pressing of the shutter button on the shooting device and the user's clicking of the shutter control in the user interface of the shooting device are considered as the user's shooting operations, realizing the user's control over the shooting function of the shooting device. Both shooting operations can cause the shooting device to shake. By acquiring the shaking information and determining the start time of shooting, problems such as insufficient image sharpness or ghosting caused by shooting device shaking can be improved, thereby improving the image quality and user experience.
[0102] Understandably, the above-mentioned shooting control method can achieve the acquisition of target images and is suitable for shooting images. However, for shooting video, the user needs to perform two shooting operations to correspond to the recording time and the end time of the video, and the start and end times of video recording need to be determined separately.
[0103] Therefore, in some embodiments, when shooting video, the shooting operation includes a recording start operation and a recording end operation. The recording start operation is used to control the shooting device to start performing video recording, and the recording end operation is used to control the shooting device to end video recording. Both the recording start operation and the recording end operation can include any one or a combination of the user pressing the shutter button on the shooting device and the user clicking the shutter control in the user interface of the shooting device.
[0104] As shown in Figure 10, the control method for the shooting device also includes the following steps:
[0105] Step S410: Determine the start time of recording by the shooting device based on the shake information corresponding to the start of recording operation.
[0106] In step S410, as shown in FIG11, the jitter information corresponding to the recording start operation can characterize the jitter intensity of the shooting device at different times during the duration of the recording start operation. Based on the jitter information corresponding to the recording start operation, the start recording time of the shooting device can be determined as the timing for controlling the shooting device to start recording video. For example, the start recording time of the shooting device can be determined based on the jitter information corresponding to the recording start operation in the same way as determining the start recording time based on the jitter information, so that the shooting device has a smaller jitter intensity at the start recording time.
[0107] Step S420: Determine the end recording time of the shooting device based on the shake information corresponding to the recording end operation.
[0108] In step S420, as shown in Figure 11, the jitter information corresponding to the recording end operation can characterize the jitter intensity of the shooting device at different times during the duration of the recording end operation. Based on the jitter information corresponding to the recording end time, the recording end time of the shooting device can be determined as the timing for controlling the shooting device to stop recording video.
[0109] Step S430: Record video according to the start and end times to obtain the target video.
[0110] In step S430, the shooting device records video according to the start and end times of recording to obtain the target video corresponding to this video shooting task. For example, the shooting device continuously acquires video data through an image sensor and uses the start and end times of recording as the start and end times for capturing video data, respectively, to output the captured video data as the target video.
[0111] In this embodiment, the start and end times of recording are determined based on the jitter information corresponding to the start and end operations, respectively. This allows for recording based on these start and end times, thus determining the start and end times of recording and acquiring the target video. Using the jitter information corresponding to the start and end operations as the basis for determining the start and end times ensures that these times are compatible with the start and end operations. By fully considering the impact of camera jitter on the start and end times of video recording, this approach improves issues such as insufficient clarity or shaky footage in the target video, enhancing its stability and user experience.
[0112] In some embodiments, as shown in FIG12, determining the end recording time of the shooting device based on the shake information corresponding to the recording end operation includes the following steps:
[0113] Step S421: Determine at least one fourth candidate moment within the duration of the recording end operation, where the jitter intensity corresponding to the fourth candidate moment is the minimum.
[0114] In step S421, as shown in Figure 13, during the duration of the recording end operation, one or more fourth candidate moments are determined. The fourth candidate moment has the minimum jitter intensity, that is, the shooting device is most stable at the fourth candidate moment, and the video data acquired by its image sensor at the fourth candidate moment has less noise and good imaging effect.
[0115] Step S422: Determine the fourth candidate moment as the end of recording.
[0116] In step S422, the fourth candidate time is determined as the end recording time so that the jitter intensity corresponding to the end recording time is minimized, thereby ensuring that when video is recorded according to the end recording time, the impact of the shooting device jitter on the target video can be improved or eliminated.
[0117] It should be noted that when the duration of the recording end operation includes multiple fourth candidate moments, the fourth candidate moment that is closest to the start moment of the recording end operation, i.e. the fourth candidate moment that best satisfies the user's intention to end the recording, can be determined as the recording end moment.
[0118] In this embodiment, by determining at least one fourth candidate moment with the smallest jitter intensity within the duration of the recording end operation, and determining the fourth candidate moment as the recording end moment, the recording end moment is determined, so that the jitter intensity is minimized within the duration of the recording end operation at the recording end moment. This improves the problems of insufficient clarity or image jitter in the target video, and enhances the stability of the target video and the user experience.
[0119] In other embodiments, as shown in Figure 14, determining the end recording time of the shooting device based on the shake information corresponding to the recording end operation includes the following steps:
[0120] Step S423: During the duration of the recording end operation, determine at least one fifth candidate moment, where the jitter intensity corresponding to the fifth candidate moment is less than the preset jitter intensity.
[0121] In step S423, as shown in Figure 15, during the duration of the recording end operation, one or more fifth candidate moments are determined. The jitter intensity of each fifth candidate moment is less than a preset jitter intensity. The preset jitter intensity can be set according to the type of shooting device and the requirements of jitter control. When the jitter intensity is less than the preset jitter intensity, the jitter of the shooting device is unlikely to cause problems such as insufficient clarity or image shakiness. The shooting device has a relatively stable state at the fifth candidate moment, and the video data acquired by its image sensor at the fifth candidate moment has low noise and good imaging effect.
[0122] Step S424: Determine the fifth candidate moment as the end of recording.
[0123] In step S424, the fifth candidate moment is determined as the end recording moment so that the shaking intensity corresponding to the end recording moment will not cause problems such as insufficient clarity or image shaking. This ensures that when recording video based on the end recording moment, the impact of the camera shake on the target video can be improved or eliminated.
[0124] It should be noted that when the duration of the recording end operation includes multiple fifth candidate moments, the fifth candidate moment that is closest to the start moment of the recording end operation, i.e. the fifth candidate moment that best satisfies the user's intention to end the recording, can be determined as the recording end moment.
[0125] In this embodiment, by determining at least one fifth candidate moment with a jitter intensity less than a preset jitter intensity within the duration of the recording end operation, and determining the fifth candidate moment as the recording end moment, the recording end moment is determined. This ensures that the jitter intensity at the recording end moment is insufficient to affect the video recording during the duration of the recording end operation, thereby improving problems such as insufficient clarity or image jitter in the target video and enhancing the stability of the target video and user experience.
[0126] In some embodiments, determining the end recording time of the shooting device based on the jitter information corresponding to the end recording operation includes: if the jitter intensity corresponding to each moment within the duration of the end recording operation is equal to or greater than a preset jitter intensity, then the start time of the end recording operation is determined as the end recording time; or, the sixth candidate moment before the start time of the end recording operation is determined as the end recording time, wherein there is a third preset time interval between the sixth candidate moment and the start time of the end recording operation.
[0127] If the jitter intensity at each moment during the recording end operation is equal to or greater than the preset jitter intensity, it means that the entire execution process of the recording end operation caused significant jitter in the shooting device. If a recording end moment is determined within the recording end operation duration, it will not be able to effectively improve the problems of insufficient target video clarity or image shakiness caused by the jitter in the shooting device.
[0128] In this case, the start time of the recording end operation can be determined as the end time of recording. That is, while satisfying the user's intention to end recording, the moment when the recording end operation has not yet caused the shooting device to shake can be selected as the end time of recording. This achieves the effect of editing out the video segment corresponding to the recording end operation, thereby improving the problems of insufficient clarity of the target video or image shaking caused by the shaking of the shooting device.
[0129] As shown in Figure 16, the sixth candidate time before the start time of the recording end operation can also be determined as the recording end time. This ensures that the recording end time is earlier than the start time of the recording end operation, achieving the same effect of editing out the video segment corresponding to the recording end operation. This improves issues such as insufficient clarity or image shakiness in the target video caused by camera shake. There is a third preset time interval between the sixth candidate time and the start time of the recording end operation. This third preset time can be set according to shake control requirements or video segment editing length standards, serving as the advance of the recording end time relative to the start time of the recording end operation.
[0130] In this embodiment, when the jitter intensity at each moment during the recording end operation is equal to or greater than the preset jitter intensity, by determining the start time of the recording end operation as the end recording time, or by determining the sixth candidate moment before the start time of the recording end operation as the end recording time, the video segment corresponding to the recording end operation can be edited out. This improves the problem of insufficient clarity or image shaking in the target video caused by the shaking of the shooting device due to the recording end operation, thereby enhancing the stability of the target video and the user experience.
[0131] In one exemplary embodiment, a shooting device is provided. The shooting device may be a computer device such as a mobile phone or a camera. The shooting device includes a processor and a memory. The memory stores a computer program. When the processor executes the computer program, it implements the steps of any of the above-described shooting device control methods.
[0132] As shown in Figure 17, a structural block diagram of a computer device 100, which can serve as the imaging apparatus of this disclosure, will now be described. The computer device 100 includes a computing unit 101, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 102 or a computer program loaded from a storage unit 108 into a random access memory (RAM) 103. The RAM 103 may also store various programs and data required for the operation of the computer device 100. The computing unit 101, ROM 102, and RAM 103 are interconnected via a bus 104. An input / output (I / O) interface 105 is also connected to the bus 104.
[0133] Multiple components in computer device 100 are connected to I / O interface 105, including: input unit 106, output unit 107, storage unit 108, and communication unit 109. Input unit 106 can be any type of device capable of inputting information into computer device 100. Input unit 106 can receive input numerical or character information and generate key signal inputs related to user settings and / or function control of computer device 100, and may include, but is not limited to, a mouse, keyboard, touchscreen, trackpad, trackball, joystick, microphone, and / or remote control. Output unit 107 can be any type of device capable of presenting information, and may include, but is not limited to, a monitor, speaker, video / audio output terminal, vibrator, and / or printer. Storage unit 108 may include, but is not limited to, a hard disk and an optical disk. Communication unit 109 allows computer device 100 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication transceivers, and / or chipsets, such as Bluetooth™ devices, WiFi devices, WiMax devices, cellular communication devices, and / or the like.
[0134] The computing unit 101 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 101 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 101 performs the various methods and processes described above, such as the control method of the shooting device. For example, in some embodiments, the control method of the shooting device may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 108. In some embodiments, part or all of the computer program may be loaded and / or installed on the computer device 100 via ROM 102 and / or communication unit 109. When the computer program is loaded into RAM 103 and executed by the computing unit 101, one or more steps of the control method of the shooting device described above may be performed. Alternatively, in other embodiments, the computing unit 101 may be configured to perform the control method of the shooting device by any other suitable means (e.g., by means of firmware).
[0135] The computer device 100 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the control method of the above-described imaging device.
[0136] The various embodiments or implementation methods described in this specification are presented in a progressive manner. Each embodiment focuses on the differences from other embodiments, and the same or similar parts between the embodiments can be referred to each other.
[0137] In the description of this specification, references to the terms "embodiment," "exemplary embodiment," etc., refer to specific features, structures, materials, or characteristics described in connection with implementation methods or examples that are included in at least one implementation method or example of this disclosure.
[0138] In this specification, the illustrative expressions of the terms used do not necessarily refer to the same implementation or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more implementations or examples.
[0139] It is understood that the terms "first," "second," etc., as used in this disclosure may be used to describe various structures, but these structures are not limited by these terms. These terms are only used to distinguish one structure from another.
[0140] In one or more accompanying drawings, the same elements are represented by similar reference numerals. For clarity, many parts in the drawings are not drawn to scale. Furthermore, certain well-known parts may not be shown. For simplicity, a structure obtained after several steps may be depicted in a single drawing. Many specific details of this disclosure, such as the structure, materials, dimensions, processing methods, and techniques of the devices, are described below to provide a clearer understanding of the disclosure. However, as those skilled in the art will understand, this disclosure may be implemented without adhering to these specific details.
[0141] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this disclosure, and are not intended to limit them. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this disclosure. Industrial applicability
[0142] The shooting device and control method provided in this disclosure, when a user's shooting operation is detected, acquires shake information and determines the start shooting time based on the shake information, enabling shooting based on the start shooting time, thus achieving automatic determination of the shooting timing and acquisition of the target image. By using the shake intensity corresponding to different moments within the duration of the shooting operation as the basis for determining the start shooting time, and ensuring that the start shooting time matches the shooting operation, the impact of the shooting device's shake on the shooting timing is fully considered. This can improve problems such as insufficient target image clarity or ghosting, enhancing the image quality and user experience.
Claims
1. A control method for a shooting device, characterized in that, The control method includes: In response to the user's shooting operation on the shooting device, shake information is acquired, and the shake information is used to characterize the shake intensity of the shooting device at different times during the duration of the shooting operation; Based on the shaking information, the start time of the shooting device is determined; The target image is obtained by taking a picture at the stated start time.
2. The control method according to claim 1, characterized in that, Determining the start time of the shooting device based on the jitter information includes: During the duration of the shooting operation, at least one first candidate moment is determined, and the shake intensity corresponding to the first candidate moment is the minimum. The first candidate time is determined as the start shooting time.
3. The control method according to claim 1, characterized in that, Determining the start time of the shooting device based on the jitter information includes: During the duration of the shooting operation, at least one second candidate moment is determined, wherein the shake intensity corresponding to the second candidate moment is less than a preset shake intensity; The second candidate time is determined as the start shooting time.
4. The control method according to any one of claims 1 to 3, characterized in that, Before determining the start time of shooting by the shooting device based on the jitter information, the control method further includes: Get the current exposure duration; Determining the start time of the shooting device based on the jitter information includes: If the current exposure time is longer than the preset exposure time, then the start time of the shooting device is determined based on the shake information; or, If the current exposure duration is less than or equal to the preset exposure duration, then the start time of the shooting operation is determined as the start shooting time.
5. The control method according to claim 4, characterized in that, The preset exposure time is negatively correlated with the preset jitter intensity.
6. The control method according to claim 4 or 5, characterized in that, The control method further includes: In response to the user's exposure duration adjustment operation, the current exposure duration is adjusted.
7. The control method according to any one of claims 4 to 6, characterized in that, The step of capturing images according to the start time to obtain the target image includes: The target image is generated based on the image exposure data within the current exposure duration after the start of shooting; or, The shake information also includes shake intensity at different times within a first preset time period before the duration of the shooting operation and within a second preset time period after the duration of the shooting operation. The step of capturing the target image based on the start shooting time includes: At least one third candidate moment is determined within the first preset time period and the second preset time period, and the jitter intensity is minimized at the third candidate moment. Update the start shooting time to the third candidate time; The target image is generated based on the image exposure data within the current exposure duration after the updated start shooting time.
8. The control method according to any one of claims 1 to 7, characterized in that, The shaking information is obtained through the inertial measurement unit and / or accelerometer of the shooting device.
9. The control method according to any one of claims 1 to 8, characterized in that, The shaking information includes any one or any combination of velocity, acceleration, angular velocity, angular acceleration, and attitude offset along multiple preset axes of the shooting device.
10. The control method according to any one of claims 1 to 9, characterized in that, The shooting operation includes: The user presses the shutter button of the shooting device; and / or, The user clicks on the shutter control in the user interface of the shooting device.
11. The control method according to any one of claims 1 to 10, characterized in that, In the case of recording video, the recording operation includes a recording start operation and a recording end operation; The control method further includes: Based on the jitter information corresponding to the recording start operation, the start recording time of the shooting device is determined; Based on the jitter information corresponding to the recording end operation, the recording end time of the shooting device is determined; Video recording is performed based on the start and end times to obtain the target video.
12. The control method according to claim 11, characterized in that, Determining the end recording time of the shooting device based on the jitter information corresponding to the recording end operation includes: During the duration of the recording end operation, at least one fourth candidate moment is determined, and the jitter intensity corresponding to the fourth candidate moment is the minimum. The fourth candidate time is determined as the end recording time.
13. The control method according to claim 11, characterized in that, Determining the end recording time of the shooting device based on the jitter information corresponding to the recording end operation includes: During the duration of the recording end operation, at least one fifth candidate moment is determined, and the jitter intensity corresponding to the fifth candidate moment is less than a preset jitter intensity; The fifth candidate moment is determined as the end recording moment.
14. The control method according to claim 11, characterized in that, Determining the end recording time of the shooting device based on the jitter information corresponding to the recording end operation includes: If the jitter intensity at each moment during the duration of the recording end operation is equal to or greater than the preset jitter intensity, then the start time of the recording end operation is determined as the recording end time; or, the sixth candidate moment before the start time of the recording end operation is determined as the recording end time, wherein the sixth candidate moment and the start time of the recording end operation have a time interval of a third preset time.
15. A shooting device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the computer program is executed by the processor, the processor is configured to acquire shake information in response to a user's shooting operation on the shooting device, the shake information being used to characterize the shake intensity of the shooting device at different times during the duration of the shooting operation; Based on the shaking information, the start time of the shooting device is determined; The target image is obtained by taking a picture at the stated start time.
16. The shooting device according to claim 15, characterized in that, The processor is configured to determine at least one first candidate moment during the duration of the shooting operation, the first candidate moment corresponding to the minimum shake intensity; The first candidate time is determined as the start shooting time.
17. The shooting device according to claim 15, characterized in that, The processor is configured to determine at least one second candidate moment during the duration of the shooting operation, wherein the shake intensity corresponding to the second candidate moment is less than a preset shake intensity; The second candidate time is determined as the start shooting time.
18. The shooting device according to any one of claims 15 to 17, characterized in that, The processor is configured to acquire the current exposure duration; Determining the start time of the shooting device based on the jitter information includes: If the current exposure time is longer than the preset exposure time, then the start time of the shooting device is determined based on the shake information; or, If the current exposure duration is less than or equal to the preset exposure duration, then the start time of the shooting operation is determined as the start shooting time.
19. The shooting device according to claim 18, characterized in that, The preset exposure time is negatively correlated with the preset jitter intensity.
20. The shooting device according to claim 18 or 19, characterized in that, The processor is configured to adjust the current exposure duration in response to a user's exposure duration adjustment operation.
21. The shooting device according to any one of claims 18 to 20, characterized in that, The processor is configured to generate the target image based on image exposure data within the current exposure duration after the start of shooting; or, The shake information also includes the shake intensity at different times within a first preset time period before the duration of the shooting operation and within a second preset time period after the duration of the shooting operation. At least one third candidate moment is determined within the first preset time period and the second preset time period, and the jitter intensity is minimized at the third candidate moment. Update the start shooting time to the third candidate time; The target image is generated based on the image exposure data within the current exposure duration after the updated start shooting time.
22. The shooting device according to any one of claims 15 to 21, characterized in that, The shaking information is obtained through the inertial measurement unit and / or accelerometer of the shooting device.
23. The shooting device according to any one of claims 15 to 22, characterized in that, The shaking information includes any one or any combination of velocity, acceleration, angular velocity, angular acceleration, and attitude offset along multiple preset axes of the shooting device.
24. The shooting device according to any one of claims 15 to 23, characterized in that, The shooting operation includes: The user presses the shutter button of the shooting device; and / or, The user clicks on the shutter control in the user interface of the shooting device.
25. The shooting device according to any one of claims 15 to 23, characterized in that, In the case of shooting video, the shooting operation includes a recording start operation and a recording end operation; the processor is configured to determine the start recording time of the shooting device based on the jitter information corresponding to the recording start operation; Based on the jitter information corresponding to the recording end operation, the recording end time of the shooting device is determined; Video recording is performed based on the start and end times to obtain the target video.
26. The shooting device according to claim 25, characterized in that, The processor is configured to determine at least one fourth candidate moment during the duration of the recording end operation, the fourth candidate moment corresponding to the minimum jitter intensity; The fourth candidate time is determined as the end recording time.
27. The shooting device according to claim 25, characterized in that, The processor is configured to determine at least one fifth candidate moment during the duration of the recording end operation, wherein the jitter intensity corresponding to the fifth candidate moment is less than a preset jitter intensity; The fifth candidate moment is determined as the end recording moment.
28. The shooting device according to claim 25, characterized in that, The processor is configured to determine the start time of the recording end operation as the recording end time if the jitter intensity corresponding to each moment within the duration of the recording end operation is equal to or greater than a preset jitter intensity, or to determine the sixth candidate moment before the start time of the recording end operation as the recording end time, wherein the sixth candidate moment and the start time of the recording end operation have a time interval of a third preset time.
Citation Information
Patent Citations
Method and apparatus for compensating hand-trembling of camera
CN101345824A
Picture shooting method and device
CN106210496A
Shooting parameter adjustment method and device, electronic equipment and computer storage medium
CN113347352A
Shooting method and electronic equipment
CN116709043A
Imaging device and imaging method thereof
TW200947107A