Intelligent dynamic anti-shake camera method and system

Abstract

The present application provides a method for implementing dynamic anti-shake. It includes obtaining a first acceleration of a shooting device, a second acceleration of a vehicle, and a third acceleration of a target object, calculating an absolute jitter parameter value based on the first acceleration, the second acceleration, and the third acceleration, and then determining whether compensation is required based on the absolute jitter parameter value. If compensation is required, the image is jitter-compensated using the absolute jitter parameter value. In addition, the present application also provides an intelligent dynamic anti-shake system, including a sensor, a calculation unit, a determination unit, and an image compensation unit. The technical solution of the present application effectively solves the jitter problem of shooting in a vehicle-mounted scene, ensuring high quality of images and videos.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a method and system for implementing intelligent dynamic anti-shake. Background Art

[0002] With the development of camera technology, various sensors, and algorithm technology, cameras are widely used in various industries. At the same time, people's requirements for image quality are increasing. In order to adapt to shooting in various scenes, a series of problems, especially anti-shake, need to be solved.

[0003] Existing solutions for image stabilization utilize either digital or physical techniques. Digital stabilization has the disadvantage of being extremely ineffective when the camera shakes significantly. Physical stabilization cannot compensate for camera motion when the subject is in motion, and can lead to inaccurate compensation if the subject is moving in the opposite direction of the camera's shake. Even combining digital and physical techniques fails to account for in-vehicle filming scenarios, where vehicle shake is inevitable. Summary of the Invention

[0004] The present application provides a method and system for implementing intelligent dynamic anti-shake, which can effectively solve the shaking problem of shooting in vehicle scenes and ensure the high quality of images and videos.

[0005] In a first aspect, an embodiment of the present application provides a method for implementing intelligent dynamic anti-shake, including: obtaining a first acceleration of a shooting device, the first acceleration being obtained from a first acceleration sensor configured on the shooting device; obtaining a second acceleration of a vehicle, the vehicle being equipped with the shooting device, the second acceleration being obtained by a second acceleration sensor configured on the vehicle; obtaining a third acceleration of a target object, the target object being riding in the vehicle; calculating an absolute jitter parameter value based on the first acceleration, the second acceleration, and the third acceleration; determining whether jitter compensation is required based on the absolute jitter parameter value; and when jitter compensation is required, using the absolute jitter parameter value to perform jitter compensation on the image.

[0006] In a second aspect, an embodiment of the present application provides an intelligent dynamic anti-shake system, comprising: an acquisition unit, configured to acquire a first acceleration of a shooting device, the first acceleration being obtained from a first acceleration sensor configured on the shooting device; acquiring a second acceleration of a vehicle, the vehicle being equipped with the shooting device, the second acceleration being obtained from a second acceleration sensor configured on the vehicle; acquiring a third acceleration of a target object, the target object being riding on the vehicle; a calculation unit, configured to calculate an absolute jitter parameter value based on the first acceleration, the second acceleration, and the third acceleration; a determination unit, configured to determine whether jitter compensation is required based on the absolute jitter parameter value; and an image compensation unit, configured to perform jitter compensation on an image based on the absolute jitter parameter value.

[0007] As described above, based on the special motion scenarios of vehicles and the relative motion states of different objects in the vehicle, the absolute jitter parameter value is calculated by obtaining the camera acceleration, vehicle acceleration, and target object acceleration. The absolute jitter parameter value is used to compensate for image jitter, effectively solving the problem of not being able to obtain high-quality images due to shooting jitter in vehicle-mounted scenarios. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0009] Figure 1 A flowchart of a method for implementing intelligent dynamic anti-shake provided in an embodiment of the present application.

[0010] Figure 2 A schematic diagram of a scenario for implementing an intelligent dynamic anti-shake method is provided for an embodiment of the present application.

[0011] Figure 3 This is a functional module block diagram of the intelligent dynamic anti-shake system provided in an embodiment of the present application.

[0012] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0013] In order to make the purpose, technical solutions and advantages of this application more clear, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0014] The terms "first," "second," "third," "fourth," and the like (if any) in the specification and claims of this application and in the accompanying drawings are used to distinguish similar program objects and are not necessarily used to describe a particular order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate. In other words, the described embodiments are implemented according to an order other than that illustrated or described herein. In addition, the terms "including" and "having," and any variations thereof, may also encompass other content. For example, a process, method, system, product, or apparatus comprising a series of steps or units need not be limited to only those steps or units explicitly listed, but may include other steps or units that are not explicitly listed or that are inherent to these processes, methods, products, or apparatus.

[0015] It should be noted that the descriptions of "first", "second", etc. in this application are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include one or more of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that ordinary technicians in this field can implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0016] Please see Figure 1 and Figure 2 , which is a flowchart of a method for implementing intelligent dynamic anti-shake provided in an embodiment of the present application. Figure 2 A schematic diagram of an intelligent dynamic stabilization system for implementing the intelligent dynamic stabilization method. The intelligent dynamic stabilization system scenario includes a camera 10, a vehicle 20, and a target subject 30 riding in vehicle 20. Both the camera 10 and the vehicle 20 are equipped with acceleration sensors. Furthermore, in this embodiment, in some feasible embodiments, the target subject may also wear an acceleration sensor. The camera 10 is a camera. The acceleration sensor may be a gyroscope or a gravity acceleration sensor, for example.

[0017] The embodiment of the present application can realize dynamic compensation of the image captured by the shooting device 10 through the intelligent dynamic anti-shake method, which can effectively solve the shaking problem of shooting in a vehicle scene and ensure the high quality of images and videos. Specifically, the intelligent dynamic anti-shake method of this example includes the following steps.

[0018] Step S100: Acquire a first acceleration of the camera device. The first acceleration is obtained from a first acceleration sensor configured in the camera device. In this embodiment, the first acceleration is g1. The first acceleration sensor is mounted in the camera device to acquire the acceleration of the camera device.

[0019] In step S200, a sensor acquires a second acceleration of the vehicle, the vehicle being equipped with the camera. The second acceleration is obtained from a second acceleration sensor mounted on the vehicle. In this embodiment, the second acceleration is g2. The second acceleration sensor is mounted on a device relatively stationary relative to the vehicle, such as an onboard computer, and is used to acquire the vehicle's acceleration.

[0020] Step S300: Obtain a third acceleration of a target object, the target object being a passenger in the vehicle. In this embodiment, the third acceleration is g3, which can be calculated based on the second acceleration g2 and the classification of the target object. The target objects are classified according to their relative motion states while the vehicle is in motion, and then calculated based on the second acceleration g2 to obtain the third acceleration g3. In another embodiment, when the motion or vibration of the target within the vehicle relative to the vehicle is relatively small, the vehicle's acceleration is considered to be consistent with the target object's acceleration, and the target object's acceleration is determined by the second acceleration. Alternatively, the target object is equipped with an acceleration sensor and a gyroscope to obtain the third acceleration. The third acceleration is obtained by the target object's acceleration sensor or determined from the second acceleration. Since the target object's acceleration is consistent with the vehicle's acceleration, the third acceleration is the same as the second acceleration, i.e., g2 = g3.

[0021] The example of this application is that the camera captures images in a vehicle environment. During the vehicle's driving process, the shooting device, the vehicle and the shooting target are all in motion (such as Figure 2As shown), the shooting device and the target object will produce motion or shaking in different directions due to reasons such as bumps. It is understandable that the shooting device, the vehicle, and the target object have a velocity v1 in the same direction, and the shooting device, the vehicle, and the target object have relatively independent accelerations. It is understandable that since the vehicle and the target object can be regarded as being basically relatively stationary during the driving process of the vehicle. That is, the acceleration of the vehicle and the target object are basically the same, therefore, in this embodiment, it is only necessary to obtain the acceleration of the vehicle to obtain the acceleration of the target object. That is, the first acceleration g1 and the second acceleration g2 are independent of each other, because the third acceleration is very small compared to the second acceleration, and for the convenience of calculation, the third acceleration g3 is regarded as equal to the second acceleration g2. In this embodiment, the first acceleration and the second acceleration obtained by the first sensor and the second sensor can be sent wirelessly to a computing unit disposed in the vehicle for processing. In some feasible embodiments, the first acceleration and the second acceleration obtained by the first sensor and the second sensor can also be sent wirelessly to a computing unit disposed outside the vehicle for calculation.

[0022] For step S400, an absolute jitter parameter value is calculated based on the first acceleration, the second acceleration, and the third acceleration. In this embodiment, the absolute jitter parameter value is g. In this embodiment, only the absolute jitter parameter value is calculated by a calculation unit provided in the vehicle. The value of g can be positive or negative, and the positive and negative represent the direction. Specifically, the first acceleration, the second acceleration, and the third acceleration are transformed into the same coordinate system to obtain the first transformed acceleration, the second transformed acceleration, and the third transformed acceleration; then, the difference between the first transformed acceleration and the second transformed acceleration is subtracted from the difference between the third transformed acceleration and the second transformed acceleration to obtain the absolute jitter parameter value. In this embodiment, the absolute jitter parameter value is g, and the absolute jitter parameter value is expressed as: g = (g1-g2)-(g3-g2).

[0023] Step S500 determines whether jitter compensation is required based on the absolute jitter parameter value. Specifically, the absolute jitter parameter value is compared with a preset jitter threshold. Only the numerical value needs to be compared; the sign represents only the direction. When the absolute jitter parameter value is less than or equal to the preset jitter threshold, compensation is determined not to be required; when the absolute jitter parameter value is greater than the preset jitter threshold, compensation is determined to be required. In this embodiment, the determination of whether compensation is required is made by a confirmation unit located in vehicle 20.

[0024] Step S600: When shake compensation is required, the image captured by the camera is compensated using the absolute shake parameter value. The compensation method is to use a value opposite to the absolute shake parameter value, i.e., a compensation value of -g. The shake algorithm may be a Floyd-Steinberg shake algorithm, a DITHER shake algorithm, or the like. In this embodiment, when shake compensation is required, the calculation unit sends the absolute shake parameter value to the camera to compensate the image captured by the camera.

[0025] In the above embodiment, by obtaining the acceleration of the shooting device, the vehicle acceleration, and the target object acceleration, the absolute jitter parameter value is calculated, and the absolute jitter parameter value is used to compensate for the image jitter, which effectively solves the problem of not being able to obtain high-quality images due to shooting jitter in vehicle scenarios.

[0026] Please see Figure 3 , which is a schematic diagram of the functional modules of the intelligent dynamic anti-shake system provided in an embodiment of the present application.

[0027] The intelligent dynamic anti-shake system 1 includes an acquisition unit 100 , a calculation unit 200 , a determination unit 300 , and an image compensation unit 400 .

[0028] The acquisition unit 100 is configured to acquire a first acceleration of a camera, a second acceleration of a vehicle, and a third acceleration of a target object. The first acceleration is obtained from a first acceleration sensor configured on the camera; the second acceleration is obtained from a vehicle equipped with the camera, and the second acceleration is obtained from a second acceleration sensor configured on the vehicle; the target object is riding in the vehicle.

[0029] The calculation unit 200 is configured to calculate an absolute jitter parameter value based on the first, second, and third accelerations. The calculation unit 200 includes a coordinate transformation unit 201 and an operation unit 202. The coordinate transformation unit 201 is configured to transform the first, second, and third accelerations into the same coordinate system to obtain first, second, and third transformed accelerations. The operation unit 202 is configured to subtract the difference between the third and second transformed accelerations from the difference between the first and second transformed accelerations to obtain the absolute jitter parameter value.

[0030] The determining unit 300 is configured to determine whether jitter compensation is required based on the absolute jitter parameter value. The determining unit is configured to determine that compensation is not required when the absolute jitter parameter value is less than or equal to a preset jitter threshold, and to determine that compensation is required when the absolute jitter parameter value is greater than the preset jitter threshold.

[0031] The image compensation unit 400 is configured to compensate the image captured by the camera using a value opposite to the absolute jitter parameter value. The jitter algorithm may be a Floyd-Steinberg jitter algorithm, a DITHER jitter algorithm, or the like. When jitter compensation is required, the image captured by the camera is compensated using the absolute jitter parameter value. The compensation method is to use a value opposite to the absolute jitter parameter value, i.e., a compensation value of -g.

[0032] In the above embodiment, an intelligent dynamic stabilization method and system are provided. The method and system include obtaining a first acceleration of a shooting device, a second acceleration of a vehicle, and a third acceleration of a target object, calculating an absolute jitter parameter value based on the first, second, and third accelerations, and then determining whether compensation is required based on the absolute jitter parameter value. If compensation is required, the absolute jitter parameter value is used to compensate for image jitter, thereby effectively solving the jitter problem in vehicle-mounted shooting scenarios and ensuring high image and video quality.

[0033] Obviously, those skilled in the art may make various modifications and variations to this application without departing from the spirit and scope of this application. Thus, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application is intended to include such modifications and variations.

[0034] The above examples are merely preferred embodiments of the present application and are not intended to limit the scope of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope of the present application.

Claims

1. A method for realizing intelligent dynamic anti-shake, characterized in that: include: Acquire a first acceleration of a photographing device, where the first acceleration is obtained from a first acceleration sensor configured in the photographing device; acquiring a second acceleration of a vehicle, the vehicle being equipped with the photographing device, the second acceleration being obtained from a second acceleration sensor configured on the vehicle; acquiring a third acceleration of a target object, the target object being riding in the vehicle; Calculating an absolute jitter parameter value based on the first acceleration, the second acceleration, and the third acceleration, wherein calculating the absolute jitter parameter value specifically includes transforming the first acceleration, the second acceleration, and the third acceleration into the same coordinate system to obtain a first transformed acceleration, a second transformed acceleration, and a third transformed acceleration; and subtracting a difference between the third transformed acceleration and the second transformed acceleration from a difference between the first transformed acceleration and the second transformed acceleration; Determining whether jitter compensation is required based on the absolute jitter parameter value, wherein determining whether jitter compensation is required based on the absolute jitter parameter value specifically includes: comparing the absolute jitter parameter value with a preset jitter threshold; when the absolute jitter parameter value is less than or equal to the preset jitter threshold, determining that compensation is not required; when the absolute jitter parameter value is greater than the preset jitter threshold, determining that compensation is required; wherein only corresponding values ​​are compared between the absolute jitter parameter value and the preset jitter threshold; When jitter compensation is required, the absolute jitter parameter value is used to perform jitter compensation on the image captured by the shooting device.

2. The method for realizing intelligent dynamic anti-shake according to claim 1, wherein: Acquiring the third acceleration of the target object specifically includes: determining the second acceleration as the third acceleration, or obtaining the third acceleration from an acceleration sensor configured on the target object.

3. The method for realizing intelligent dynamic anti-shake according to claim 1, wherein: The image captured by the capturing device is compensated by using a value opposite to the absolute jitter parameter value.

4. An intelligent dynamic anti-shake system, characterized in that: include: an acquisition unit, configured to acquire a first acceleration of the camera device, a second acceleration of the vehicle, and a third acceleration of the target object, wherein the first acceleration is obtained from a first acceleration sensor configured on the camera device; acquire a second acceleration of the vehicle, wherein the camera device is installed on the vehicle, and the second acceleration is obtained from a second acceleration sensor configured on the vehicle; and acquire a third acceleration of the target object, wherein the target object is riding in the vehicle; a calculation unit, configured to calculate an absolute jitter parameter value based on the first acceleration, the second acceleration, and the third acceleration, the calculation unit comprising: a coordinate transformation unit, configured to transform the first acceleration, the second acceleration, and the third acceleration into the same coordinate system to obtain a first transformed acceleration, a second transformed acceleration, and a third transformed acceleration; and an operation unit, configured to subtract a difference between the third transformed acceleration and the second transformed acceleration from a difference between the first transformed acceleration and the second transformed acceleration to obtain the absolute jitter parameter value; a determining unit, configured to determine whether jitter compensation is required based on the absolute jitter parameter value; the determining unit further configured to compare the absolute jitter parameter value with a preset jitter threshold; when the absolute jitter parameter value is less than or equal to the preset jitter threshold, determining that compensation is not required; and when the absolute jitter parameter value is greater than the preset jitter threshold, determining that compensation is required; wherein only corresponding values ​​are compared between the absolute jitter parameter value and the preset jitter threshold; An image compensation unit is configured to perform jitter compensation on the image captured by the capturing device based on the absolute jitter parameter value.

5. The intelligent dynamic anti-shake system according to claim 4, wherein: The acquiring unit determines the second acceleration as the third acceleration, or obtains the third acceleration from an acceleration sensor disposed on the target object.

6. The intelligent dynamic anti-shake system according to claim 4, wherein: The image compensation unit compensates the image captured by the shooting device using a value opposite to the absolute jitter parameter value.

Images