A method and device for collecting gestures in a vehicle

By setting up a camera on the A-pillar of the vehicle and adjusting parameters to maximize the collection of finger contours, the problem of poor driver gesture recognition is solved, and the clarity of gesture recognition and driving safety is improved.

CN116883639BActive Publication Date: 2025-08-01CHINA FAW CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310919056.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-25
Publication Date
2025-08-01
Estimated Expiration
2043-07-25

AI Technical Summary

Technical Problem

Because driver gesture recognition in the vehicle is limited by space, the gesture recognition effect is poor, affecting driving safety.

Method used

By setting the camera on the A-pillar of the vehicle, obtain the finger profile after the driver leaves the steering wheel, adjust the camera parameters to maximize the finger profile, and achieve clear gesture recognition.

Benefits of technology

Improves clarity and accuracy of gesture recognition, reduces driver distraction, and improves driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116883639B_ABST
    Figure CN116883639B_ABST
Patent Text Reader

Abstract

The present application provides a method and a device for collecting gestures in a vehicle. By means of a camera disposed on the A-pillar of the vehicle and facing the driver, the contour of any finger of the driver leaving the steering wheel is tracked. The adjustment parameters of the camera and the target area in the video image are determined according to the display position and the complete ratio of the finger contour in the video image, so as to collect the gestures of the driver as clearly as possible to the greatest extent, which is conducive to gesture recognition.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of gesture recognition, and in particular, to a method and device for collecting gestures in a vehicle, a computer-readable storage medium, and an electronic device. Background Art

[0002] As the number of intelligent functions in vehicles increases, the original operations, whether it is the steering wheel control buttons or the touch screen, etc., will distract the driver during driving, posing a driving hazard. Controlling the vehicle through gestures can reduce the distraction of the driver.

[0003] In order to conveniently capture the gestures of the driver, a camera facing the driver is provided on the A-pillar of the vehicle. However, due to space limitations, it is difficult for the driver to make gestures facing the camera on the A-pillar. Therefore, the effect of gesture recognition is not very good.

[0004] Therefore, the present application provides a method for collecting gestures in a vehicle to solve the above technical problems. Summary of the Invention

[0005] The purpose of the present application is to provide a method and device for collecting gestures in a vehicle, a computer-readable storage medium, and an electronic device, which can solve at least one of the above-mentioned technical problems. The specific solutions are as follows:

[0006] According to a specific embodiment of the present application, in a first aspect, the present application provides a method for collecting gestures in a vehicle, including:

[0007] In the vehicle, obtain the finger contour after any finger of the driver leaves the steering wheel in the video image;

[0008] Determine the display position of the finger contour in the video image and the complete ratio of the finger contour in the video image;

[0009] Based on the display position of the finger contour and the complete ratio of the finger contour in the video image, determine the adjustment parameters of the camera and the target area in the video image, so as to adjust the camera based on the adjustment parameters, and make the finger contour be completely collected with the maximum display height in the target area of the video image, where the camera is provided on the A-pillar of the vehicle and faces the driver.

[0010] Optionally, the determining the adjustment parameters of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameters, and make the finger contour be completely collected with the maximum display height in the target area of the video image, includes:

[0011] When the display position of the finger contour is within the video image and the complete ratio of the finger contour is equal to 100%, determine the first adjustment parameter of the camera and the first target area in the video image, so as to adjust the camera based on the first adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the first target area of the video image, where the midline of the first target area is on the midline of the video image.

[0012] Optionally, determining the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the target area of the video image, includes:

[0013] When the display position of the finger contour is close to the left border of the video image and the complete ratio of the finger contour is less than 100% and greater than 50%, determine the second adjustment parameter of the camera and the second target area in the video image, so as to adjust the camera based on the second adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the second target area of the video image, where the second target area is within the video image and adjacent to the left border of the video image.

[0014] Optionally, determining the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the target area of the video image, includes:

[0015] When the display position of the finger contour is close to the right border of the video image and the complete ratio of the finger contour is less than 100% and greater than 50%, determine the third adjustment parameter of the camera and the third target area in the video image, so as to adjust the camera based on the third adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the third target area of the video image, where the third target area is within the video image and adjacent to the right border of the video image.

[0016] Optionally, the method further includes:

[0017] When the display position of the finger contour is in the first target area, and the complete ratio of the finger contour is less than 100% and greater than 50%, determine the fourth adjustment parameter of the camera, so as to adjust the camera based on the fourth adjustment parameter, and completely collect the finger contour with the maximum display height in the first target area of the video image.

[0018] According to the specific implementation manners of the present application, in a second aspect, the present application provides a gesture acquisition device in a vehicle, including:

[0019] An acquisition unit, configured to acquire the finger contour of any finger of the driver after leaving the steering wheel in a video image in the vehicle;

[0020] A determination unit, configured to determine the display position of the finger contour in the video image and the complete ratio of the finger contour in the video image;

[0021] An adjustment unit, configured to determine the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and completely collect the finger contour with the maximum display height in the target area of the video image, where the camera is disposed on the A-pillar of the vehicle and faces the driver.

[0022] Optionally, the adjustment unit includes:

[0023] A first adjustment unit, configured to when the display position of the finger contour is in the video image and the complete ratio of the finger contour is equal to 100%, determine the first adjustment parameter of the camera and the first target area in the video image, so as to adjust the camera based on the first adjustment parameter, and completely collect the finger contour with the maximum display height in the first target area of the video image, where the midline of the first target area is on the midline of the video image.

[0024] Optionally, the adjustment unit includes:

[0025] A second adjustment unit, configured to when the display position of the finger contour is close to the left border of the video image and the complete ratio of the finger contour is less than 100%, determine the second adjustment parameter of the camera and the second target area in the video image, so as to adjust the camera based on the second adjustment parameter, and completely collect the finger contour with the maximum display height in the second target area of the video image, where the second target area is within the video image and adjacent to the left border of the video image.

[0026] Optionally, the adjustment unit includes:

[0027] A third adjustment unit, configured to determine a third adjustment parameter of the camera and a third target area in the video image when the display position of the finger contour is close to the right border of the video image and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the third adjustment parameter, and enable the finger contour to be completely collected with the maximum display height in the third target area of the video image, where the third target area is within the video image and adjacent to the right border of the video image.

[0028] Optionally, the device further includes a fourth adjustment unit;

[0029] The fourth adjustment unit is configured to determine a fourth adjustment parameter of the camera when the display position of the finger contour is in the first target area and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the fourth adjustment parameter, and enable the finger contour to be completely collected with the maximum display height in the first target area of the video image.

[0030] According to a specific embodiment of the present application, in a third aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for collecting gestures in a vehicle as described in any one of the above is implemented.

[0031] According to a specific embodiment of the present application, in a fourth aspect, the present application provides an electronic device, including: one or more processors; a storage device, configured to store one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors are enabled to implement the method for collecting gestures in a vehicle as described in any one of the above.

[0032] Compared with the prior art, the above solution of the embodiment of the present application has at least the following beneficial effects:

[0033] The present application provides a method, a device, a computer-readable storage medium, and an electronic device for collecting gestures in a vehicle. The present application uses a camera disposed on the A-pillar of the vehicle and facing the driver to track the finger contour of any finger of the driver leaving the steering wheel. The adjustment parameter of the camera and the target area in the video image are determined according to the display position and the complete ratio of the finger contour in the video image, so as to clearly collect the gestures of the driver to the greatest extent, which is beneficial to gesture recognition. Description of the Drawings

[0034] Figure 1 Shows a flowchart of the method for collecting gestures in a vehicle according to an embodiment of the present application;

[0035] Figure 2Shows a target area diagram of a method for collecting gestures in a vehicle according to an embodiment of the present application;

[0036] Figure 3 Shows a unit block diagram of a gesture collection device in a vehicle according to an embodiment of the present application. Detailed implementation manners

[0037] In order to make the objectives, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts shall fall within the scope of protection of the present application.

[0038] The terms used in the embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. The singular forms "a", "the", and "said" used in the embodiments of the present application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. "Plural" generally includes at least two.

[0039] It should be understood that the term "and / or" used herein is only a description of the associated relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the character " / " herein generally represents an "or" relationship between the associated objects before and after.

[0040] It should be understood that although terms such as first, second, and third may be used in the embodiments of the present application for description, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, without departing from the scope of the embodiments of the present application, the first can also be called the second, and similarly, the second can also be called the first.

[0041] Depending on the context, the words "if", "when" as used herein can be interpreted as "when...", "when...", "in response to determining", or "in response to detecting". Similarly, depending on the context, the phrase "if determined" or "if detecting (stated condition or event)" can be interpreted as "when determined", "in response to determining", "when detecting (stated condition or event)", or "in response to detecting (stated condition or event)".

[0042] It should also be noted that the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a commodity or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or elements inherent to such commodity or device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of another identical element in the commodity or device comprising said element.

[0043] It should be particularly noted that symbols and / or numbers existing in the specification, if not marked in the accompanying drawing description, are not reference numerals.

[0044] The optional embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0045] An embodiment provided by the present application is an embodiment of a method for collecting gestures in a vehicle.

[0046] Below in conjunction with Figure 1 The embodiments of the present application will be described in detail.

[0047] Step S101, in a vehicle, obtain the finger contour after any finger of the driver leaves the steering wheel in the video image.

[0048] The video image is captured by a camera disposed on the A-pillar of the vehicle and facing the driver. This camera is specifically used for collecting the gestures of the driver. Since this camera does not have a pan-tilt head and cannot track the gesture by rotating the camera angle, only the focal length can be adjusted to improve the clarity of gesture collection.

[0049] Since the gesture is mainly generated by the fingers of the driver leaving the steering wheel, the camera in the embodiment of the present application is specifically used for collecting the video image of the fingers of the driver leaving the steering wheel. Extract the finger contour from the video image.

[0050] Step S102, determine the display position of the finger contour in the video image and the complete ratio of the finger contour in the video image.

[0051] The display position refers to the position in the image coordinate system.

[0052] The display position of the finger contour can be understood as the geometric center position of the finger contour.

[0053] If the finger contour exceeds the boundary of the video image, the finger contour is incomplete.

[0054] The complete ratio refers to the percentage of the finger contour in the video image to the complete finger contour.

[0055] Step S103: Determine the adjustment parameters of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameters to completely collect the finger contour with the maximum display height in the target area of the video image.

[0056] Wherein, the camera is disposed on the A-pillar of the vehicle and faces the driver.

[0057] In the embodiment of the present application, the camera disposed on the A-pillar of the vehicle and facing the driver tracks the finger contour of any finger of the driver leaving the steering wheel. Determine the adjustment parameters of the camera and the target area in the video image according to the display position and the complete ratio of the finger contour in the video image, so as to clearly collect the gestures of the driver to the greatest extent, which is beneficial to gesture recognition.

[0058] In some specific embodiments, the determining the adjustment parameters of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio in the video image, so as to adjust the camera based on the adjustment parameters to completely collect the finger contour with the maximum display height in the target area of the video image includes the following steps:

[0059] Step S103a: When the display position of the finger contour is in the video image and the complete ratio of the finger contour is equal to 100%, determine the first adjustment parameter of the camera and the first target area in the video image, so as to adjust the camera based on the first adjustment parameter to completely collect the finger contour with the maximum display height in the first target area of the video image.

[0060] Wherein, as Figure 2 shown, the midline of the first target area is on the midline of the video image.

[0061] The complete ratio of the finger contour being equal to 100% can be understood as that the finger contour is completely displayed on the video image.

[0062] Since the width of the video image is greater than the height, that is, after the finger contour is displayed with the maximum display height in the first target area, the finger contour can also be displayed in the video image in terms of width. For example, if the finger contour is close to the upper border of the video image, the top of the adjusted finger contour is adjacent to the upper border of the video image; if the finger contour is close to the lower border of the video image, the bottom of the adjusted finger contour is adjacent to the lower border of the video image. That is, the finger contour is displayed to the greatest extent.

[0063] In some specific embodiments, determining the adjustment parameters of the camera and the target area in the video image based on the display position of the finger contour and the complete proportion in the video image, so as to adjust the camera based on the adjustment parameters to completely collect the finger contour with the maximum display height in the target area of the video image, includes the following steps:

[0064] Step S103b, when the display position of the finger contour is close to the left border of the video image, and the complete proportion of the finger contour is less than 100% and greater than 50%, determine the second adjustment parameters of the camera and the second target area in the video image, so as to adjust the camera based on the second adjustment parameters to completely collect the finger contour with the maximum display height in the second target area of the video image.

[0065] Wherein, the second target area is within the video image and adjacent to the left border of the video image.

[0066] The display position of the finger contour is close to the left border of the video image, and the complete proportion of the finger contour is less than 100% and greater than 50%. It can be understood that most of the finger contour is within the left border of the video image. Relative to the position of the camera, the image content collected by the left border of the video image involves the far end of the driver. Only by expanding the shooting range of the camera can the finger contour be completely displayed in the video image. And when expanding the shooting range, the image of the finger contour in the video image will become smaller. Therefore, the display position where the complete finger contour is obtained and the finger contour is the largest can only be in the second target area, that is, within the video image and adjacent to the left border of the video image.

[0067] In some specific embodiments, determining the adjustment parameters of the camera and the target area in the video image based on the display position of the finger contour and the complete proportion in the video image, so as to adjust the camera based on the adjustment parameters to completely collect the finger contour with the maximum display height in the target area of the video image, includes the following steps:

[0068] Step S103c, when the display position of the finger contour is close to the right border of the video image, and the complete proportion of the finger contour is less than 100% and greater than 50%, determine the third adjustment parameters of the camera and the third target area in the video image, so as to adjust the camera based on the third adjustment parameters to completely collect the finger contour with the maximum display height in the third target area of the video image,

[0069] Wherein, the third target area is within the video image and adjacent to the right border of the video image.

[0070] The display position of the finger outline is adjacent to the right frame of the video image, and the complete proportion of the finger outline is less than 100% and greater than 50%. It can be understood that most of the finger outline is within the right frame of the video image. Relative to the position of the camera, the image content captured by the right frame of the video image involves the near end of the driver. The finger outline can only be fully displayed in the video image by expanding the shooting range of the camera. As the shooting range is expanded, the image of the finger outline in the video image will become smaller. Therefore, the complete finger outline and the largest display position of the finger outline can only be obtained in the third target area, that is, within the video image and adjacent to the right frame of the video image.

[0071] In some specific embodiments, the method further comprises the following steps:

[0072] Step S103d, when the display position of the finger outline is in the first target area and the complete proportion of the finger outline is less than 100% and greater than 50%, determine the fourth adjustment parameter of the camera, so as to adjust the camera based on the fourth adjustment parameter so that the finger outline is completely captured at the maximum display height in the first target area of the video image.

[0073] The finger outline is displayed within the first target area, and the completeness ratio of the finger outline is less than 100% and greater than 50%. This means that a large portion of the finger outline is within the right border of the video image. Since the finger outline is within the first target area, the finger outline is fully captured at the maximum display height within the first target area of the video image.

[0074] In other cases, gesture information is not collected because a complete and clear finger outline cannot be obtained.

[0075] The present application also provides an apparatus embodiment that is based on the above embodiment, and is used to implement the method steps described in the above embodiment. The interpretation based on the same name meaning is the same as that of the above embodiment, and has the same technical effect as the above embodiment, and will not be repeated here.

[0076] like Figure 3 As shown, the present application provides a gesture collection device 300 in a vehicle, comprising:

[0077] An acquisition unit 301 is configured to acquire, in a vehicle, a finger outline of a driver after any finger leaves the steering wheel in a video image;

[0078] a determining unit 302, configured to determine a display position of the finger outline in the video image and a complete proportion of the finger outline in the video image;

[0079] An adjustment unit 303 is configured to determine adjustment parameters of the camera and a target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameters, and completely collect the finger contour with the maximum display height in the target area of the video image, where the camera is disposed on the A-pillar of the vehicle and faces the driver.

[0080] Optionally, the adjustment unit includes:

[0081] A first adjustment unit is configured to determine first adjustment parameters of the camera and a first target area in the video image when the display position of the finger contour is in the video image and the complete ratio of the finger contour is equal to 100%, so as to adjust the camera based on the first adjustment parameters, and completely collect the finger contour with the maximum display height in the first target area of the video image, where the midline of the first target area is on the midline of the video image.

[0082] Optionally, the adjustment unit includes:

[0083] A second adjustment unit is configured to determine second adjustment parameters of the camera and a second target area in the video image when the display position of the finger contour is close to the left border of the video image and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the second adjustment parameters, and completely collect the finger contour with the maximum display height in the second target area of the video image, where the second target area is within the video image and adjacent to the left border of the video image.

[0084] Optionally, the adjustment unit includes:

[0085] A third adjustment unit is configured to determine third adjustment parameters of the camera and a third target area in the video image when the display position of the finger contour is close to the right border of the video image and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the third adjustment parameters, and completely collect the finger contour with the maximum display height in the third target area of the video image, where the third target area is within the video image and adjacent to the right border of the video image.

[0086] Optionally, the device further includes a fourth adjustment unit;

[0087] A fourth adjustment unit, configured to determine a fourth adjustment parameter of the camera when the display position of the finger contour is in the first target area and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the fourth adjustment parameter, so that the finger contour is completely collected with the maximum display height in the first target area of the video image.

[0088] In the embodiment of the present application, a camera disposed on the A-pillar of the vehicle and facing the driver is used to track the finger contour of any finger of the driver leaving the steering wheel. The adjustment parameter of the camera and the target area in the video image are determined according to the display position and the complete ratio of the finger contour in the video image, so as to collect the driver's gesture as clearly as possible to the greatest extent, which is beneficial to gesture recognition.

[0089] This embodiment provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, the memory stores instructions executable by the one processor, and the instructions are executed by the at least one processor, so that the at least one processor can execute the method steps described in the above embodiment.

[0090] The embodiment of the present application provides a non-volatile computer storage medium, and the computer storage medium stores computer-executable instructions, and the computer-executable instructions can execute the method steps described in the above embodiment.

[0091] Finally, it should be noted that the embodiments in this specification are described in a progressive manner, and the key points of each embodiment are the differences from other embodiments. The same and similar parts between the embodiments can be referred to each other. For the system or device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method part.

[0092] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for collecting gestures in a vehicle, characterized in that, Including: In a vehicle, obtaining a finger contour after any finger of the driver leaves the steering wheel in a video image; Determining a display position of the finger contour in the video image and a complete ratio of the finger contour in the video image; Determining an adjustment parameter of the camera and a target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and enabling the finger contour to be completely collected with a maximum display height in the target area of the video image, wherein the camera is disposed on the A-pillar of the vehicle and faces the driver.

2. The method according to claim 1, characterized in that, The determining the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and enabling the finger contour to be completely collected with a maximum display height in the target area of the video image, includes: When the display position of the finger contour is in the video image and the complete ratio of the finger contour is equal to 100%, determining a first adjustment parameter of the camera and a first target area in the video image, so as to adjust the camera based on the first adjustment parameter, and enabling the finger contour to be completely collected with a maximum display height in the first target area of the video image, wherein a midline of the first target area is on a midline of the video image.

3. The method according to claim 1, wherein The determining the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and enabling the finger contour to be completely collected with a maximum display height in the target area of the video image, includes: When the display position of the finger contour is close to a left border of the video image and the complete ratio of the finger contour is less than 100% and greater than 50%, determining a second adjustment parameter of the camera and a second target area in the video image, so as to adjust the camera based on the second adjustment parameter, and enabling the finger contour to be completely collected with a maximum display height in the second target area of the video image, wherein the second target area is within the video image and adjacent to the left border of the video image.

4. The method according to claim 1, wherein The determining the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, and enabling the finger contour to be completely collected with a maximum display height in the target area of the video image, includes: When the display position of the finger contour is close to the right border of the video image, and the complete ratio of the finger contour is less than 100% and greater than 50%, determine the third adjustment parameter of the camera and the third target area in the video image, so as to adjust the camera based on the third adjustment parameter, so that the finger contour is completely collected with the maximum display height in the third target area of the video image, wherein the third target area is within the video image and adjacent to the right border of the video image.

5. The method according to claim 2, characterized in that The method further includes: When the display position of the finger contour is in the first target area, and the complete ratio of the finger contour is less than 100% and greater than 50%, determine the fourth adjustment parameter of the camera, so as to adjust the camera based on the fourth adjustment parameter, so that the finger contour is completely collected with the maximum display height in the first target area of the video image.

6. A gesture acquisition device in a vehicle, characterized in that, It includes: An acquisition unit, configured to acquire the finger contour of any finger of the driver leaving the steering wheel in the video image in the vehicle; A determination unit, configured to determine the display position of the finger contour in the video image and the complete ratio of the finger contour in the video image; An adjustment unit, configured to determine the adjustment parameter of the camera and the target area in the video image based on the display position of the finger contour and the complete ratio of the finger contour in the video image, so as to adjust the camera based on the adjustment parameter, so that the finger contour is completely collected with the maximum display height in the target area of the video image, wherein the camera is disposed on the A-pillar of the vehicle and faces the driver.

7. The device according to claim 6, characterized in that, The adjustment unit includes: A first adjustment unit, configured to when the display position of the finger contour is in the video image and the complete ratio of the finger contour is equal to 100%, determine the first adjustment parameter of the camera and the first target area in the video image, so as to adjust the camera based on the first adjustment parameter, so that the finger contour is completely collected with the maximum display height in the first target area of the video image, wherein the midline of the first target area is on the midline of the video image.

8. The device according to claim 6, wherein The adjustment unit includes: A second adjustment unit, configured to when the display position of the finger contour is close to the left border of the video image and the complete ratio of the finger contour is less than 100%, determine the second adjustment parameter of the camera and the second target area in the video image, so as to adjust the camera based on the second adjustment parameter, so that the finger contour is completely collected with the maximum display height in the second target area of the video image, wherein the second target area is within the video image and adjacent to the left border of the video image.

9. The device according to claim 6, characterized in that, The adjustment unit includes: A third adjustment unit, configured to determine a third adjustment parameter of the camera and a third target area in the video image when the display position of the finger contour is close to the right border of the video image and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the third adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the third target area of the video image, wherein the third target area is within the video image and adjacent to the right border of the video image.

10. The device according to claim 7, characterized in that, The device further includes a fourth adjustment unit; The fourth adjustment unit is configured to determine a fourth adjustment parameter of the camera when the display position of the finger contour is in the first target area and the complete ratio of the finger contour is less than 100%, so as to adjust the camera based on the fourth adjustment parameter, and enable the finger contour to be completely captured with the maximum display height in the first target area of the video image.

Citation Information

Patent Citations

  • Information acquisition method and device, electronic equipment and storage medium

    CN112817445A

  • Gesture based image capturing system for vehicle

    US20150199019A1