Door handle control method, device, electronic device and storage medium

Abstract

The present invention provides a door handle control method, device, electronic device and storage medium. By acquiring at least one target area image inside and outside the door of a vehicle to be controlled, gesture recognition of the user in the at least one target area image is performed, user gesture information and the door handle associated with the user gesture information are determined, and the user intention is determined based on the user gesture information and the door handle associated with the user gesture information. The user intention includes opening or closing at least one door. If the user intends to open at least one door, the door handle on the door is controlled to be in a pop-up state to open the door. If the user intends to close at least one door, the door handle on the door is controlled to be in a retracted state to close the door. By determining the user intention, a more convenient and accurate door handle control method is provided, thereby improving the comfort and convenience of daily vehicle use.

Description

Technical Field

[0001] The present invention relates to the field of automobile technology, and in particular to a door handle control method, device, electronic device and storage medium. Background Art

[0002] With the development of society and the economy, cars have become a vital part of people's lives and have become one of their preferred means of transportation. Existing vehicles all feature door handles for opening and closing doors. These handles include both traditional and emerging hidden door handles. During driving, the protruding areas of traditional door handles and the recessed areas of the doors can cause airflow to shift direction as it glides along the vehicle body, increasing driving resistance and noise, and impacting overall vehicle comfort.

[0003] With the development of science and technology, intelligent driving of automobiles has become a standard configuration of mainstream models, and hidden door handles have also become the trend of future vehicle styling. Hidden door handles are not only more beautiful, but also can reduce the wind resistance of the vehicle, which is conducive to reducing the vehicle's fuel consumption and power consumption. However, the existing hidden door handle unlocking and automatic pop-up has two settings: one is to unlock and pop up the door handle of the main driver's door, and the other is to unlock and pop up the door handles of all doors. It is impossible to realize the control function of specifying a single or multiple door handles, and the accuracy and user experience are not high. In the comparative document CN114991602A "A kind of automobile hidden door handle automatic control system and vehicle", the user's door opening action is sensed by installing a door handle sensor on each door, which cannot accurately judge the user's intention, and there is a large misjudgment, which will bring a bad experience to the user. It should be noted that the above content only provides background technical information related to the present invention and does not necessarily constitute prior art. Summary of the Invention

[0004] In view of the above-mentioned shortcomings of the prior art, the present invention provides a door handle control method, device, electronic device and storage medium to solve the above-mentioned technical problems of inaccurate door handle control and inability to specify control of single or multiple door handles.

[0005] Other features and advantages of the present invention will become apparent from the following detailed description, or may be learned in part by practice of the present invention.

[0006] According to one aspect of an embodiment of the present invention, a door handle control method is provided, comprising: acquiring at least one target area image inside and outside a door of a vehicle to be controlled; performing gesture recognition on a user in at least one of the target area images to determine user gesture information and a door handle associated with the user gesture information; determining a user intention based on the user gesture information and the door handle associated with the user gesture information, the user intention including opening or closing at least one door; if the user intention is to open at least one door, controlling the door handle on the door to be in a pop-up state to open the door; if the user intention is to close at least one door, controlling the door handle on the door to be in a retracted state to close the door.

[0007] In one embodiment of the present invention, based on the aforementioned scheme, gesture recognition is performed on a user in at least one of the target area images, and user gesture information and a door handle associated with the user gesture information are determined, including: if it is detected that the distance between the user in the target area image and the vehicle to be controlled is less than or equal to a first preset distance, then it is determined that the user is in the preset area; gesture recognition is performed on a user in at least one of the target area images, and user gesture information is determined, and the user gesture information includes the user gesture action and the current relative distance; the current position of the user in the target area image is identified, the relationship between the current position of the user and the preset area is determined, and the area to which the user belongs is obtained to determine the door handle associated with the user gesture information.

[0008] In one embodiment of the present invention, based on the aforementioned scheme, the user intention is determined according to the door handle associated with the user gesture information, and the user intention includes opening or closing at least one car door, including: if the user gesture action is recognized as a first preset gesture action and the current relative distance at the second moment is less than the current relative distance at the first moment, then the user intention is determined to be to open the car door associated with the user gesture information, and the second moment is greater than the first moment; if the second preset gesture action is recognized within the first preset time, then the user intention is determined to be to close the car door associated with the user gesture information, and the second preset gesture action is different from the first preset gesture action.

[0009] In one embodiment of the present invention, based on the aforementioned scheme, after determining the user intention according to the user gesture information and the door handle associated with the user gesture information, it also includes: if the user intention is to close the vehicle door associated with the user gesture information and the current vehicle locking state is a locked state, then keeping the door handle associated with the user gesture information in a retracted state; if the user intention is to close the vehicle door associated with the user gesture information and the current vehicle locking state is an unlocked state, then generating a first control signal according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a retracted state.

[0010] In one embodiment of the present invention, based on the aforementioned scheme, if the user intends to close the vehicle door associated with the user gesture information and the current vehicle locking state is the unlocked state, a first control signal is generated according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a retracted state, including: if the user intends to close the vehicle door associated with the user gesture information, the current vehicle locking state is the unlocked state, and the current state of the door handle associated with the user gesture information is the retracted state, then a first control signal is generated to keep the door handle associated with the user gesture information, and keep the door handle associated with the user gesture information in a retracted state; if the user intends to close the vehicle door associated with the user gesture information, the current vehicle locking state is the unlocked state, and the current state of the door handle associated with the user gesture information is the pop-up state, then a first control signal is generated to retract the door handle associated with the user gesture information, and control the door handle associated with the user gesture information to be in a retracted state.

[0011] In one embodiment of the present invention, based on the aforementioned scheme, after determining the user intention according to the user gesture information and the door handle associated with the user gesture information, it also includes: if the user intention is to open the vehicle door associated with the user gesture information and the current vehicle locking state is a locked state, then the door handle associated with the user gesture information is kept in a retracted state; if the user intention is to open the vehicle door associated with the user gesture information and the current vehicle locking state is an unlocked state, then according to the current state of the door handle associated with the user gesture information, a second control signal is generated to control the door handle associated with the user gesture information to be in a pop-up state.

[0012] In one embodiment of the present invention, based on the aforementioned scheme, if the user intends to open the vehicle door associated with the user gesture information and the current vehicle locking state is the unlocked state, then a second control signal is generated according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a pop-up state, including: if the user intends to open the vehicle door associated with the user gesture information, the current vehicle locking state is the unlocked state, and the current state of the door handle associated with the user gesture information is the retracted state, then a second control signal is generated to pop out the door handle associated with the user gesture information, and the door handle associated with the user gesture information is controlled to be in a pop-up state; if the user intends to open the vehicle door associated with the user gesture information, the current vehicle locking state is the unlocked state, and the current state of the door handle associated with the user gesture information is the pop-up state, then a second control signal is generated to keep the door handle associated with the user gesture information, and keep the door handle associated with the user gesture information in a pop-up state.

[0013] According to one aspect of an embodiment of the present invention, a door handle control device is provided, comprising: an image acquisition module, configured to acquire at least one target area image inside and outside a door of a vehicle to be controlled; a gesture recognition module, configured to perform gesture recognition on a user in at least one of the target area images, and determine user gesture information and a door handle associated with the user gesture information; an intention determination module, configured to determine a user intention based on the user gesture information and the door handle associated with the user gesture information, wherein the user intention includes opening or closing at least one door; a first control module, configured to control the door handle on the door to be in a pop-up state to open the door if the user intends to open at least one door; and a second control module, configured to control the door handle on the door to be in a retracted state to close the door if the user intends to close at least one door.

[0014] According to one aspect of an embodiment of the present invention, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the electronic device implements the door handle control method as described in any one of the above embodiments.

[0015] The present invention also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor of a computer, the computer is caused to execute the door handle control method as described in any one of the above embodiments.

[0016] Beneficial effects of the present invention: The present invention provides a door handle control method, device, electronic device and storage medium. In the present invention, by analyzing the acquired target area image, the user gesture information and the door handle associated with the user gesture information are determined, and the user's current user intention is obtained. Combined with the current vehicle locking state, the door handle of a single or multiple doors of the vehicle to be controlled is designated to control, and the user's current user intention is accurately judged to improve the user's usage experience. The device of the present invention can control the current state of the door handle associated with the user gesture information according to the user's current user intention, providing support for a more intelligent and humane car experience.

[0017] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings are incorporated into and constitute a part of the specification, illustrating embodiments consistent with the present application and, together with the specification, serving to explain the principles of the present application. It is obvious that the drawings described below are merely some embodiments of the present application, and a person of ordinary skill in the art can derive other drawings based on these drawings without inventive effort. In the drawings:

[0019] Figure 1 is a schematic diagram of an exemplary system architecture shown in an exemplary embodiment of the present application;

[0020] Figure 2 is a flow chart of a door handle control method according to an exemplary embodiment of the present application;

[0021] Figure 3 is a schematic diagram of the system structure of a door handle control method shown in an exemplary embodiment of the present application;

[0022] Figure 4 is a block diagram of a door handle control device shown in an exemplary embodiment of the present application;

[0023] Figure 5 is a block diagram of a door handle control system according to an exemplary embodiment of the present application;

[0024] Figure 6 A schematic structural diagram of a computer system suitable for implementing an electronic device according to an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0025] The following describes the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art will readily appreciate the other advantages and benefits of the present invention from the disclosure herein. The present invention may also be implemented or applied through various other specific embodiments, and the various details in this specification may be modified or altered based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are intended only to illustrate the present invention and are not intended to limit the scope of protection of the present invention.

[0026] It should be noted that the illustrations provided in the following embodiments are merely schematic illustrations of the basic concept of the present invention. Therefore, the illustrations only show components related to the present invention and are not drawn according to the number, shape, and size of components in actual implementation. In actual implementation, the type, quantity, and proportion of each component may be changed arbitrarily, and the component layout may also be more complex.

[0027] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it will be apparent to those skilled in the art that the embodiments of the present invention may be practiced without these specific details. In other embodiments, well-known structures and devices are shown in block diagram form rather than in detail to avoid obscuring the embodiments of the present invention.

[0028] First of all, it should be noted that hidden door handles refer to door handles that are designed to be hidden on the vehicle, and the door handles support electric pop-up and retraction.

[0029] Computer vision (CV) is the science of making machines "see." Specifically, it refers to using cameras and computers to replace the human eye in identifying, tracking, and measuring objects. It also performs further image processing, transforming the computer's image into one more suitable for human observation or transmission to instrumentation. As a scientific discipline, computer vision studies related theories and technologies, attempting to build artificial intelligence systems capable of extracting information from images or multidimensional data. Computer vision technologies typically include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and common biometric recognition technologies such as facial recognition and fingerprint recognition.

[0030] Figure 1 It is a schematic diagram of an exemplary system architecture shown in an exemplary embodiment of the present application.

[0031] Reference Figure 1 As shown, the system architecture may include an image acquisition device 101 and a computer device 102. The computer device 102 may be at least one of a desktop graphics processing unit (GPU) computer, a GPU computing cluster, a neural network computer, etc. Relevant technical personnel can use the computer device 102 to process images, obtain target area images, perform gesture recognition, determine user intentions, and control the state of the door handle according to the user intentions. The image acquisition device 101 is used to acquire target area images. In this embodiment, the image acquisition device 101 uses a camera to acquire images and provides them to the computer device 102 for processing. It should be noted that the image acquisition device 101 and the computer device 102 provided in this embodiment are only examples and should not bring any limitations to the functions and scope of use of the embodiments of the present invention.

[0032] Illustratively, after acquiring at least one target area image from the image acquisition device 101, the computer device 102 can perform gesture recognition on the user within the at least one target area image to determine user gesture information and the door handle associated with the gesture information. Based on the user gesture information and the door handle associated with the gesture information, the computer device 102 can determine the user's intention, which may include opening or closing at least one vehicle door. If the user's intention is to open at least one vehicle door, the door handle on the vehicle door is controlled to be in an extended state to open the vehicle door; if the user's intention is to close at least one vehicle door, the door handle on the vehicle door is controlled to be in a retracted state to close the vehicle door. Thus, the technical solution of the embodiment of the present application can determine the user's intention by performing gesture recognition on the target area image, thereby specifying the control state of the vehicle door handle based on the user's intention. By determining the user's door opening need under multiple conditions and accurately determining the user's intention, the accuracy of door handle control can be improved. It can also specify the control of single or multiple door handles, reducing error rates and supporting a more intelligent and user-friendly vehicle experience.

[0033] It should be noted that the door handle control method provided in the embodiment of the present application is generally executed by the computer device 102 , and accordingly, the door handle control device is generally provided in the computer device 102 .

[0034] Figure 2 is a flow chart of a door handle control method according to an exemplary embodiment of the present invention. The door handle control method can be executed by a computing and processing device. The computing and processing device can be Figure 1 The computer device 102 shown in FIG. Figure 2 As shown, the door handle control method includes at least steps S210 to S250, which are described in detail as follows:

[0035] In step S210 , an image of at least one target area inside and outside a door of a vehicle to be controlled is acquired.

[0036] In one embodiment of the present application, the target area image can be obtained by processing the real-time captured images of the inside and outside of the door of the vehicle to be controlled; the target area image can also be obtained by the computing and processing device 102 through other image acquisition devices connected thereto; and the target area image can also be input into the computing and processing device 102 by relevant technical personnel.

[0037] In step S220 , a user gesture is recognized within at least one target area image to determine user gesture information and a door handle associated with the user gesture information.

[0038] In one embodiment of the present application, if it is detected that the distance between the user and the vehicle to be controlled in the target area image is less than or equal to a first preset distance, the user is determined to be in the preset area; gesture recognition is performed on the user in at least one target area image, and the gesture recognition can distinguish between the left and right hands, and determine the user gesture information. The user gesture information includes the user gesture action and the current relative distance. The current relative distance is the current relative distance between the current user gesture action and the door handle associated with the user gesture information; the user's current position in the target area image is identified, the relationship between the user's current position and the preset area is determined, and the area to which the user belongs is obtained to determine the door handle associated with the user gesture information. For example, the first preset distance is set to 1 meter. If it is detected that the distance between the user and the vehicle to be controlled in the target area image is less than or equal to 1 meter, the user is determined to be in the preset area; gesture recognition is performed on the user in the target area image to obtain user gesture information, the user gesture action is palm down and fingers forward, and the current relative distance between the user gesture action and the door handle associated with the user gesture information is 1 meter; the user's current position in the target area image is identified, and it is determined that the user's current position is within the first preset area, and the area to which the user belongs is obtained as the first preset area, and the door handle associated with the user gesture information is determined to be the door handle within the first preset area, that is, the door handle of the main driver's door.

[0039] In step S230, the user intention is determined based on the user gesture information and the door handle associated with the user gesture information.

[0040] The user intention includes opening or closing at least one vehicle door.

[0041] In one embodiment of the present application, if the user gesture is recognized as a first preset gesture and the current relative distance at the second moment is less than the current relative distance at the first moment, then it is determined that the user intends to open the door associated with the user gesture information, and the second moment is greater than the first moment. If the second preset gesture is recognized within the first preset time, then it is determined that the user intends to close the door associated with the user gesture information, and the second preset gesture is different from the first preset gesture. For example, if the user gesture is recognized as a palm facing down, fingers forward, which is the first preset gesture, and the current relative distance of 0.3 meters between the user gesture at the second moment and the door handle associated with the user gesture information, i.e., the door handle of the main driver's door, is less than the current relative distance of 0.5 meters between the user gesture at the first moment and the door handle associated with the user gesture information, i.e., the door handle of the main driver's door, then it is determined that the user intends to open the door associated with the user gesture information, i.e., it is determined that the user intends to open the main driver's door. For another example, if the user gesture is identified as a fist, which is the second preset gesture, within 10 seconds, it is determined that the user intends to close the door associated with the user gesture information, that is, it is determined that the user intends to close the main driver's door.

[0042] In step S240 , if the user intends to open at least one door, the door handle on the door is controlled to be in a pop-up state to open the door.

[0043] In one embodiment of the present application, if the user intends to open the door associated with the user gesture information and the current vehicle lock state is locked, the door handle associated with the user gesture information is kept in a retracted state; if the user intends to open the door associated with the user gesture information and the current vehicle lock state is unlocked, a second control signal is generated based on the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in an ejected state. For example, if the user intends to open the main driver's door and the current vehicle lock state is locked, the main driver's door handle is kept in a retracted state; if the user intends to open the main driver's door and the current vehicle lock state is unlocked, a second control signal is generated based on the current state of the main driver's door handle to control the main driver's door handle to be in an ejected state.

[0044] If the user intends to open the door associated with the user gesture information, the current vehicle lock state is unlocked, and the current state of the door handle associated with the user gesture information is retracted, a second control signal is generated to pop out the door handle associated with the user gesture information, controlling the door handle associated with the user gesture information to be in the pop-up state. If the user intends to open the door associated with the user gesture information, the current vehicle lock state is unlocked, and the current state of the door handle associated with the user gesture information is in the pop-up state, a second control signal is generated to hold the door handle associated with the user gesture information, maintaining the door handle associated with the user gesture information in the pop-up state. For example, if the user intends to open the main driver's door, the current vehicle lock state is unlocked, and the current state of the main driver's door handle is retracted, a second control signal is generated to pop out the main driver's door handle, controlling the door handle to be in the pop-up state. If the user intends to open the main driver's door, the current vehicle lock state is unlocked, and the current state of the main driver's door handle is in the pop-up state, a second control signal is generated to hold the main driver's door handle, maintaining the door handle in the pop-up state.

[0045] In step S250 , if the user intends to close at least one door, the door handle on the door is controlled to be in a retracted state to close the door.

[0046] In one embodiment of the present application, if the user intends to close the door associated with the user gesture information and the current vehicle lock state is locked, the door handle associated with the user gesture information is maintained in a retracted state. If the user intends to close the door associated with the user gesture information and the current vehicle lock state is unlocked, a first control signal is generated based on the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be retracted. For example, if the user intends to close the rear right seat door and the current vehicle lock state is locked, the rear right seat door handle is maintained in a retracted state. If the user intends to close the rear right seat door and the current vehicle lock state is unlocked, a first control signal is generated based on the current state of the rear right seat door handle to control the rear right seat door handle to be retracted.

[0047] If the user intends to close the vehicle door associated with the user gesture information, the current vehicle locking state is unlocked, and the current state of the door handle associated with the user gesture information is retracted, then a first control signal is generated to keep the door handle associated with the user gesture information, and the door handle associated with the user gesture information is kept in the retracted state; if the user intends to close the vehicle door associated with the user gesture information, the current vehicle locking state is unlocked, and the current state of the door handle associated with the user gesture information is popped out, then a first control signal is generated to retract the door handle associated with the user gesture information, and the door handle associated with the user gesture information is controlled to be in the retracted state. For example, if the user intends to close the rear right door, the current vehicle lock state is unlocked, and the current state of the rear right door handle is retracted, a first control signal is generated to keep the rear right door handle, keeping the rear right door handle in the retracted state; if the user intends to close the rear right door, the current vehicle lock state is unlocked, and the current state of the rear right door handle is popped out, a first control signal is generated to retract the rear right door handle, controlling the rear right door handle to be in the retracted state.

[0048] It should be noted that there is no fixed order between step S240 controlling the door handle on the vehicle door to be in a pop-up state and step S250 controlling the door handle on the vehicle door to be in a retracted state. Depending on the actual situation, only step S240 may be executed to control the door handle on the vehicle door to be in a pop-up state or only step S250 may be executed to control the door handle on the vehicle door to be in a retracted state. Alternatively, step S240 may be executed first to control the door handle on the vehicle door to be in a pop-up state and then step S250 may be executed to control the door handle on the vehicle door to be in a retracted state. Alternatively, step S250 may be executed first to control the door handle on the vehicle door to be in a retracted state and then step S240 may be executed to control the door handle on the vehicle door to be in a pop-up state.

[0049] Figure 3It is a system structure diagram of a door handle control method shown in an exemplary embodiment of the present application.

[0050] Reference Figure 3 As shown, the system structure diagram of the door handle control method includes a vehicle lock controller 310, a vehicle B-pillar camera 320, a body controller 330, an image analysis system 340, a hidden door handle controller 350 and a door handle drive motor 360.

[0051] In one embodiment of the present application, a user unlocks a vehicle to be controlled through a vehicle lock controller 310, wherein the vehicle lock controller 310 includes but is not limited to a remote control key, a Bluetooth key, a mobile phone application software control, and an in-vehicle unlocking switch, so that the vehicle to be controlled is in an unlocked state, and controls the wide-angle cameras installed on the left and right sides of the B-pillar of the vehicle body, namely the vehicle B-pillar camera 320, to start working, and obtain an image of a target area of the vehicle to be controlled, including an image of the environment outside the vehicle body. After the image is obtained, it is analyzed and processed by the image analysis system 340 to determine user gesture information and the door handle associated with the user gesture information, analyze the door area currently located by the user, namely the user's area, and the user's door opening requirement, namely the user's intention, and issue the user's intention. After obtaining the user's intention, the body controller 330 combines the current door handle state, namely the current state of the door handle associated with the user gesture information, and sends a door handle control signal to a specified single or multiple hidden door handle controllers 350. The hidden door handle controller 350 receives the door handle control signal and controls the door handle drive motor 360 to drive and control the current door handle state. After the door handle drive motor 360 completes driving and controlling the current door handle state, i.e., the current state of the door handle associated with the user gesture information, it feeds back the current door handle state, i.e., the current state of the door handle associated with the user gesture information, to the hidden door handle controller 350. The hidden door handle controller 350 then feeds back the current door handle state fed back by the door handle drive motor 360 to the vehicle body controller. The current door handle state can be obtained from the feedback of the door handle drive motor 360 or from the image recognition of the target area. It is understood that this embodiment is applied to the control process of hidden door handles in a vehicle. The hidden door handles are usually hidden in the vehicle body to ensure aesthetics while reducing the vehicle's wind resistance, which is a significant advantage over traditional fixed door handles.

[0052] In one embodiment, upon receiving the unlock signal from the lock controller 310, the vehicle body controller 330 controls the unlock state of the controlled vehicle and transmits a vehicle unlock status signal to the vehicle bus. The image analysis system 340 uses the target area image captured by the vehicle's B-pillar camera 320 to perform image segmentation and gesture recognition. It determines the current door handle state and analyzes the distance between the user's gesture and the door handle, i.e., the current relative distance. It then interprets the user's intent and transmits it to the hidden door handle controller 350. Furthermore, it develops a rigorous strategy to optimize user scenarios and enhance the user experience.

[0053] In one embodiment, if the vehicle to be controlled is unlocked, that is, the current vehicle lock state is unlocked, the current door handle state is retracted, and a single door interprets the user's intention as opening the door, the door handle of the corresponding single door is controlled to automatically pop out; if the vehicle to be controlled is unlocked, that is, the current vehicle lock state is unlocked, the current door handle state is pop-up, and a single door interprets the user's intention as closing the door, the door handle of the corresponding single door is controlled to automatically retract; if the vehicle is unlocked, the current door handle state is retracted, and multiple doors interpret the user's intention as opening the door, the door handles of the corresponding multiple doors are controlled to automatically pop out; if the vehicle is unlocked, the current door handle state is pop-up, and multiple doors interpret the user's intention as closing the door, the door handles of the corresponding multiple doors are controlled to automatically retract; if the vehicle is unlocked, the current door handle state is pop-up, and the user's intention to open the door is not interpreted within a certain period of time, the door handles of the corresponding doors are controlled to automatically retract; if the vehicle is not unlocked, the user's intention cannot be interpreted, and the current door handle state is retracted. The present invention determines user intentions under multiple conditions and formulates corresponding strategies, and through the collaborative work of multiple controllers, improves control accuracy and enhances user experience.

[0054] Figure 4 This is a block diagram of a door handle control device shown in an exemplary embodiment of the present application. The device can be applied to Figure 1 The implementation environment shown is specifically configured in the computer device 102. The apparatus may also be applicable to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the apparatus is applicable.

[0055] like Figure 4 As shown, the exemplary door handle control device 400 includes: an image acquisition module 410, a gesture recognition module 420, an intention determination module 430, a first control module 440 and a second control module 450.

[0056] Among them, the image acquisition module 410 is configured to acquire at least one target area image inside and outside the door of the vehicle to be controlled; the gesture recognition module 420 is configured to perform gesture recognition on the user in the at least one target area image, determine the user gesture information and the door handle associated with the user gesture information; the intention determination module 430 is configured to determine the user intention based on the user gesture information and the door handle associated with the user gesture information, and the user intention includes opening or closing at least one door; the first control module 440 is configured to control the door handle on the door to be in a pop-up state to open the door if the user intends to open at least one door; the second control module 450 is configured to control the door handle on the door to be in a retracted state to close the door if the user intends to close at least one door.

[0057] It should be noted that the door handle control device provided in the above embodiment and the door handle control method provided in the above embodiment are based on the same concept. The specific manner in which the various modules and units perform their operations has been described in detail in the method embodiments and will not be repeated here. In actual applications, the door handle control device provided in the above embodiment can, as needed, allocate the above functions to different functional modules, i.e., divide the internal structure of the device into different functional modules to perform all or part of the functions described above. This is not a limitation herein.

[0058] Figure 5 It is a block diagram of a door handle control system shown in an exemplary embodiment of the present application.

[0059] The embodiment of the present invention further provides a door handle control system 500, comprising: an image acquisition module 510, an image recognition module 520, a vehicle control module 530, a vehicle lock control module 540, a door handle control module 550 and a door handle driving module 560;

[0060] Among them, the image acquisition module 510 is configured to obtain at least one target area image inside and outside the door of the vehicle to be controlled and send it to the image recognition module 520; the vehicle lock control module 540 is configured to obtain the current vehicle locking state and send it to the vehicle control module 530; the image recognition module 520 is configured to perform gesture recognition on the user in the received target area image, determine the user gesture information and the door handle associated with the user gesture information, determine the user intention based on the user gesture information and the door handle associated with the user gesture information, and send the user intention to the vehicle control module 530; the vehicle control module 530 is configured to generate a control user gesture according to the received user intention and the current vehicle locking state. The control signal of the door handle associated with the user gesture information is received, and the control signal is sent to the door handle control module 550; the door handle control module 550 is configured to control the door handle driving module 560 corresponding to the door handle associated with the user gesture information according to the received control signal to control the current state of the door handle associated with the user gesture information; the door handle driving module 560 is configured to control the door handle associated with the user gesture information to be in a retracted state or a pop-up state, and feed back the current state of the door handle associated with the user gesture information to the door handle control module 550; the door handle control module 550 is also configured to feed back the current state of the door handle associated with the received user gesture information to the vehicle control module 530.

[0061] It should be noted that the door handle control system provided in the above embodiment and the door handle control device provided in the above embodiment are of the same concept, wherein the image acquisition module 510 in the door handle control system corresponds to the image acquisition module 410 in the door handle control device, the image recognition module 520 in the door handle control system corresponds to the gesture recognition module 420 and the intention determination module 430 in the door handle control device, and the vehicle control module 530, the vehicle lock control module 540, the door handle control module 550 and the door handle drive module 560 in the door handle control system correspond to the first control module 440 and the second control module 450 in the door handle control device. The specific manner in which the various modules and units of the door handle control system perform operations has been described in detail in the method embodiment and will not be repeated here. In actual applications, the door handle control system provided in the above embodiment can, as needed, allocate the above functions to different functional modules, that is, divide the internal structure of the device into different functional modules to complete all or part of the functions described above, and this is not limited here. The door handle control system provided in this embodiment is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present invention.

[0062] An embodiment of the present invention also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, which, when executed by one or more processors, enables the electronic device to implement the door handle control method provided in the above-mentioned embodiments.

[0063] Figure 6 FIG1 shows a schematic diagram of the structure of a computer system suitable for implementing an electronic device according to an embodiment of the present invention. Figure 6 The computer system 600 of the electronic device shown is only an example and should not limit the functions and scope of use of the embodiments of the present invention.

[0064] like Figure 6 As shown, the computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 602 or the program loaded from the storage part 608 into the random access memory (RAM) 603, such as executing the methods provided in the above-mentioned various embodiments. Various programs and data required for system operation are also stored in the RAM 603. The CPU 601, ROM 602 and RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0065] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, a mouse, and the like; an output section 607 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 608 including a hard disk; and a communication section 609 including a network interface card such as a LAN (Local Area Network) card or a modem. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. Removable media 611, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 610 as needed, so that computer programs read from the removable media can be installed in the storage section 608 as needed.

[0066] In particular, according to an embodiment of the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present invention includes a computer program product that includes a computer program carried on a computer-readable medium, the computer program including a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 609 and / or installed from a removable medium 611. When the computer program is executed by the central processing unit (CPU) 601, the various functions defined in the system of the present invention are performed.

[0067] It should be noted that the computer-readable medium shown in the embodiments of the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. The computer-readable storage medium may, for example, be an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable computer program. Such a propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0068] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram can represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the boxes can also occur in an order different from that marked in the accompanying drawings. For example, two boxes shown in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or can be implemented using a combination of dedicated hardware and computer instructions.

[0069] The units involved in the embodiments of the present invention may be implemented in software or hardware, and the units described may also be provided in a processor. In some cases, the names of these units do not limit the units themselves.

[0070] Another aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon. When executed by a computer processor, the computer program causes the computer to perform the door handle control methods provided in the above-described embodiments. The computer-readable storage medium may be included in the electronic device described in the above-described embodiments, or may exist independently and not be incorporated into the electronic device.

[0071] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the application, the features and functions of two or more modules or units described above can be concretized in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.

[0072] Another aspect of the present application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the door handle control method provided in each of the above embodiments.

[0073] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the embodiments of the present application.

[0074] Those skilled in the art will readily conceive of other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of this application and include common knowledge or customary techniques in the art that are not disclosed herein.

[0075] The above embodiments are merely illustrative of the principles and effects of the present invention and are not intended to limit the present invention. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, any equivalent modifications or alterations made by one of ordinary skill in the art without departing from the spirit and technical principles disclosed herein are intended to be covered by the claims of the present invention.

Claims

1. A door handle control method, characterized in that: include: Acquire an image of at least one target area inside and outside a door of a vehicle to be controlled; Performing gesture recognition on a user within at least one of the target area images to determine user gesture information and a door handle associated with the user gesture information, wherein the user gesture information includes a user gesture action and a current relative distance; determining a user intention based on the door handle associated with the user gesture information, wherein the user intention includes opening or closing at least one vehicle door; If the user intends to open at least one vehicle door, controlling the door handle on the vehicle door to be in a pop-up state to open the vehicle door; If the user intends to close at least one vehicle door, controlling the door handle on the vehicle door to be retracted to close the vehicle door; Wherein, determining the user intention based on the door handle associated with the user gesture information, wherein the user intention includes opening or closing at least one vehicle door, includes: If the user gesture is recognized as the first preset gesture and the current relative distance at the second moment is less than the current relative distance at the first moment, it is determined that the user intends to open the door associated with the user gesture information, and the second moment is greater than the first moment; If a second preset gesture is recognized within the first preset time, it is determined that the user intends to close the door associated with the user gesture information, and the second preset gesture is different from the first preset gesture.

2. The door handle control method according to claim 1, characterized in that: Performing gesture recognition on a user within at least one of the target area images to determine user gesture information and a door handle associated with the user gesture information includes: If it is detected that the distance between the user and the vehicle to be controlled in the target area image is less than or equal to a first preset distance, it is determined that the user is within the preset area; Performing gesture recognition on a user within at least one of the target area images to determine user gesture information; Identify the user's current position within the target area image, determine the relationship between the user's current position and the preset area, and obtain the area to which the user belongs to determine the door handle associated with the user gesture information.

3. The door handle control method according to claim 1, characterized in that: After determining the user intention based on the user gesture information and the door handle associated with the user gesture information, the method further includes: If the user intends to close the vehicle door associated with the user gesture information and the current vehicle lock state is locked, keep the door handle associated with the user gesture information in a retracted state; If the user intends to close the vehicle door associated with the user gesture information and the current vehicle locking state is unlocked, a first control signal is generated according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a retracted state.

4. The door handle control method according to claim 3, characterized in that: If the user intends to close the vehicle door associated with the user gesture information and the current vehicle lock state is unlocked, a first control signal is generated according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a retracted state, including: If the user intends to close the vehicle door associated with the user gesture information, the current vehicle lock state is unlocked, and the current state of the door handle associated with the user gesture information is retracted, generating a first control signal for maintaining the door handle associated with the user gesture information, thereby maintaining the door handle associated with the user gesture information in the retracted state; If the user intends to close the vehicle door associated with the user gesture information, the current vehicle lock state is the unlocked state, and the current state of the door handle associated with the user gesture information is the pop-up state, then a first control signal is generated to retract the door handle associated with the user gesture information, and the door handle associated with the user gesture information is controlled to be in the retracted state.

5. The door handle control method according to claim 1, characterized in that: After determining the user intention based on the user gesture information and the door handle associated with the user gesture information, the method further includes: If the user intends to open the vehicle door associated with the user gesture information and the current vehicle lock state is locked, keep the door handle associated with the user gesture information in a retracted state; If the user intends to open the vehicle door associated with the user gesture information and the current vehicle lock state is unlocked, a second control signal is generated according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a pop-up state.

6. The door handle control method according to claim 5, characterized in that: If the user intends to open the vehicle door associated with the user gesture information and the current vehicle lock state is unlocked, a second control signal is generated according to the current state of the door handle associated with the user gesture information to control the door handle associated with the user gesture information to be in a pop-up state, including: If the user intends to open the vehicle door associated with the user gesture information, the current vehicle lock state is unlocked, and the current state of the door handle associated with the user gesture information is retracted, generating a second control signal for popping out the door handle associated with the user gesture information, and controlling the door handle associated with the user gesture information to be in the popped-out state; If the user intends to open the vehicle door associated with the user gesture information, the current vehicle lock state is unlocked, and the current state of the door handle associated with the user gesture information is a pop-up state, a second control signal is generated to keep the door handle associated with the user gesture information in the pop-up state.

7. A door handle control device, characterized in that: include: An image acquisition module, configured to acquire an image of at least one target area inside or outside a door of a vehicle to be controlled; a gesture recognition module, configured to recognize a user's gesture within at least one of the target area images, and determine user gesture information and a door handle associated with the user gesture information, wherein the user gesture information includes the user gesture action and a current relative distance; an intention determination module, configured to determine a user intention based on the user gesture information and the door handle associated with the user gesture information, wherein the user intention includes opening or closing at least one vehicle door; Specifically, if the user gesture is recognized as a first preset gesture and the current relative distance at the second moment is less than the current relative distance at the first moment, determining that the user intends to open the vehicle door associated with the user gesture information, and the second moment is greater than the first moment; If a second preset gesture is recognized within the first preset time, it is determined that the user intends to close the door associated with the user gesture information, and the second preset gesture is different from the first preset gesture; a first control module, configured to control a door handle on at least one door to be in a pop-up state to open the door if the user intends to open the door; The second control module is configured to control a door handle on at least one vehicle door to be retracted so as to close the vehicle door if the user intends to close the at least one vehicle door.

8. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the door handle control method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the door handle control method according to any one of claims 1 to 6.

Images