Gesture vehicle control method and system and vehicle

Abstract

The invention relates to the technical field of vehicle control, in particular to a gesture vehicle control method and system and a vehicle. The method comprises the steps that after a gesture vehicle control mode is in a control state, a first gesture of a user in a preset vehicle exterior area is obtained; the first gesture is recognized, and when it is recognized that the first gesture is a preset vehicle control gesture, the area where the first gesture is located is positioned; the area where the first gesture is located is matched in a preset corresponding relation, a target area is obtained, and the vehicle is controlled to execute a preset command corresponding to the target area; wherein the preset corresponding relation comprises a corresponding relation between a plurality of preset areas and a plurality of preset commands; the target area is a preset area consistent with the area where the first gesture is located. By adopting the method, the success rate of gesture vehicle control and the vehicle use experience of the user can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of vehicle control, and particularly to a gesture-controlled vehicle method, system, and vehicle. Background Art

[0002] Gesture-controlled vehicle technology is an innovative technology that allows users to control a vehicle outside the vehicle through gestures. The development of this technology not only enhances the user experience but also brings new possibilities to the automotive industry and is becoming one of the important components of future intelligent vehicles.

[0003] The principle of gesture-controlled vehicle in related technologies is as follows: capture the user's gestures through high-precision camera devices or sensors, analyze the captured gestures using gesture recognition algorithms, and determine whether the user's gestures are consistent with preset specific gestures. If they are consistent, control the vehicle to execute the control commands corresponding to the specific gestures.

[0004] However, in related technologies, different specific gestures are set for different control commands, and users need time to adapt to the new interaction method and remember each specific gesture and its corresponding command. When users do not accurately remember each specific gesture and its corresponding command and the gestures made during vehicle control are not standardized enough, it will lead to a decrease in the success rate of gesture-controlled vehicle, thereby reducing the user's vehicle usage experience. Summary of the Invention

[0005] Based on this, it is necessary to provide a gesture-controlled vehicle method, system, and vehicle for the above technical problems to improve the success rate of gesture-controlled vehicle and the user's vehicle usage experience.

[0006] In a first aspect, a gesture-controlled vehicle method is provided, and the method includes:

[0007] After the gesture-controlled vehicle mode is in a control state, obtain the first gesture of the user in a preset out-of-vehicle area;

[0008] Recognize the first gesture, and when the first gesture is recognized as a preset vehicle control gesture, locate the area where the first gesture is located;

[0009] Match the area where the first gesture is located in a preset corresponding relationship to obtain a target area, and control the vehicle to execute a preset command corresponding to the target area; wherein, the preset corresponding relationship includes the corresponding relationship between multiple preset areas and multiple preset commands; the target area is a preset area that is consistent with the area where the first gesture is located.

[0010] In combination with the first aspect, in the first implementable manner of the first aspect, the multiple preset regions at least include the upper body region, lower body region, left region, and right region of the user; the multiple preset commands at least include moving forward at a preset vehicle speed, moving backward at a preset vehicle speed, turning left at a preset steering speed, and turning right at a preset steering speed.

[0011] In combination with the first implementable manner of the first aspect, in the second implementable manner of the first aspect, the preset corresponding relationships at least include: the corresponding relationship between the upper body region and moving forward at a preset vehicle speed, the corresponding relationship between the lower body region and moving backward at a preset vehicle speed, the corresponding relationship between the left region and turning left at a preset steering speed, and the corresponding relationship between the right region and turning right at a preset steering speed.

[0012] In combination with the second implementable manner of the first aspect, in the third implementable manner of the first aspect, controlling the vehicle to execute the preset command corresponding to the target region includes:

[0013] When the target region is the upper body region, controlling the vehicle to move forward at the preset vehicle speed;

[0014] When the target region is the lower body region, controlling the vehicle to move backward at the preset vehicle speed;

[0015] When the target region is the left region, controlling the vehicle to turn left at the preset steering speed;

[0016] When the target region is the right region, controlling the vehicle to turn right at the preset steering speed.

[0017] In combination with the first aspect, in the fourth implementable manner of the first aspect, before the gesture control vehicle mode is in the control state, the method further includes:

[0018] After the gesture control vehicle mode is in the ready state, obtaining a second gesture of the user within a preset out-of-vehicle region;

[0019] Identifying the second gesture;

[0020] When it is identified that the second gesture is a preset handshake gesture, controlling the gesture control vehicle mode to be in the control state and locking the user who makes the second gesture, where the first gesture is made by the locked user;

[0021] Or,

[0022] When it is recognized that the second gesture is a preset handshake gesture and it is monitored that one hand of the user always maintains the second gesture, control the gesture vehicle control mode to be in a control state and lock the user who makes the second gesture, where the first gesture is made by the other hand of the locked user.

[0023] Combined with the fourth implementable manner of the first aspect, in the fifth implementable manner of the first aspect, before the gesture vehicle control mode is in a ready state, the method further includes:

[0024] When the vehicle is in an unlocked state, detect whether there is a user in the driver's seat of the vehicle;

[0025] If there is no user in the driver's seat, detect whether a knocking operation is received at a preset vehicle body position of the vehicle;

[0026] If a knocking operation is received, count the number and / or frequency of the knocking operations;

[0027] If the number of the knocking operations reaches a preset number and / or the frequency of the knocking operations reaches a preset frequency, control the gesture vehicle control mode to be in a ready state.

[0028] Combined with the fifth implementable manner of the first aspect, in the sixth implementable manner of the first aspect, after controlling the gesture vehicle control mode to be in a ready state, the method further includes:

[0029] Control the vehicle lights to flash at a preset first frequency and first duration to prompt the user that the gesture vehicle control mode is in a ready state;

[0030] Use the moment when the gesture vehicle control mode is in a ready state as the start time of timing. Start timing. When the timing duration exceeds a preset duration, if the second gesture is not obtained, control the gesture vehicle control mode to exit the ready state;

[0031] After controlling the gesture vehicle control mode to be in a control state, the method further includes:

[0032] Control the vehicle lights to flash at a preset second frequency and second duration to prompt the user that the gesture vehicle control mode is in a control state.

[0033] Combined with the first aspect, in the seventh implementable manner of the first aspect, during the process of controlling the vehicle to execute a preset command corresponding to the target area, the method further includes:

[0034] Detect the environment within a preset range of the vehicle;

[0035] If an obstacle is detected within a preset range of the vehicle and the distance between the obstacle and the vehicle is less than a preset distance, the vehicle is controlled to perform a braking operation.

[0036] In a second aspect, a gesture control vehicle system is provided, and the system includes:

[0037] An acquisition module, configured to acquire a first gesture of a user within a preset external vehicle area after the gesture control vehicle mode is in a control state;

[0038] A processing module, configured to recognize the first gesture, and when the first gesture is recognized as a preset vehicle control gesture, locate the area where the first gesture is located;

[0039] A control module, configured to match the area where the first gesture is located in a preset corresponding relationship to obtain a target area, and control the vehicle to execute a preset command corresponding to the target area; wherein, the preset corresponding relationship includes a corresponding relationship between multiple preset areas and multiple preset commands; the target area is a preset area that is the same as the area where the first gesture is located.

[0040] In a third aspect, a vehicle is provided, and the vehicle includes the gesture control vehicle system described in the second aspect.

[0041] For the above gesture control vehicle method, system and vehicle, after the gesture control vehicle mode is in a control state, a first gesture of a user within a preset external vehicle area is acquired; the first gesture is recognized, and when the first gesture is recognized as a preset vehicle control gesture, the area where the first gesture is located is located; the area where the first gesture is located is matched in a preset corresponding relationship to obtain a target area, and the vehicle is controlled to execute a preset command corresponding to the target area; wherein, the preset corresponding relationship includes a corresponding relationship between multiple preset areas and multiple preset commands; the target area is a preset area that is the same as the area where the first gesture is located. By using the gesture control vehicle method of the present application, the same gesture is used for different vehicle control commands, and different vehicle control commands are distinguished by the area where the user's gesture is located. Compared with the related art, the present application does not need to set a corresponding gesture for each vehicle control command, and the user does not need to accurately remember multiple gestures and their corresponding commands, thereby reducing the adaptation difficulty of the new interaction method, improving the problem that the success rate of gesture control vehicle is reduced due to the non-standard gestures made by the user during vehicle control, and improving the user's vehicle use experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 It is a schematic flowchart of a gesture control vehicle method in an embodiment;

[0043] Figure 2 It is a structural block diagram of a gesture control vehicle system in an embodiment;

[0044] Figure 3 It is a structural block diagram of a gesture-controlled vehicle system in an embodiment;

[0045] Figure 4 It is a structural block diagram of a gesture-controlled vehicle system in an embodiment;

[0046] Figure 5 It is an internal structure diagram of a computer device in an embodiment. Specific implementation manners

[0047] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0048] It should be noted that the diagrams provided in this embodiment only illustrate the basic concept of the present application in a schematic manner. Therefore, only the components related to the present application are shown in the diagrams, rather than being drawn according to the number, shape and size of the components in actual implementation. The types, quantities and proportions of the components in actual implementation may be arbitrarily changed, and the component layout type may also be more complex.

[0049] The structures, proportions, sizes, etc. shown in the drawings of this specification are only used to cooperate with the content disclosed in the specification for those skilled in this technology to understand and read, and are not used to limit the limiting conditions under which the present application can be implemented. Therefore, they do not have technical substance significance. Any modification of the structure, change of the proportional relationship or adjustment of the size should still fall within the scope that can be covered by the technical content disclosed in the present application without affecting the effects that the present application can produce and the objectives that can be achieved.

[0050] The orientation or positional relationship indicated by terms such as "upper", "lower", "left", "right", "middle", "longitudinal", "transverse", "horizontal", "inner", "outer", "radial", "circumferential", etc. cited in this specification is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of simplifying the description, rather than indicating or implying that the system or component referred to must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation to the present application. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance.

[0051] Currently, the principle of a vehicle to achieve the gesture-controlled vehicle function is generally as follows: capturing the user's gestures through a high-precision camera device or sensor, analyzing the captured gestures using a gesture recognition algorithm, comparing them with each gesture in a preset gesture set. When the captured gesture is consistent with a certain preset gesture in the gesture set, the gesture is converted into a corresponding control command, and the vehicle is controlled to execute the corresponding control command.

[0052] However, since different gestures are set for different control commands, it requires users to spend more time adapting to the gestures required for different control commands and accurately remember each gesture and its corresponding control command. This not only increases the difficulty of adapting to the new interaction method and brings a certain burden to users, but also when users do not accurately remember each gesture and its corresponding control command and the gestures made during vehicle control are not standardized enough, it will lead to a decrease in the success rate of gesture-based vehicle control and reduce the user's driving experience.

[0053] For this reason, this application proposes a gesture-based vehicle control method. After the gesture-based vehicle control mode is in the control state, the first gesture of the user in the preset out-of-vehicle area is obtained; the first gesture is recognized, and when the first gesture is recognized as a preset vehicle control gesture, the area where the first gesture is located is located; the area where the first gesture is located is matched in the preset correspondence relationship to obtain a preset area that is consistent with the area where the first gesture is located, and it is used as the target area, and the vehicle is controlled to execute the preset command corresponding to the target area. The preset correspondence relationship includes the correspondence relationship between multiple preset areas and multiple preset commands.

[0054] It can be seen that this application uses the same preset vehicle control gesture for different preset commands, but distinguishes different preset commands by locating the area where the user's gesture is located. Compared with the related technology that uses different preset vehicle control gestures for different preset commands, users do not need to accurately remember multiple gestures and their corresponding commands, reducing the difficulty of adapting to the new interaction method, reducing the burden on users, and being able to improve the problem that the success rate of gesture-based vehicle control is reduced because users do not accurately remember each gesture and its corresponding command and the gestures made are not standardized enough, and improving the user's driving experience.

[0055] Next, the present application will be described in detail through the following embodiments.

[0056] In one embodiment, as Figure 1 shown, a gesture-based vehicle control method is provided. Taking the application of this method to the vehicle controller as an example, it includes the following steps:

[0057] Step 202, after the gesture-based vehicle control mode is in the control state, obtain the first gesture of the user in the preset out-of-vehicle area;

[0058] Step 204, recognize the first gesture, and when the first gesture is recognized as a preset vehicle control gesture, locate the area where the first gesture is located;

[0059] Step 206: Match the area where the first gesture is located in the preset correspondence relationship to obtain a target area, and control the vehicle to execute a preset command corresponding to the target area; wherein, the preset correspondence relationship includes the correspondence relationship between multiple preset areas and multiple preset commands; the target area is a preset area that is the same as the area where the first gesture is located.

[0060] Among them, the gesture control vehicle mode refers to a mode in which the user can control the vehicle to execute corresponding commands through gestures; the gesture control vehicle mode being in a control state means that the gesture control vehicle mode is started and is in a state that allows the user to control the vehicle to execute commands corresponding to the gesture through specific gestures. For example, the user can make specific gestures to make the vehicle controller control the vehicle to move forward, backward, turn left or turn right, etc.

[0061] In some embodiments, the starting methods of the gesture control vehicle mode include: the user clicks the start button in the gesture control vehicle setting interface on the central control screen to start the gesture control vehicle mode; the user starts the gesture control vehicle mode by saying a specific voice command, such as "turn on the gesture control vehicle mode"; dedicated buttons or joysticks can also be set on the steering wheel for the user to quickly switch to the gesture control vehicle mode; the user starts the gesture control vehicle mode through an application program paired with the vehicle; the user automatically starts the gesture control vehicle mode by making a specific action, such as knocking on the vehicle body.

[0062] In some embodiments, the preset out-of-vehicle area can be a spherical area centered on the vehicle and radiating outward with a preset radius, or an area within a preset distance of the vehicle, such as an area within 5 meters of the vehicle, or an area that can be detected by a high-precision camera device or sensor configured on the vehicle, etc.

[0063] In some embodiments, the vehicle can detect and track the user within the preset out-of-vehicle area by configuring a high-precision camera or sensor (such as a millimeter-wave radar), and the vehicle controller communicates with the high-precision camera or sensor to obtain the first gesture of the user within the preset out-of-vehicle area.

[0064] In some embodiments, the vehicle controller uses a machine learning algorithm or a deep learning model to extract the features of the first gesture, including features such as the position, direction, speed of the fingers and the overall shape of the hand, and compares the extracted features with the preset vehicle control gestures to determine whether the first gesture is a preset vehicle control gesture. Among them, the preset vehicle control gesture can be the default gesture set when the vehicle leaves the factory, or can be customized by the user on the gesture control vehicle setting interface of the central control screen or the application program paired with the vehicle, such as waving.

[0065] Since the preset correspondence is pre-stored in the vehicle controller, the preset correspondence defines multiple preset regions, and each region is associated with a corresponding preset command for controlling the vehicle. Therefore, when it is recognized that the first gesture is a preset vehicle control gesture, it is necessary to determine the region where the first gesture is located, and then match the region where the first gesture is located in the preset correspondence to obtain a preset region that is consistent with the region where the first gesture is located, and use it as the target region, and then control the vehicle to execute the preset command corresponding to the target region.

[0066] Among them, the correspondence between the multiple preset regions and the multiple preset commands can be the default correspondence set when the vehicle leaves the factory, or can be customized by the user on the gesture vehicle control setting interface of the central control screen or the application program paired with the vehicle according to their own preferences and memory habits.

[0067] In summary, for different preset commands, the present application uses the same preset vehicle control gesture. By defining multiple preset regions of interest, each preset region is associated with a corresponding preset command. When controlling the vehicle, the region where the user's gesture is located is located, and the corresponding preset command is determined according to the region where the user's gesture is located, and the vehicle is controlled to execute the preset command, so as to realize the control of the vehicle through gestures. Compared with the prior art, the present application does not require the user to accurately remember multiple gestures and their corresponding commands, reduces the adaptation difficulty of the gesture vehicle control mode, reduces the user's memory burden, and can improve the problem that the user does not accurately remember multiple gestures and their corresponding commands, and the made gestures are not standardized enough, resulting in a reduction in the success rate of gesture vehicle control, and improves the user's vehicle use experience.

[0068] In one embodiment, the multiple preset regions at least include the upper body region, the lower body region, the left region and the right region of the user; the multiple preset commands at least include moving forward at a preset vehicle speed, moving backward at a preset vehicle speed, turning left at a preset steering speed and turning right at a preset steering speed. Among them, with the user's face facing forward as the forward direction, the upper body region represents the region corresponding to the projection of the user's upper body in the horizontal forward direction, and the lower body region represents the region corresponding to the projection of the user's lower body in the horizontal forward direction; with the user's face facing as the reference direction, the left region represents the region located on the left side of the user's body, and the right region represents the region located on the right side of the user's body.

[0069] In some embodiments, the correspondence between the upper body region, the lower body region, the left region and the right region and moving forward at a preset vehicle speed, moving backward at a preset vehicle speed, turning left at a preset steering speed and turning right at a preset steering speed can be the default correspondence set when the vehicle leaves the factory, or can be customized by the user on the gesture vehicle control setting interface of the central control screen or the application program paired with the vehicle according to their own preferences and memory habits. The present application does not make specific limitations on this.

[0070] In one example, the preset correspondence relationship at least includes: the correspondence relationship between the upper body area and moving forward at a preset vehicle speed, the correspondence relationship between the lower body area and moving backward at a preset vehicle speed, the correspondence relationship between the left side area and turning left at a preset steering speed, and the correspondence relationship between the right side area and turning right at a preset steering speed. In an actual gesture-controlled vehicle scenario, when it is detected that the user makes a preset vehicle control gesture in the upper body area of the user himself / herself, that is, the target area is the upper body area, the vehicle is controlled to move forward at a preset vehicle speed; when it is detected that the user makes a preset vehicle control gesture in the lower body area of the user himself / herself, that is, the target area is the lower body area, the vehicle is controlled to move backward at a preset vehicle speed; when it is detected that the user makes a preset vehicle control gesture in the left side area of the user himself / herself, that is, the target area is the left side area, the vehicle is controlled to turn left at a preset steering speed; when it is detected that the user makes a preset vehicle control gesture in the right side area of the user himself / herself, that is, the target area is the right side area, the vehicle is controlled to turn right at a preset steering speed.

[0071] In other examples, the preset correspondence relationship may also include: the correspondence relationship between the upper body area and turning left at a preset steering speed, the correspondence relationship between the lower body area and turning right at a preset steering speed, the correspondence relationship between the left side area and moving forward at a preset vehicle speed, and the correspondence relationship between the right side area and moving backward at a preset vehicle speed. In an actual gesture-controlled vehicle scenario, when it is detected that the user makes a preset vehicle control gesture in the upper body area of the user himself / herself, that is, the target area is the upper body area, the vehicle is controlled to turn left at a preset steering speed; when it is detected that the user makes a preset vehicle control gesture in the lower body area of the user himself / herself, that is, the target area is the lower body area, the vehicle is controlled to turn right at a preset steering speed; when it is detected that the user makes a preset vehicle control gesture in the left side area of the user himself / herself, that is, the target area is the left side area, the vehicle is controlled to move forward at a preset vehicle speed; when it is detected that the user makes a preset vehicle control gesture in the right side area of the user himself / herself, that is, the target area is the right side area, the vehicle is controlled to move backward at a preset vehicle speed.

[0072] During the process of the vehicle executing the preset command corresponding to the target area, if the user continuously makes the preset vehicle control gesture, the preset command corresponding to the target area is continuously executed. If the user stops making the preset vehicle control gesture, the execution of the preset command corresponding to the target area is stopped. For example, assuming that the preset vehicle control gesture is waving, when the user continuously waves in a certain area, the vehicle is controlled to continuously execute the preset command corresponding to that area. When the user stops waving, the vehicle is controlled to stop executing the preset command corresponding to that area.

[0073] In one embodiment, before step 202, the method further includes: after the gesture-controlled vehicle mode is in a ready state, obtaining a second gesture of a user within a preset external vehicle area; recognizing the second gesture; when the recognized second gesture is a preset handshake gesture, controlling the gesture-controlled vehicle mode to be in a control state and locking the user who makes the second gesture, where the first gesture is made by the locked user.

[0074] Among them, the gesture-controlled vehicle mode being in a ready state means that the gesture-controlled vehicle mode is started and is in a state of being ready to receive the user's gesture commands but has not executed any specific commands. At this time, the vehicle's high-precision camera device or sensor is monitoring the user's hand movements, but these movements have not triggered specific vehicle functions yet. This state can be understood as the "standby" state after the gesture-controlled vehicle mode is started. Once a preset gesture is recognized, it will respond quickly. The preset handshake gesture can be the default handshake gesture set when the vehicle leaves the factory, or can be customized by the user according to their own preferences.

[0075] In this embodiment, after the gesture-controlled vehicle mode is started, the user triggers the gesture-controlled vehicle mode to enter the control state by making a preset handshake gesture, so that the user can then control the vehicle to execute corresponding commands by making a preset vehicle control gesture. During the process of triggering the gesture-controlled vehicle mode to enter the control state, after the user makes the preset handshake gesture, they only need to hold it for a short period of time until the gesture-controlled vehicle mode enters the control state, and there is no need to keep the preset handshake gesture all the time, thus reducing user operations and improving the user experience; the fact that the user makes the preset handshake gesture indicates a high possibility that the user intends to control the vehicle by gesture. Therefore, after recognizing that the user makes the preset handshake gesture, the user who makes the second gesture is locked, so as to monitor the user's gestures subsequently and implement the gesture-controlled vehicle function. It should be noted that the first gesture and the second gesture come from the same user, but can come from different hands of the same user.

[0076] It should be understood that by setting a ready state and a control state for the gesture-controlled vehicle mode in this application, only when the user first makes a preset handshake gesture and then makes a preset vehicle control gesture, will the system execute corresponding preset commands according to the area where the preset vehicle control gesture is located, which can improve the phenomenon that the vehicle is accidentally triggered to execute corresponding commands due to the user unconsciously making a preset vehicle control gesture, reduce the misoperation rate, and enhance the safety of vehicle control.

[0077] In another embodiment, before step 202, the method further includes: after the gesture control vehicle mode is in a ready state, obtaining a second gesture of a user within a preset external vehicle area; recognizing the second gesture; when the second gesture is a preset handshake gesture and it is monitored that one hand of the user always maintains the second gesture, controlling the gesture control vehicle mode to be in a control state and locking the user who makes the second gesture, wherein the first gesture is made by the other hand of the locked user.

[0078] In this embodiment, after the gesture control vehicle mode is started, if it is recognized that the second gesture of a user within the preset external vehicle area is a preset handshake gesture, then it is monitored in real time whether the user always maintains the second gesture. If it is monitored that one hand of the user always maintains the second gesture, then the gesture control vehicle mode is triggered to enter the control state; the user who makes the second gesture is locked, so as to monitor the gesture of the user subsequently and implement the gesture control vehicle function.

[0079] Different from the previous embodiment, in this embodiment, after one hand of the user triggers the gesture control vehicle mode to enter the control state by making a preset handshake gesture, it is necessary to always maintain the preset handshake gesture without moving. On this premise, the other hand of the user makes a preset vehicle control gesture to control the vehicle to execute corresponding commands. In this way, it is possible to further improve the phenomenon that the gesture control vehicle function is accidentally triggered due to the user unconsciously making a preset handshake gesture and a preset vehicle control gesture, further reduce the misoperation rate, and enhance the safety of vehicle control.

[0080] In one embodiment, the gesture control vehicle mode is started through the following steps: when the vehicle is in an unlocked state, detecting whether there is a user in the driver's seat of the vehicle; if there is no user in the driver's seat, detecting whether a knocking operation is received at a preset vehicle body position; if a knocking operation is received, counting the number and / or frequency of the knocking operations; if the number of knocking operations reaches a preset number and / or the frequency of the knocking operations reaches a preset frequency, starting the gesture control vehicle mode, that is, controlling the gesture control vehicle mode to be in a ready state. Wherein, the preset vehicle body position can be a default vehicle body position set when the vehicle leaves the factory, such as the front of the vehicle, the rear of the vehicle or the door, etc.; the preset number and the preset frequency can be default values set when the vehicle leaves the factory, or can be customized by the user according to their own preferences and habits.

[0081] In this embodiment, when the vehicle is unlocked, image acquisition and image recognition are performed on the driver's seat through in-vehicle monitoring. If it is recognized that the driver is not in the driver's seat, the possibility that the user in the preset out-of-vehicle area needs to control the vehicle is increased. If the user activates the vehicle by knocking on a preset vehicle body position to make it vibrate, the knocking operation initiated by the user can be detected by a sensor, and the number of times and / or frequency thereof are counted. When the number of times and / or frequency reach a preset value, the gesture control mode of the vehicle is started, and at this time, the gesture control mode enters the preparation state. This starting method is simple and easy to operate, and can efficiently determine whether to start the gesture control function of the vehicle.

[0082] In one embodiment, in order to improve the interactivity between the person and the vehicle and remind the user of the vehicle state in real time, after controlling the gesture control mode of the vehicle to be in the preparation state, the method further includes: controlling the vehicle lights to flash at a preset first frequency and for a preset first duration to prompt the user that the gesture control mode of the vehicle is in the preparation state, and subsequently, the gesture control mode can be triggered to enter the control state by making a preset handshake gesture; after controlling the gesture control mode of the vehicle to be in the control state, the method further includes: controlling the vehicle lights to flash at a preset second frequency and for a preset second duration to prompt the user that the gesture control mode of the vehicle is in the control state, and subsequently, the vehicle can be controlled to execute corresponding preset commands by making a preset vehicle control gesture in a corresponding preset area.

[0083] In one embodiment, after controlling the gesture control mode of the vehicle to be in the preparation state, the method further includes: starting timing with the moment when the gesture control mode of the vehicle is in the preparation state as the start time of timing. When the timing duration exceeds a preset duration, if no second gesture is obtained, the gesture control mode of the vehicle is controlled to exit the preparation state. In this embodiment, when the user activates the gesture control mode of the vehicle by knocking on a preset vehicle body position and the gesture control mode enters the preparation state, if the user does not make a preset handshake gesture for a long time, the possibility of accidentally triggering the gesture control mode due to the user unconsciously knocking on the preset vehicle body position is relatively high. At this time, in order to reduce the vehicle energy consumption, the gesture control mode of the vehicle is controlled to exit the preparation state, that is, the gesture control mode is turned off. Among them, the preset duration can be the default duration set when the vehicle leaves the factory, or can be customized by the user according to his own preferences and habits.

[0084] In one embodiment, in order to improve the driving safety of the vehicle during the gesture control process, during the process of controlling the vehicle to execute a preset command corresponding to a target area, the method further includes: detecting the environment within a preset range of the vehicle; if an obstacle is detected within the preset range of the vehicle and the distance between the obstacle and the vehicle is less than a preset distance, the vehicle is controlled to execute a braking operation.

[0085] It should be understood that although Figure 1The steps in the flowchart are shown in sequence according to the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 at least a part of the steps in Figure 1 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0086] In one embodiment, as Figure 2 shown, a gesture-controlled vehicle system is provided, including: an acquisition module, a processing module, and a control module, where:

[0087] The acquisition module is configured to obtain a first gesture of a user in a preset external vehicle area after the gesture-controlled vehicle mode is in a control state;

[0088] The processing module is configured to identify the first gesture, and when the first gesture is identified as a preset vehicle control gesture, locate the area where the first gesture is located;

[0089] The control module is configured to match the area where the first gesture is located in a preset correspondence relationship to obtain a target area, and control the vehicle to execute a preset command corresponding to the target area; where the preset correspondence relationship includes a correspondence relationship between multiple preset areas and multiple preset commands; the target area is a preset area that is the same as the area where the first gesture is located.

[0090] In one embodiment, the multiple preset areas at least include the upper body area, the lower body area, the left area, and the right area of the user; the multiple preset commands at least include moving forward at a preset vehicle speed, moving backward at a preset vehicle speed, turning left at a preset steering speed, and turning right at a preset steering speed.

[0091] In one embodiment, the preset correspondence relationship at least includes: the correspondence relationship between the upper body area and moving forward at a preset vehicle speed, the correspondence relationship between the lower body area and moving backward at a preset vehicle speed, the correspondence relationship between the left area and turning left at a preset steering speed, and the correspondence relationship between the right area and turning right at a preset steering speed.

[0092] In one embodiment, the control module is configured to control the vehicle to execute a preset command corresponding to the target area, specifically including: when the target area is the upper body area, controlling the vehicle to move forward at the preset vehicle speed; when the target area is the lower body area, controlling the vehicle to move backward at the preset vehicle speed; when the target area is the left area, controlling the vehicle to turn left at the preset steering speed; when the target area is the right area, controlling the vehicle to turn right at the preset steering speed.

[0093] In one embodiment, before the gesture control vehicle mode is in the control state, the acquisition module is further configured to, after the gesture control vehicle mode is in the preparation state, acquire a second gesture of a user within a preset out-of-vehicle area; the processing module is further configured to identify the second gesture; when the processing module identifies that the second gesture is a preset handshake gesture, the control module is further configured to control the gesture control vehicle mode to be in the control state and lock the user who makes the second gesture, wherein the first gesture is made by the locked user.

[0094] In one embodiment, before the gesture control vehicle mode is in the control state, the acquisition module is further configured to, after the gesture control vehicle mode is in the preparation state, acquire a second gesture of a user within a preset out-of-vehicle area; the processing module is further configured to identify the second gesture; when the processing module identifies that the second gesture is a preset handshake gesture and detects that one hand of the user always maintains the second gesture, the control module is further configured to control the gesture control vehicle mode to be in the control state and lock the user who makes the second gesture, wherein the first gesture is made by the other hand of the locked user.

[0095] In one embodiment, as Figure 3 shown, the system further includes a detection module. Before the gesture control vehicle mode is in the preparation state, the detection module is configured to, when the vehicle is in the unlocked state, detect whether there is a user in the driver's seat of the vehicle; if there is no user in the driver's seat, detect whether a knocking operation is received at a preset vehicle body position of the vehicle; if the detection module detects that a knocking operation is received, the processing module is further configured to count the number and / or frequency of the knocking operations; the control module is further configured to, if the number of the knocking operations reaches a preset number and / or the frequency of the knocking operations reaches a preset frequency, control the gesture control vehicle mode to be in the preparation state.

[0096] In one embodiment, after controlling the gesture control vehicle mode to be in the preparation state, the control module is further configured to control the vehicle lights to flash at a preset first frequency and for a first duration to prompt the user that the gesture control vehicle mode is in the preparation state; as Figure 4As shown in the figure, the system further includes a timing module, which is configured to: start timing with the moment when the gesture-controlled vehicle mode is in the ready state as the start time of timing, and when the timing duration exceeds a preset duration, if the acquisition module does not acquire the second gesture, the control module is further configured to control the gesture-controlled vehicle mode to exit the ready state; after controlling the gesture-controlled vehicle mode to be in the control state, the control module is further configured to control the vehicle lights to flash at a preset second frequency and second duration to prompt the user that the gesture-controlled vehicle mode is in the control state.

[0097] In one embodiment, during the process of controlling the vehicle to execute a preset command corresponding to the target area, the detection module is further configured to detect the environment within a preset range of the vehicle; if the detection module detects that there is an obstacle within the preset range of the vehicle and the distance between the obstacle and the vehicle is less than a preset distance, the control module is further configured to control the vehicle to execute a braking operation.

[0098] For the specific limitations of the gesture-controlled vehicle system, reference can be made to the limitations of the gesture-controlled vehicle method in the above text, which will not be elaborated here. Each module in the above gesture-controlled vehicle system can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or independent of it, or stored in the memory of the computer device in software form, so as to facilitate the processor to call and execute the operations corresponding to the above modules.

[0099] In one embodiment, a vehicle is provided, which includes the gesture-controlled vehicle system as described in the above embodiment.

[0100] In one embodiment, a computer device is provided. The computer device can be a terminal, and its internal structure diagram can be as Figure 5 shown. The computer device includes a processor, a memory, a network interface, a display screen, and an input system connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer program, when executed by the processor, implements a gesture-controlled vehicle method. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input system of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0101] Those skilled in the art can understand, Figure 5The structure shown is only a block diagram of some of the structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0102] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the gesture-controlled vehicle method described in the above embodiment are implemented.

[0103] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided in this application can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0104] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0105] The above-described embodiments only represent several implementation manners of this application. Their descriptions are relatively specific and detailed, but they should not be construed as limitations on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can still be made, and these all belong to the protection scope of this application. Therefore, the protection scope of this application patent should be subject to the appended claims.

Claims

1. A gesture control method for a vehicle, characterized in that: The method comprises: After the gesture control mode is in the control state, obtaining a first gesture of a user in a preset area outside the vehicle; recognizing the first gesture, and when the first gesture is recognized as a preset vehicle control gesture, locating an area where the first gesture is located; Match the area where the first gesture is located in a preset correspondence relationship to obtain a target area, and control the vehicle to execute a preset command corresponding to the target area; wherein the preset correspondence relationship includes a correspondence between multiple preset areas and multiple preset commands; the target area is a preset area consistent with the area where the first gesture is located.

2. The gesture control method of claim 1, characterized in that: The multiple preset areas include at least the upper body area, lower body area, left area and right area of ​​the user; the multiple preset commands include at least moving forward at a preset vehicle speed, moving backward at a preset vehicle speed, turning left at a preset steering speed and turning right at a preset steering speed.

3. The method for controlling a vehicle by gesture according to claim 2, characterized in that: The preset correspondences include at least: a correspondence between the upper body area and moving forward at a preset vehicle speed, a correspondence between the lower body area and moving backward at a preset vehicle speed, a correspondence between the left side area and turning to the left at a preset steering speed, and a correspondence between the right side area and turning to the right at a preset steering speed.

4. The method for controlling a vehicle by gesture according to claim 3, characterized in that: Controlling the vehicle to execute a preset command corresponding to the target area includes: When the target area is the upper body area, controlling the vehicle to move forward at the preset vehicle speed; When the target area is the lower body area, controlling the vehicle to move backward at the preset vehicle speed; When the target area is the left area, controlling the vehicle to turn left at the preset turning speed; When the target area is the right area, the vehicle is controlled to turn right at the preset turning speed.

5. The gesture control method of claim 1, characterized in that: Before the gesture control mode is in the control state, the method further includes: After the gesture control mode is in a ready state, obtaining a second gesture of a user in a preset area outside the vehicle; recognizing the second gesture; When the second gesture is recognized as a preset handshake gesture, the gesture-controlled vehicle mode is controlled to be in a control state, and the user who makes the second gesture is locked, wherein the first gesture is made by the locked user; or, When the second gesture is identified as a preset handshake gesture and it is monitored that one hand of the user always maintains the second gesture, the gesture control mode is controlled to be in a control state, and the user who makes the second gesture is locked, wherein the first gesture is made by the other hand of the locked user.

6. The gesture control method of claim 5, characterized in that: Before the gesture control mode is in a ready state, the method further includes: When the vehicle is in an unlocked state, detecting whether there is a user in the driving seat of the vehicle; If there is no user at the driving seat, detecting whether a tapping operation is received at a preset body position of the vehicle; If a tapping operation is received, counting the number and / or frequency of the tapping operation; If the number of tapping operations reaches a preset number of times, and / or the frequency of the tapping operations reaches a preset frequency, the gesture control mode is controlled to be in a ready state.

7. The method for controlling a vehicle by gesture according to claim 6, characterized in that: After controlling the gesture control mode to be in a ready state, the method further includes: Controlling the vehicle lights to flash according to a preset first frequency and a first duration to prompt the user that the gesture control vehicle mode is in a ready state; The timing starts with the time when the gesture control mode is in the ready state. When the timing duration exceeds the preset duration, if the second gesture is not obtained, the gesture control mode is controlled to exit the ready state. After controlling the gesture-controlled vehicle mode to be in a control state, the method further includes: The vehicle lights are controlled to flash according to a preset second frequency and a second duration to prompt the user that the gesture-controlled vehicle mode is in a control state.

8. The gesture control method of claim 1, characterized in that: In the process of controlling the vehicle to execute a preset command corresponding to the target area, the method further includes: Detecting an environment within a preset range of the vehicle; If it is detected that there is an obstacle within a preset range of the vehicle, and the distance between the obstacle and the vehicle is less than a preset distance, the vehicle is controlled to perform a braking operation.

9. A gesture control vehicle system, characterized in that: The system comprises: An acquisition module, configured to acquire a first gesture of a user in a preset area outside the vehicle after the gesture control vehicle mode is in a control state; a processing module, configured to identify the first gesture, and when the first gesture is identified as a preset vehicle control gesture, locate an area where the first gesture is located; A control module is used to match the area where the first gesture is located in a preset correspondence relationship, obtain a target area, and control the vehicle to execute a preset command corresponding to the target area; wherein the preset correspondence relationship includes a correspondence between multiple preset areas and multiple preset commands; the target area is a preset area consistent with the area where the first gesture is located.

10. A vehicle, characterized in that: The vehicle includes the gesture-controlled vehicle system as claimed in claim 9.

Images