Vehicle gesture control method, device, electronic device, storage medium and vehicle

By switching to the target interface and starting the gesture operation mode while the vehicle is in motion, recognizing and executing preset gesture operations, the safety hazard of the driver operating the vehicle screen while driving is resolved, and the effect of simplifying operations and reducing safety risks is achieved.

CN115509430BActive Publication Date: 2025-09-23GREAT WALL MOTOR CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202211168277.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-23
Publication Date
2025-09-23
Estimated Expiration
2042-09-23

AI Technical Summary

Technical Problem

While the vehicle is driving, the driver needs to divert his eyes when operating the on-board screen, which poses a safety hazard.

Method used

When the vehicle is in motion, switch to the target interface of the driving state, start the gesture operation mode, receive and recognize the preset gestures through the vehicle screen, and perform the corresponding preset operations.

Benefits of technology

It simplifies the driver's operation, reduces the safety risks caused by diverting the eyesight during driving, and makes the operation more convenient and quick.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115509430B_ABST
    Figure CN115509430B_ABST
Patent Text Reader

Abstract

The present disclosure provides a vehicle gesture control method, device, electronic device, storage medium, and vehicle. The method includes: when confirming that the vehicle is in a driving state, switching the vehicle screen to a target interface of the driving state and starting a gesture operation mode; receiving a first target gesture through the vehicle screen; in response to confirming that the first target gesture belongs to any of a plurality of pre-stored preset gestures, obtaining a preset operation corresponding to the target gesture and executing the preset operation. The rational use of the system can be achieved, and the gesture operation mode corresponding to the driving-specific interface does not require the driver to divert his or her sight to operate the vehicle screen, which can reduce the safety risk of the driver operating the vehicle screen while driving.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle control technology, and in particular to a vehicle gesture control method, device, electronic device, storage medium, and vehicle. Background Art

[0002] When the vehicle is in motion, the driver needs to check the content displayed on the screen before operating the vehicle. For the driver, operating the vehicle screen by diverting his eyesight while driving poses a safety hazard.

[0003] In view of this, how to simplify the driver's operations and reduce safety risks during vehicle driving has become an important research issue. Summary of the Invention

[0004] In view of this, the present disclosure provides a vehicle gesture control method, device, electronic device, storage medium and vehicle, which are used to solve the problem in the prior art that the driver's operation during vehicle driving is complicated and affects the vehicle driving safety.

[0005] Based on the above objectives, a first aspect of the present disclosure provides a gesture control method for a vehicle, comprising:

[0006] When the vehicle is confirmed to be in driving state, switch the vehicle screen to the target interface of driving state and start the gesture operation mode;

[0007] receiving a first target gesture via the vehicle-mounted screen;

[0008] In response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, a preset operation corresponding to the first target gesture is acquired, and the preset operation is executed.

[0009] Based on the same inventive concept, a second aspect of the present disclosure provides a gesture control device for a vehicle, comprising:

[0010] The interface switching module is configured to switch the vehicle screen to the target interface of the driving state and start the gesture operation mode when confirming that the vehicle is in the driving state;

[0011] A first target gesture receiving module is configured to receive a first target gesture through the vehicle-mounted screen;

[0012] The preset operation execution module is configured to, in response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, obtain a preset operation corresponding to the first target gesture and execute the preset operation.

[0013] Based on the same inventive concept, the third aspect of the present disclosure proposes an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, wherein the processor implements the method described above when executing the computer program.

[0014] Based on the same inventive concept, a fourth aspect of the present disclosure proposes a non-transitory computer-readable storage medium, which stores computer instructions for causing a computer to execute the method described above.

[0015] Based on the same inventive concept, the fifth aspect of the present disclosure proposes a vehicle, including the gesture control device for the vehicle described in the second aspect, the electronic device described in the third aspect, or the storage medium described in the fourth aspect.

[0016] From the above description, it can be seen that the present disclosure provides a vehicle gesture control method, device, electronic device, storage medium and vehicle. When confirming that the vehicle is in a driving state, the vehicle screen is switched to the target interface of the driving state and the gesture operation mode is started, so that the rational use of the system can be achieved. The first target gesture is received through the vehicle screen. When the first target gesture belongs to any of a plurality of pre-stored preset gestures, the preset operation corresponding to the first target gesture is obtained and the preset operation is executed. Among them, the pre-stored multiple preset gestures are simple and easy to operate. Compared with the operation through complex gestures such as buttons in the prior art, the driver's operation is more convenient and quick. In this way, during the gesture control process, the driver can operate the vehicle screen without shifting his sight, reducing the safety risk of the driver operating the vehicle screen while driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the present disclosure or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are only embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 is a flow chart of a gesture control method for a vehicle according to an embodiment of the present disclosure;

[0019] Figure 2 A schematic diagram of a method for operating an in-vehicle screen while a vehicle is driving according to an embodiment of the present disclosure;

[0020] Figure 3 Schematic diagram of the structure of a gesture control device for a vehicle according to an embodiment of the present disclosure;

[0021] Figure 4Schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0023] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should have the usual meanings understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the embodiments of the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. "Include" or "comprise" and similar words mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative position relationships. When the absolute position of the described object changes, the relative position relationship may also change accordingly.

[0024] As mentioned above, how to simplify the gestures for controlling the in-vehicle screen while the vehicle is driving and reduce safety risks has become an important research issue.

[0025] While the vehicle is in motion, the driver needs to check the content displayed on the screen before proceeding. For the driver, operating the vehicle screen by diverting their gaze while driving presents a safety hazard. To address the safety issue of distracting the driver when operating the vehicle screen, this embodiment proposes a vehicle gesture control method.

[0026] Based on the above description, if Figure 1 As shown, the vehicle gesture control method proposed in this embodiment includes:

[0027] Step 101: When it is confirmed that the vehicle is in driving state, the vehicle screen is switched to the target interface of the driving state and the gesture operation mode is started.

[0028] In specific implementations, the vehicle's driving status can be determined by obtaining vehicle speed information from a speed sensor and determining whether the vehicle is in a driving state based on the vehicle speed information. Alternatively, the vehicle's driving status can be determined based on the Global Positioning System (GPS) or China's BeiDou Navigation Satellite System (BDS). When the vehicle is in a driving state, the onboard screen switches to the driving state target interface and activates the gesture operation mode. When the vehicle is not in a driving state, the onboard screen removes the driving state target interface and locks the gesture operation mode.

[0029] In this solution, the standard on-board screen interface and gestures are used when the vehicle is not in motion. When the vehicle is in motion, the system switches to the target interface (e.g., a dedicated driving interface) and gesture operation mode. This allows for optimal system utilization, and the gesture operation mode corresponding to the dedicated driving interface eliminates the need for the driver to divert their gaze to operate the vehicle screen, reducing the safety risk of operating the on-board screen while driving.

[0030] In some embodiments, step 101 includes:

[0031] Step 101A: obtaining vehicle speed information through a sensor, and in response to the vehicle speed information being greater than 0, determining that the vehicle is in a driving state.

[0032] In specific implementations, real-time vehicle speed information is acquired through sensors to accurately determine the vehicle's status. The sensors include at least one of the following: a gyroscope, a speed sensor, a temperature sensor, a humidity sensor, a pressure sensor, a wheel speed sensor, a knock sensor, an oxygen sensor, and a crankshaft position sensor.

[0033] or,

[0034] Step 101B: Acquire the engine status of the vehicle, and in response to the engine status being that the engine is started, determine that the vehicle is in a driving state.

[0035] In a specific implementation, sensors are used to obtain operating parameters of the vehicle's engine. The engine operating parameters include at least one of the following: engine status, engine speed, injection control times, and air-fuel ratio. The engine status can be determined based on the engine operating parameters and analyzed and processed. When the engine status indicates engine start, the vehicle is determined to be in a driving state. Determining the engine status based on the engine operating parameters provides a more accurate assessment of the vehicle's status.

[0036] In the above solution, sensors are used to obtain vehicle speed information or engine status, and the vehicle status is determined based on the vehicle speed information or engine status, making the vehicle status determination more accurate and allowing for real-time vehicle status. Only after accurately acquiring the vehicle status in real time can the in-vehicle screen interface be accurately switched. When the vehicle is in motion, the in-vehicle screen can be promptly and accurately switched to the target interface, enabling gesture operation mode and reducing safety hazards during driving.

[0037] In some embodiments, step 101 includes:

[0038] Step 101a: Obtain the vehicle's speed.

[0039] Step 101b: Compare the driving speed with the speed threshold to obtain a speed determination result, wherein the speed threshold is a preset speed value.

[0040] In specific implementations, a speed threshold is pre-set, and the driving speed is compared with the speed threshold to determine the result. For example, the pre-set speed threshold is speed A, and the driving speed is speed a. The two speeds are compared for determination. If speed a is less than speed A, the vehicle is determined to be in a normal driving scenario; if speed a is greater than or equal to speed A, the vehicle is determined to be in a fast driving scenario.

[0041] Step 101c: In response to confirming that the driving speed is greater than or equal to the speed threshold, locking the fourth preset gesture in the gesture operation mode according to a preset priority.

[0042] The priority is set according to the complexity of the gesture.

[0043] During specific implementation, some complex gestures are locked according to the speed of the vehicle. During the gesture locking process, when the vehicle is in a fast-moving operation scenario, complex gestures can be locked first according to the complexity of the gesture. After the complex gestures are locked, the vehicle's speed continues to be obtained in real time. When the vehicle's speed is greater than or equal to the second speed threshold, it is determined that the vehicle is in a high-speed operation scenario, and more complex gestures continue to be locked according to the complexity of the gesture. During the gesture locking process, multiple speed thresholds can be set according to the complexity of the gesture and the specific situation. When the vehicle's speed reaches any speed threshold, the corresponding gesture is locked.

[0044] In the above solution, when the vehicle is in a fast or high-speed driving scenario, the corresponding gestures are locked. As the vehicle's speed increases, only simpler gestures can be recognized. Locking complex gestures can further reduce the safety risks of the driver operating the in-vehicle screen at high speeds.

[0045] Step 102: receiving a first target gesture via the vehicle-mounted screen.

[0046] In a specific implementation, the first target gesture is a gesture used by the driver to operate the vehicle screen to obtain information prompts of application software or operating instructions. For example, the first target gesture can be a circle gesture or a long press gesture. Preferably, the first target gesture is a long press gesture.

[0047] In some embodiments, step 102 further includes:

[0048] Step 102A: Analyze and process the first target gesture to obtain target key nodes in the first target gesture.

[0049] During specific implementation, there are multiple corresponding key nodes in the gesture information, and the target key node in the first target gesture is obtained to make the obtained gesture information more accurate.

[0050] Step 102B: Obtain preset key nodes corresponding to gestures in a pre-stored gesture library, wherein the preset key nodes include preset key nodes for children's gestures and preset key nodes for adult gestures.

[0051] In specific implementations, a gesture library is pre-stored. The library is constructed by collecting a large amount of gesture information, identifying the gesture information through a gesture recognition module, and constructing three-dimensional coordinates for the collected gestures, including horizontal coordinates, vertical coordinates, and relative depth coordinates. Key nodes of the gestures are then determined based on the three-dimensional coordinates of the gestures. The collected gesture information is classified and processed using a neural network. The gestures in the library are divided into child gestures and adult gestures. Correspondingly, the preset key nodes include child gesture preset key nodes and adult gesture preset key nodes.

[0052] Step 102C: performing matching and identification processing on the target key node and the preset key node.

[0053] In specific implementation, the target key node is matched with the preset key node to obtain the matching result through comparison. The matching result is determined based on the key node, making the matching result more accurate.

[0054] Step 102D: In response to confirming that the target key node is consistent with the preset key node of the child gesture, the child lock is activated to lock the gesture operation mode.

[0055] In specific implementations, when the target key node matches the preset key node of the child gesture, that is, when it is determined that the person operating the in-car screen is a child, the gesture operation mode is locked and the child lock is activated. This makes the in-car screen operation safer and avoids safety risks caused by children's accidental touches.

[0056] In the above scheme, matching and recognition are performed by comparing the target key nodes in the first target gesture with the preset key nodes of the corresponding gesture in the gesture library. The key nodes in the gesture are determined by constructing three-dimensional coordinates. This provides more accurate gesture information and can improve the accuracy of matching and recognition. The large amount of gesture information collected is classified and processed through a neural network, improving the accuracy of gesture classification and more accurately determining whether the recognized gesture is an adult gesture or a child gesture. When the received first target gesture is identified as consistent with a child gesture in the gesture library, the child lock is activated, effectively preventing the safety risks caused by children accidentally touching the in-car screen.

[0057] Step 103 : In response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, obtaining a preset operation corresponding to the first target gesture, and executing the preset operation.

[0058] During specific implementation, the preset gesture may be a gesture selected by the user or a gesture customized by the user.

[0059] When users select gestures, a large number of gestures are pre-stored. Users can select multiple preset gestures based on their preferences. Different preset gestures correspond to different preset operations. Users can first select a preset gesture and then determine the corresponding preset operation based on the preset gesture; or they can first select a preset operation and then determine the corresponding preset gesture based on the preset operation.

[0060] When users customize gestures, they can design their own preset gestures and preset actions. Users can first customize a preset gesture and then determine the preset action based on the preset gesture; or they can first customize a preset action and then determine the preset gesture based on the preset action.

[0061] The preset gestures are obtained through user selection or user customization and pre-stored, with each preset gesture corresponding to a preset operation. The target gesture is the gesture used by the driver to operate the in-vehicle screen. When the target gesture matches a pre-stored preset gesture, the corresponding preset operation is executed. The preset operations include at least one of the following: information prompt, opening an application, executing a command, and canceling a command.

[0062] In the above solution, when the first target gesture received by the in-vehicle screen matches a preset gesture, the corresponding preset operation is executed. During the preset gesture setting process, users can select a preset gesture provided by the system or customize a preset gesture. This way, the preset gestures are more diverse and convenient for users to choose. Users can customize preset gestures that are suitable for them and easy to operate.

[0063] In some embodiments, step 103 includes:

[0064] Step 1031 : When it is determined that the first target gesture is a first preset gesture, an information prompt is provided for a preset instruction corresponding to the position of the vehicle screen of the first target gesture according to a preset prompt method.

[0065] In a specific implementation, the preset operation corresponding to the first preset gesture is an information prompt. When the first target gesture matches the pre-stored first preset gesture, the preset operation of the information prompt is executed. The information prompt indicates the screen location information touched by the first target gesture, and the screen location information includes: application software icons and operation instruction icons.

[0066] In specific implementation, the pre-set prompting methods include sound prompts, light strip color change prompts or seat vibration frequency prompts. The sound prompt can be achieved by playing voice or pre-set music. The played voice can use the name of the application software or operation instruction as the prompt voice, or other pre-stored voices as the prompt voice. The pre-set music is to bind the corresponding music to the application software or operation instruction as prompt music. The application software or operation instruction at the screen position touched by the first target gesture is prompted, and the driver determines whether the current application software or operation instruction is the application software to be opened or the operation instruction to be executed based on the sound prompt. The light strip color change prompt is to pre-set different application software or operation instructions to correspond to different in-car light strip colors. When the first target gesture is consistent with the pre-stored first preset gesture, the light strip color switches to the color corresponding to the application software or operation instruction at the screen position touched by the first target gesture. The driver can determine whether the current application software or operation instruction is the application software to be opened or the operation instruction to be executed based on the current light strip color. The seat vibration frequency prompt is similar to the light strip color change prompt process and will not be repeated here.

[0067] In the above solution, when the first target gesture received by the vehicle screen matches the first preset gesture, a prompt is displayed. The driver can promptly receive the prompt information and proceed to the next step based on the prompt information, without having to check the vehicle screen to determine the next step. This can effectively avoid the problem of distracted driving safety during driving. Through sound prompts, light strip color change prompts, or seat vibration frequency prompts, the driver can receive prompt information more conveniently and accurately, and the driver can choose the prompt method that suits him or her.

[0068] Step 1032: Receive, via the in-vehicle screen, a second target gesture made by the user based on the information prompt.

[0069] In a specific implementation, the second target gesture is a gesture used by the driver to execute or cancel a preset instruction after receiving the prompt information. For example, the second target gesture can be a circle-and-release gesture or a circle-and-drag gesture, or a long-press-and-release gesture or a long-press-and-drag gesture. Preferably, the second target gesture is a long-press-and-release gesture or a long-press-and-drag gesture.

[0070] Step 1033 : In response to confirming that the second target gesture is a second preset gesture, executing the preset instruction.

[0071] In a specific implementation, the preset operation corresponding to the second preset gesture is to execute the application software or operation instruction at the screen location touched by the first target gesture. After the driver confirms, based on the prompt information, that the current application software or operation instruction is the application software or operation instruction that the driver wants to open or execute, the driver uses a second target gesture that is the same as the second preset gesture. At this time, upon receiving the second target gesture, the in-vehicle screen executes the corresponding application software or operation instruction.

[0072] Step 1034 : In response to confirming that the second target gesture is the third preset gesture, cancel the preset instruction.

[0073] In a specific implementation, the preset operation corresponding to the third preset gesture is to cancel the application software or operation instruction at the screen location touched by the first target gesture. After the driver confirms based on the information prompt that the current application software or operation instruction is not the application software or operation instruction that they want to open or execute, the driver uses a second target gesture that is the same as the third preset gesture. At this time, after receiving the second target gesture, the in-vehicle screen cancels the corresponding application software or operation instruction.

[0074] In the above scheme, the driver inputs a second target gesture based on the received information prompt. When the second target gesture matches the second preset gesture, the preset instruction is executed; when the second target gesture matches the third preset gesture, the preset instruction is canceled. Thus, after receiving the information prompt regarding the preset instruction, the driver can select the second target gesture to input based on whether or not they wish to execute the preset instruction. To execute the preset instruction, the driver inputs the second target gesture that matches the second preset gesture; to cancel the preset instruction, the driver inputs the second target gesture that matches the third preset gesture. Therefore, in the above process, driver distraction can be reduced.

[0075] In some embodiments,

[0076] The first preset gesture is a long press gesture, wherein the long press gesture is a long press on the screen and the long press time exceeds a preset time threshold.

[0077] The second preset gesture is a long press and release gesture, wherein the long press and release gesture is a long press time exceeding the time threshold and releasing the screen.

[0078] The third preset gesture is a long press and drag gesture, wherein the long press and drag gesture is a long press time exceeding the time threshold and dragging to the edge of the screen.

[0079] In specific implementations, when the driver long-presses the screen using a long-press gesture and the long-press duration exceeds a preset time threshold, the preset operation corresponding to the first preset gesture is triggered, and an information prompt is displayed for the application software icon or operation instruction icon at the long-press location on the screen. The driver determines whether the application software or operation instruction is the application software or operation instruction that the driver wants to execute based on the information prompt, and inputs a second target gesture based on the judgment result. The long-press gesture is maintained before inputting the second target gesture. If the driver wants to execute the current application software or operation instruction, the long-press and release gesture is to release the screen based on the first preset gesture long-press gesture. After the driver inputs the long-press and release gesture, the current application software or operation instruction can be executed. If the driver does not want to execute the current application software or operation instruction, the long-press and drag gesture is to drag the long-press and drag to the edge of the screen or drag off the screen based on the first preset gesture long-press gesture. After the driver inputs the long-press and drag gesture, the current application software or operation instruction can be canceled.

[0080] In the above solution, the first preset gesture, the second preset gesture, and the third preset gesture are specifically a long press gesture, a long press and release gesture, and a long press and drag gesture. As preferred preset gestures, the long press gesture, the long press and release gesture, and the long press and drag gesture are simple and easy to operate, which can further reduce the driver's attention distraction.

[0081] In the above embodiment, when it is confirmed that the vehicle is in a driving state, the vehicle screen is switched to the target interface of the driving state and the gesture operation mode is started, so that the rational use of the system can be achieved. The first target gesture is received through the vehicle screen. When the first target gesture belongs to any of the multiple pre-stored preset gestures, the preset operation corresponding to the first target gesture is obtained and the preset operation is executed. Among them, the multiple pre-stored preset gestures are simple and easy to operate. Compared with the operation through complex gestures such as buttons in the prior art, the driver's operation is more convenient and quick. In this way, during the gesture control process, the driver can operate the vehicle screen without diverting his eyes, reducing the safety risk of the driver operating the vehicle screen while driving.

[0082] It should be noted that the embodiments of the present disclosure may be further described in the following manner:

[0083] like Figure 2 As shown, Figure 2 This is a schematic diagram of how to operate the vehicle screen while the vehicle is driving, including:

[0084] Step 1: Driving status determination

[0085] The system uses sensors to determine whether the vehicle is in motion. When the vehicle is in motion, the onboard screen switches to the target interface and activates gesture operation mode. When the vehicle is not in motion, the onboard screen removes the target interface and locks gesture operation mode. The speed sensor can obtain vehicle speed information to determine whether the vehicle is in motion based on speed information. Alternatively, the system can use GPS or BDS network positioning to determine whether the vehicle is in motion based on the vehicle's location.

[0086] The target interface may display existing application software or operating instructions, or may be customized to display a combination of several icons, texts, or graphics.

[0087] Step 2: Gesture control of the vehicle

[0088] After the vehicle enters the driving state, when the driver inputs a long press gesture on the vehicle screen, a sound prompt can be played for the preset instruction at the vehicle screen position corresponding to the long press gesture. The sound prompt can be the name of the application software or the name of the operation instruction, or it can be a voice or music pre-bound to an icon, text or graphic. During the input of the long press gesture, the position of the long press gesture can be moved. During the movement of the long press gesture, a sound prompt is played for the vehicle screen position corresponding to the long press gesture to determine whether the preset instruction at the vehicle screen position corresponding to the current long press gesture is the instruction that the driver wants to execute. If the current preset instruction is the instruction that the driver wants to execute, the driver inputs a long press and release gesture to execute the preset instruction, which can be to open the application software or to execute the operation instruction; if the current preset instruction is not the instruction that the driver wants to execute, the driver inputs a long press and drag gesture, that is, moves the finger to the edge of the screen or moves it out of the screen, to cancel the preset instruction.

[0089] The sound prompt can be replaced by a light strip color change prompt or a seat vibration frequency prompt.

[0090] In the above embodiment, another method for the driver to operate the vehicle screen while driving is implemented. During the vehicle's operation, by long pressing the vehicle screen, a corresponding information prompt will be displayed. Depending on the long press position on the vehicle screen, different voice prompts will be received, helping the driver to operate the vehicle screen without having to move his eyes to the vehicle screen.

[0091] It should be noted that the method of the embodiments of the present disclosure can be performed by a single device, such as a computer or server. The method of the embodiments of the present disclosure can also be applied in a distributed scenario, where multiple devices cooperate to perform the method. In such a distributed scenario, one of the multiple devices may only perform one or more steps of the method of the embodiments of the present disclosure, and the multiple devices will interact with each other to complete the method.

[0092] It should be noted that the above description is limited to some embodiments of the present disclosure. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in an order different from that described in the above embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0093] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides a gesture control device for a vehicle.

[0094] refer to Figure 3 , the gesture control device for a vehicle comprises:

[0095] The interface switching module 301 is configured to switch the vehicle screen to the target interface of the driving state and start the gesture operation mode when confirming that the vehicle is in the driving state;

[0096] A first target gesture receiving module 302 is configured to receive a first target gesture via the vehicle screen;

[0097] The preset operation execution module 303 is configured to, in response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, obtain a preset operation corresponding to the first target gesture and execute the preset operation.

[0098] In some embodiments, the preset operation execution module 303 specifically includes:

[0099] an information prompting unit, configured to, when determining that the first target gesture is a first preset gesture, provide an information prompt for a preset instruction corresponding to a position of the vehicle screen of the first target gesture according to a preset prompting method;

[0100] a second target gesture receiving unit, configured to receive, through the in-vehicle screen, a second target gesture made by the user based on the information prompt;

[0101] a preset instruction execution unit, configured to execute the preset instruction in response to confirming that the second target gesture is a second preset gesture;

[0102] The preset instruction canceling unit is configured to cancel the preset instruction in response to confirming that the second target gesture is a third preset gesture.

[0103] In some embodiments,

[0104] The first preset gesture is a long press gesture, wherein the long press gesture is a long press on the screen and the long press time exceeds a preset time threshold;

[0105] The second preset gesture is a long press and release gesture, wherein the long press and release gesture is a long press time exceeding the time threshold and releasing the screen;

[0106] The third preset gesture is a long press and drag gesture, wherein the long press and drag gesture is a long press time exceeding the time threshold and dragging to the edge of the screen.

[0107] In some embodiments, the interface switching module 301 specifically includes:

[0108] a vehicle speed information acquiring unit configured to acquire vehicle speed information through a sensor, and determine that the vehicle is in a driving state in response to the vehicle speed information being greater than 0;

[0109] or,

[0110] The engine state acquisition unit is configured to acquire an engine state of the vehicle, and in response to the engine state being engine started, determine that the vehicle is in a driving state.

[0111] In some embodiments, the interface switching module 301 specifically includes:

[0112] A driving speed obtaining unit is configured to obtain a driving speed of the vehicle;

[0113] a determination processing unit configured to compare the driving speed with the speed threshold to obtain a speed determination result, wherein the speed threshold is a preset speed value;

[0114] a fourth preset gesture locking unit, configured to, in response to confirming that the driving speed is greater than or equal to the speed threshold, lock a fourth preset gesture in the gesture operation mode according to a preset priority;

[0115] The priority is set according to the complexity of the gesture.

[0116] In some embodiments, after the first target gesture receiving module 302, the method further includes:

[0117] a target key node acquisition unit, configured to analyze and process the first target gesture to obtain a target key node in the first target gesture;

[0118] A preset key node acquisition unit is configured to acquire preset key nodes corresponding to gestures from a pre-stored gesture library, wherein the preset key nodes include preset key nodes for children's gestures and preset key nodes for adult gestures;

[0119] a matching and identification processing unit, configured to perform matching and identification processing on the target key node and the preset key node;

[0120] The gesture operation mode locking unit is configured to activate the child lock and lock the gesture operation mode in response to confirming that the target key node is consistent with the preset key node of the child gesture.

[0121] For the convenience of description, the above devices are described as being functionally divided into various modules. Of course, when implementing the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0122] The device of the above embodiment is used to implement the gesture control method of the vehicle corresponding to any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0123] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and runnable on the processor, wherein when the processor executes the program, the gesture control method for a vehicle described in any of the above embodiments is implemented.

[0124] Figure 4 A more specific hardware structure diagram of an electronic device provided in this embodiment is shown. The device may include: a processor 410, a memory 420, an input / output interface 430, a communication interface 440, and a bus 450. The processor 410, the memory 420, the input / output interface 430, and the communication interface 440 are communicatively connected to each other within the device via the bus 450.

[0125] The processor 410 can be implemented using a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0126] The memory 420 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage devices, dynamic storage devices, etc. The memory 420 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 420 and is called and executed by the processor 410.

[0127] The input / output interface 430 is used to connect input / output modules to implement information input and output. The input / output modules can be configured as components within the device (not shown in the figure) or can be externally connected to the device to provide corresponding functions. Input devices may include a keyboard, mouse, touch screen, microphone, various sensors, etc., and output devices may include a display, speaker, vibrator, indicator light, etc.

[0128] The communication interface 440 is used to connect to a communication module (not shown) to enable communication between the device and other devices. The communication module can communicate via a wired method (such as USB, network cable, etc.) or a wireless method (such as mobile network, WiFi, Bluetooth, etc.).

[0129] The bus 450 comprises a pathway for transmitting information between the various components of the device, such as the processor 410 , the memory 420 , the input / output interface 430 , and the communication interface 440 .

[0130] It should be noted that although the above device only shows the processor 410, the memory 420, the input / output interface 430, the communication interface 440, and the bus 450, in a specific implementation, the device may also include other components necessary for normal operation. In addition, it will be understood by those skilled in the art that the above device may only include the components necessary to implement the embodiments of this specification, and does not necessarily include all the components shown in the figure.

[0131] The electronic device of the above embodiment is used to implement the gesture control method of the vehicle corresponding to any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be repeated here.

[0132] Based on the same inventive concept, corresponding to any of the above-mentioned embodiment methods, the present disclosure also provides a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable the computer to execute the gesture control method for a vehicle as described in any of the above embodiments.

[0133] The computer-readable media of this embodiment include permanent and non-permanent, removable and non-removable media that can be used to store information by any method or technology. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0134] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the vehicle gesture control method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.

[0135] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples. Within the scope of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.

[0136] In addition, to simplify the description and discussion, and so as not to obscure the embodiments of the present disclosure, known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided figures. In addition, devices may be shown in the form of block diagrams to avoid obscuring the embodiments of the present disclosure, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure are to be implemented (i.e., these details should be fully within the purview of those skilled in the art). Where specific details (e.g., circuits) are set forth to describe exemplary embodiments of the present disclosure, it will be apparent to those skilled in the art that the embodiments of the present disclosure may be implemented without these specific details or with variations in these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0137] Although the present disclosure has been described in conjunction with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those skilled in the art based on the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0138] The embodiments of the present disclosure are intended to cover all such substitutions, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure should be included in the scope of protection of the present disclosure.

Claims

1. A gesture control method for a vehicle, characterized in that: The method comprises: When the vehicle is confirmed to be in driving state, switch the vehicle screen to the target interface of driving state and start the gesture operation mode; receiving a first target gesture via the vehicle-mounted screen; In response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, obtaining a preset operation corresponding to the first target gesture, and executing the preset operation; In response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, acquiring a preset operation corresponding to the first target gesture and executing the preset operation include: When the first target gesture is determined to be the first preset gesture, an information prompt is provided for the preset instruction of the vehicle screen position corresponding to the first target gesture according to a preset prompt method; wherein the preset prompt method includes: a sound prompt, a light strip color change prompt, or a seat vibration frequency prompt; receiving, through the in-vehicle screen, a second target gesture made by the user based on the information prompt; In response to confirming that the second target gesture is a second preset gesture, executing the preset instruction; In response to confirming that the second target gesture is the third preset gesture, canceling the preset instruction.

2. The method according to claim 1, characterized in that The first preset gesture is a long press gesture, wherein the long press gesture is a long press on the screen and the long press time exceeds a preset time threshold; The second preset gesture is a long press and release gesture, wherein the long press and release gesture is a long press time exceeding the time threshold and releasing the screen; The third preset gesture is a long press and drag gesture, wherein the long press and drag gesture is a long press time exceeding the time threshold and dragging to the edge of the screen.

3. The method according to claim 1, characterized in that The process of confirming that the vehicle is in a driving state includes: acquiring vehicle speed information through a sensor, and determining that the vehicle is in a driving state in response to the vehicle speed information being greater than 0; or, An engine state of the vehicle is acquired, and in response to the engine state being engine started, it is determined that the vehicle is in a driving state.

4. The method according to claim 1, wherein After confirming that the vehicle is in a driving state, the method further includes: Get the vehicle's speed; Comparing the driving speed with a speed threshold to obtain a speed determination result, wherein the speed threshold is a preset speed value; In response to confirming that the driving speed is greater than or equal to the speed threshold, locking a fourth preset gesture in the gesture operation mode according to a preset priority; The priority is set according to the complexity of the gesture.

5. The method according to claim 1, wherein After receiving the first target gesture, the method further includes: Analyzing and processing the first target gesture to obtain a target key node in the first target gesture; Obtaining preset key nodes corresponding to the gesture in a pre-stored gesture library, wherein the preset key nodes include preset key nodes for children's gestures and preset key nodes for adult gestures; Performing matching and identification processing on the target key node and the preset key node; In response to confirming that the target key node is consistent with the child gesture preset key node, the child lock is activated to lock the gesture operation mode.

6. A gesture control device for a vehicle, characterized in that: include: The interface switching module is configured to switch the vehicle screen to the target interface of the driving state and start the gesture operation mode when confirming that the vehicle is in the driving state; A first target gesture receiving module is configured to receive a first target gesture through the vehicle-mounted screen; a preset operation execution module, configured to, in response to confirming that the first target gesture belongs to any one of a plurality of pre-stored preset gestures, obtain a preset operation corresponding to the first target gesture and execute the preset operation; The preset operation execution module includes: an information prompting unit, configured to, when determining that the first target gesture is a first preset gesture, provide an information prompt for a preset instruction corresponding to the position of the vehicle screen of the first target gesture according to a preset prompting method; wherein the preset prompting method includes: a sound prompt, a light strip color change prompt, or a seat vibration frequency prompt; a second target gesture receiving unit, configured to receive, through the in-vehicle screen, a second target gesture made by the user based on the information prompt; a preset instruction execution unit, configured to execute the preset instruction in response to confirming that the second target gesture is a second preset gesture; The preset instruction canceling unit is configured to cancel the preset instruction in response to confirming that the second target gesture is the third preset gesture.

7. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method according to any one of claims 1 to 5 is implemented.

8. A non-transitory computer-readable storage medium, characterized in that The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a computer to execute the method according to any one of claims 1 to 5.

9. A vehicle, characterized in that: The gesture control device for a vehicle according to claim 6, the electronic device according to claim 7, or the computer-readable storage medium according to claim 8.

Citation Information

Patent Citations

  • On-board apparatus

    CN104039599A

  • Control system and method of intelligent kitchen

    CN113311723A

  • Vehicle terminal control system and method

    KR1020170107767A

  • Mobile terminal and control method therefor

    US20170351335A1