Vehicle interaction method and device, vehicle and storage medium

Abstract

The application relates to the technical field of human-computer interaction, in particular to an interaction method and device of a vehicle, the vehicle and a storage medium, wherein the method comprises the following steps: acquiring a voice interaction instruction and / or a gesture interaction instruction of a user; judging whether the voice interaction instruction meets a preset control condition; if the voice interaction instruction does not meet the preset control condition, determining a target control instruction according to the voice interaction instruction and the gesture interaction instruction, and controlling the vehicle to perform a corresponding interaction action based on the target control instruction. Thus, the problems that the vehicle cannot accurately recognize when there is an interaction instruction that is difficult to recognize in vehicle voice interaction, and that a user triggers an interaction component by mistake when performing interaction are solved, the interaction instruction is simplified by dividing the vehicle into regions and combining the voice and gesture interaction modes in the interaction region, so that the interaction instruction of the user is accurately recognized, and the user experience is improved.

Description

Technical Field

[0001] This application relates to the field of human-computer interaction technology, and in particular to a vehicle interaction method, device, vehicle, and storage medium. Background Technology

[0002] With the development of intelligent vehicle cockpits, users have higher and higher requirements for in-cabin interactive functions. A complete cockpit interactive system has become one of the main purchasing factors for more users, such as in-cabin voice interaction and gesture interaction. Therefore, it is necessary to improve the vehicle cockpit interaction.

[0003] In related technologies, when users perform in-vehicle voice interaction, they often need relatively detailed interaction commands, and the interaction commands also need to have a certain logic so that the vehicle's functional modules will perform relevant operations based on the user's interaction commands.

[0004] However, during in-vehicle voice interaction, users often subconsciously use vague language, which makes it difficult for the vehicle processor to accurately identify the user's interaction commands, thus deeming them invalid. At the same time, the lack of clear zoning within the vehicle cabin can also cause users to accidentally trigger other unwanted operations during interaction, thereby reducing the user experience and urgently needing to be addressed. Summary of the Invention

[0005] This application provides a vehicle interaction method, device, vehicle, and storage medium to solve problems such as the vehicle's inability to accurately recognize difficult-to-recognize interaction commands in in-vehicle voice interaction, and users accidentally triggering interaction components during interaction.

[0006] The first aspect of this application provides a vehicle interaction method, including the following steps:

[0007] Acquire user's voice interaction commands and / or gesture interaction commands;

[0008] Determine whether the voice interaction command meets the preset control conditions; and

[0009] If the voice interaction command does not meet the preset control conditions, a target control command is determined based on the voice interaction command and the gesture interaction command, and the vehicle is controlled to perform the corresponding interactive action based on the target control command.

[0010] According to one embodiment of this application, determining whether the voice interaction command satisfies the preset control conditions includes:

[0011] Extract keywords from the voice interaction commands;

[0012] The keyword is matched with the command words in the preset command library. If the command word is matched, the voice interaction command is determined to meet the preset control conditions; otherwise, the voice interaction command is determined not to meet the preset control conditions.

[0013] According to one embodiment of this application, the step of determining a target control command based on the voice interaction command and the gesture interaction command, and controlling the vehicle to perform a corresponding interactive action based on the target control command, includes:

[0014] The user's gesture data is recognized based on the gesture interaction instructions;

[0015] The user's gesture data is calculated based on a preset algorithm to obtain the user's gesture information, wherein the gesture information includes the gesture pointing direction and the vehicle interaction component corresponding to the gesture pointing direction;

[0016] The target control command is determined based on the voice interaction command, the gesture direction, and the vehicle interaction component corresponding to the gesture direction.

[0017] Determine whether the voice interaction command and the gesture interaction command meet the preset interaction conditions, and when the voice interaction command and the gesture interaction command meet the preset interaction conditions, control the vehicle to execute the corresponding interaction action based on the target control command.

[0018] According to one embodiment of this application, determining whether the voice interaction command and the gesture interaction command meet preset interaction conditions includes:

[0019] The user's current cabin area is obtained based on the pre-defined cabin area.

[0020] The system identifies whether the user's voice interaction command and gesture interaction command are located in the current cockpit area. If the user's voice interaction command and gesture interaction command are located in the current cockpit area, the system determines that the voice interaction command and gesture interaction command meet preset interaction conditions.

[0021] According to one embodiment of this application, the pre-divided cabin area includes at least one of a single-mode, a two-two-mode, a one-three-mode, and a four-zero-mode.

[0022] The vehicle interaction method according to embodiments of this application acquires user voice interaction commands and / or gesture interaction commands. When the voice interaction command does not meet preset control conditions, a target control command is determined based on the voice interaction command and gesture interaction command, and the vehicle is controlled to execute corresponding interactive actions based on the target control command. This solves the problems of inaccurate vehicle recognition of difficult-to-recognize interaction commands in in-vehicle voice interaction, and accidental triggering of interactive components by the user during interaction. By dividing the vehicle into regions and using a combination of voice and gesture interaction within the interaction region, interaction commands are simplified, thereby accurately recognizing user interaction commands and improving user experience.

[0023] A second aspect of this application provides a vehicle interaction device, comprising:

[0024] The acquisition module is used to acquire the user's voice interaction commands and / or gesture interaction commands;

[0025] The judgment module is used to determine whether the voice interaction command meets preset control conditions; and

[0026] The control module is configured to determine a target control command based on the voice interaction command and the gesture interaction command if the voice interaction command does not meet the preset control conditions, and control the vehicle to perform corresponding interactive actions based on the target control command.

[0027] According to one embodiment of this application, the determining module is specifically used for:

[0028] Extract keywords from the voice interaction commands;

[0029] The keyword is matched with the command words in the preset command library. If the command word is matched, the voice interaction command is determined to meet the preset control conditions; otherwise, the voice interaction command is determined not to meet the preset control conditions.

[0030] According to one embodiment of this application, the control module is specifically used for:

[0031] The user's gesture data is recognized based on the gesture interaction instructions;

[0032] The user's gesture data is calculated based on a preset algorithm to obtain the user's gesture information, wherein the gesture information includes the gesture pointing direction and the vehicle interaction component corresponding to the gesture pointing direction;

[0033] The target control command is determined based on the voice interaction command, the gesture direction, and the vehicle interaction component corresponding to the gesture direction.

[0034] Determine whether the voice interaction command and the gesture interaction command meet the preset interaction conditions, and when the voice interaction command and the gesture interaction command meet the preset interaction conditions, control the vehicle to execute the corresponding interaction action based on the target control command.

[0035] According to one embodiment of this application, the control module is specifically used for:

[0036] The user's current cabin area is obtained based on the pre-defined cabin area.

[0037] The system identifies whether the user's voice interaction command and gesture interaction command are located in the current cockpit area. If the user's voice interaction command and gesture interaction command are located in the current cockpit area, the system determines that the voice interaction command and gesture interaction command meet preset interaction conditions.

[0038] According to one embodiment of this application, the pre-divided cabin area includes at least one of a single-mode, a two-two-mode, a one-three-mode, and a four-zero-mode.

[0039] The vehicle interaction device according to embodiments of this application acquires user voice interaction commands and / or gesture interaction commands. When the voice interaction command does not meet preset control conditions, it determines a target control command based on the voice interaction command and gesture interaction command, and controls the vehicle to execute corresponding interactive actions based on the target control command. This solves the problems of inaccurate vehicle recognition of difficult-to-recognize interaction commands in in-vehicle voice interaction, and accidental triggering of interaction components by the user during interaction. By dividing the vehicle into regions and using a combination of voice and gesture interaction within the interaction region, interaction commands are simplified, thereby accurately recognizing user interaction commands and improving user experience.

[0040] A third aspect of this application provides a vehicle, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle interaction method as described in the above embodiments.

[0041] A fourth aspect of this application provides a computer-readable storage medium storing computer instructions for causing the computer to perform the vehicle interaction method as described in the above embodiments.

[0042] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0043] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0044] Figure 1 This is a flowchart of a vehicle interaction method provided according to an embodiment of this application;

[0045] Figure 2 This is a flowchart illustrating the overall interaction process of a vehicle according to an embodiment of this application;

[0046] Figure 3 This is a schematic diagram of the cockpit layout according to one embodiment of this application;

[0047] Figure 4 This is an example diagram of an interactive device for a vehicle according to an embodiment of this application;

[0048] Figure 5 This is a schematic diagram of the structure of a vehicle according to an embodiment of this application. Detailed Implementation

[0049] The embodiments of this application are described in detail below. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0050] The following description, with reference to the accompanying drawings, describes a vehicle interaction method, device, electronic device, and storage medium according to embodiments of this application. Addressing the issues mentioned in the background art, such as the vehicle's inability to accurately recognize difficult-to-recognize interaction commands in in-vehicle voice interaction, and the user's accidental triggering of interaction components during interaction, this application provides a vehicle interaction method. In this method, the user's voice interaction commands and / or gesture interaction commands are acquired. When the voice interaction command does not meet preset control conditions, a target control command is determined based on the voice interaction command and gesture interaction command, and the vehicle is controlled to execute the corresponding interactive action based on the target control command. This solves the problems of the vehicle's inability to accurately recognize difficult-to-recognize interaction commands in in-vehicle voice interaction, and the user's accidental triggering of interaction components during interaction. By dividing the vehicle into regions and using a combination of voice and gesture interaction within the interaction region, interaction commands are simplified, thereby accurately recognizing the user's interaction commands and improving the user experience.

[0051] Specifically, Figure 1 This is a flowchart illustrating a vehicle interaction method provided in an embodiment of this application.

[0052] like Figure 1 As shown, the interaction method of this vehicle includes the following steps:

[0053] In step S101, the user's voice interaction commands and / or gesture interaction commands are obtained.

[0054] Specifically, to avoid situations where the vehicle cannot accurately recognize the user's interaction commands and execute corresponding actions due to illogical or unclear statements during the interaction process between the user and the vehicle, thereby affecting the user's interaction experience, this application embodiment uses two methods, voice recognition and gesture recognition, to assist the user in interacting with the vehicle, that is, to obtain the user's voice interaction commands and / or gesture interaction commands, thereby meeting the user's interaction needs.

[0055] In this embodiment of the application, the voice interaction commands are recognized by the voice interaction module, such as a vehicle speaker; the gesture interaction commands are recognized by the gesture interaction module, such as a camera inside the vehicle (both the voice interaction module and the gesture interaction module are activated by a voice wake-up command).

[0056] In step S102, it is determined whether the voice interaction command meets the preset control conditions.

[0057] According to one embodiment of this application, determining whether a voice interaction command meets preset control conditions includes: extracting keywords from the voice interaction command; matching the keywords with command words in a preset command library; if a command word is matched, determining that the voice interaction command meets the preset control conditions; otherwise, determining that the voice interaction command does not meet the preset control conditions.

[0058] The preset instruction library can be set by those skilled in the art according to the user's needs, or it can be obtained through multiple experiments, and no specific limitation is made here.

[0059] Specifically, such as Figure 2 As shown, after receiving a user's voice interaction command, the voice interaction module in this embodiment determines whether the user's voice interaction command meets the preset control conditions, i.e. whether it is operable. When the user's voice interaction command meets the preset control conditions, the module controls the vehicle to perform the corresponding interactive action.

[0060] Specifically, in this embodiment, firstly, the vehicle processor extracts keywords from the voice interaction command, that is, it determines whether there are semantically unclear words or phrases in the user's voice interaction command, such as "this" or "that," or whether the user's voice interaction command lacks necessary words or phrases, such as only having nouns or verbs. Secondly, the extracted keywords are matched with command words in a preset command library. If a command word is matched, it is determined that the voice interaction command meets the preset control conditions. For example, if the keyword extracted by the vehicle processor is "play music," and the command word "play music" exists in the preset command library, it means that the keyword and the command word in the preset command library have successfully matched, that is, the user's voice interaction command meets the preset control conditions. If the command word "play music" does not exist in the preset command library, it means that the keyword and the command word in the preset command library have failed to match, that is, the user's voice interaction command does not meet the preset control conditions.

[0061] In step S103, if the voice interaction command does not meet the preset control conditions, the target control command is determined based on the voice interaction command and the gesture interaction command, and the vehicle is controlled to perform the corresponding interactive action based on the target control command.

[0062] According to one embodiment of this application, a target control command is determined based on voice interaction commands and gesture interaction commands, and the vehicle is controlled to perform corresponding interactive actions based on the target control command. This includes: recognizing user gesture data based on the gesture interaction command; calculating the user's gesture data based on a preset algorithm to obtain user gesture information, wherein the gesture information includes the gesture pointing direction and the vehicle interaction component corresponding to the gesture pointing direction; determining the target control command based on the voice interaction command, the gesture pointing direction, and the vehicle interaction component corresponding to the gesture pointing direction; determining whether the voice interaction command and the gesture interaction command meet preset interaction conditions, and controlling the vehicle to perform corresponding interactive actions based on the target control command when the voice interaction command and the gesture interaction command meet the preset interaction conditions.

[0063] The preset algorithm and preset interaction conditions can be selected by those skilled in the art based on actual usage needs, or they can be obtained through computer simulation, and no specific limitations are made here.

[0064] Specifically, in this embodiment, if the user's voice interaction command does not meet the preset control conditions, the user's gesture interaction command is first collected through the gesture interaction module, and the user's gesture data is identified based on the gesture interaction command. Secondly, the vehicle processor calculates the gesture data based on a preset algorithm to obtain the user's gesture information. The user's gesture information includes the gesture direction and the corresponding vehicle interaction component. It should be noted that the gesture interaction module can be set to recognize only the direction of one of the user's fingers, i.e., a hand in a fist with only one finger extended; the direction of the finger's tip is the direction of the gesture. For example, if the user points to the car window, the car window is the corresponding vehicle interaction component. Finally, the target control command is determined based on the voice interaction command, the gesture direction, and the corresponding vehicle interaction component. That is, if the user's voice interaction command is "open the window," and the gesture direction is the direction of the car window corresponding to the finger, and the vehicle interaction component is the car window, then the target control command is determined to be opening the window pointed to by the user.

[0065] Furthermore, in this embodiment of the application, after determining the target control command, it is necessary to further determine whether the user's voice interaction command and gesture interaction command meet the preset interaction conditions, and when the voice interaction command and gesture interaction command meet the preset interaction conditions, control the vehicle to perform the corresponding interactive action based on the target control command.

[0066] According to one embodiment of this application, determining whether voice interaction commands and gesture interaction commands meet preset interaction conditions includes: obtaining the user's current cabin area based on a pre-divided cabin area; identifying whether the user's voice interaction commands and gesture interaction commands are in the current cabin area; and determining that the voice interaction commands and gesture interaction commands meet preset interaction conditions when the user's voice interaction commands and gesture interaction commands are in the current cabin area.

[0067] Specifically, since users may accidentally control interactive components in other vehicle areas when interacting inside the vehicle, this application embodiment needs to divide the vehicle into areas to avoid problems such as users misoperating or improperly operating interactive components in other vehicle areas.

[0068] Specific questions, such as Figure 3 As shown, in this embodiment of the application, the vehicle can be divided into front left cabin (driver's seat), front right cabin (passenger's seat), rear left cabin and rear right cabin according to spatial area through the cabin area module. Then, the divided cabin area is divided into at least one of four modes, namely one-one mode, two-two mode, one-three mode and four-zero mode.

[0069] The four configurations are divided into four modes: Mode 1: Each of the four cabins is a separate area, with each cabin being an independent space; Mode 2: Two adjacent cabins are divided into one independent space; Mode 3: The front left cabin and front right cabin, the rear left cabin and rear right cabin, the front left cabin and rear left cabin, and the front right cabin and rear right cabin are combined. Mode 4: Three adjacent cabins are divided into one independent space, with the remaining cabin also forming an independent space; Mode 5: The front left cabin, front right cabin, and rear left cabin form one independent space, and the rear right cabin forms another independent space, or the front left cabin and rear right cabin form another independent space. The four-zero mode treats the four cabins as a whole, allowing the gesture interaction module to collect user gesture data from different areas and transmit it to the processor for calculation to determine the direction of the user's gesture and the vehicle component and corresponding vehicle function pointed to by the user's gesture.

[0070] Furthermore, such as Figure 2 As shown in the embodiment of this application, after dividing the vehicle's cabin area, the vehicle processor obtains the user's current cabin area based on the different divided areas, and identifies whether the user's voice interaction commands and gesture interaction commands are within the current cabin area. That is, the permission setting module retrieves the permission setting range of the cabin area and determines whether the user within the cabin area has the permission to control the vehicle to perform corresponding interactive actions through the voice interaction module and gesture interaction module. If the user's voice interaction commands and gesture interaction commands are within the current cabin area, it is determined that the voice interaction commands and gesture interaction commands meet the preset interaction conditions, that is, the user has the permission to control the vehicle to perform corresponding interactive actions based on the target control command through the voice interaction module and gesture interaction module. This limits the range specified by the user's gestures when issuing voice commands, thereby reducing the control of other areas by users with limited permission areas and avoiding misoperation or improper operation.

[0071] To facilitate a better understanding by those skilled in the art, the following will be illustrated through three specific embodiments:

[0072] Example 1:

[0073] When a passenger needs to control the window while riding in a vehicle, they can issue a voice command, "Open this," while pointing to the desired window. The vehicle's processor extracts keywords from the received voice command and matches them against a pre-defined command library. Since "this" is a semantically ambiguous word, the match fails. The processor then recognizes the user's gesture data and determines the target control command, "Open the window," based on the voice command, the direction of the gesture, and the corresponding vehicle interaction component. Simultaneously, to prevent... Users in one area can open windows in other areas. For example, a user in the rear left cabin can open the front left cabin window using the method described above. Therefore, users can set the permissions for the rear left cabin user in the permission setting module according to the combination mode of front left cabin and front right cabin, and rear left cabin and rear right cabin in the 2-2 mode. That is, the rear left cabin user can only open the two rear left cabin windows using the method described above. Similarly, the permissions for the rear left cabin user can also be set according to the combination of front left cabin, front right cabin and rear right cabin as an independent space, and rear left cabin as an independent space in the 1-3 mode. That is, the rear left cabin user can only open the rear left cabin window using the method described above.

[0074] Example 2:

[0075] When a user needs to move the front seats to expand the rear space while riding in the vehicle, they can issue a voice command "move forward" while pointing to the front right cabin seat. The vehicle processor extracts keywords from the received voice command and matches them against a pre-defined command library. Since "move forward" is semantically ambiguous, the match fails. Instead, the processor recognizes the user's gesture data and determines the target control command based on the voice command, the gesture direction, and the corresponding vehicle interaction component: "move the front right cabin seat forward." To prevent users in one area from moving seats in other areas (e.g., a user in the rear right cabin using the same method to move the front right cabin seat), the user can configure permissions in the permission settings module, separating the front and rear right cabins into one-to-one groups. This means the rear right cabin user can only move the front right cabin seat using the same method.

[0076] Example 3:

[0077] When a user needs to play music while riding in the car, they can issue a voice interaction command "open or play" while pointing their finger at the central control screen or the speakers. At this time, the vehicle processor can extract keywords from the received user voice interaction command and match the keywords with the command words in the preset command library. Since "open or play" is a semantically unclear phrase, the match fails. At this time, the vehicle processor recognizes the user's gesture data based on the user's gesture interaction command, and determines the target control command, namely "open or play music", based on the voice interaction command, the direction of the gesture, and the corresponding vehicle interaction component.

[0078] Therefore, the embodiments of this application improve the interaction method and simplify the interaction commands through voice interaction commands and gesture interaction commands. At the same time, it can reduce the mental effort required for users to input interaction commands. The addition of gesture interaction as a supplement to voice interaction is more in line with users' spoken language habits, thereby improving the user's driving experience.

[0079] The vehicle interaction method according to embodiments of this application acquires user voice interaction commands and / or gesture interaction commands. When the voice interaction command does not meet preset control conditions, a target control command is determined based on the voice interaction command and gesture interaction command, and the vehicle is controlled to execute corresponding interactive actions based on the target control command. This solves the problems of inaccurate vehicle recognition of difficult-to-recognize interaction commands in in-vehicle voice interaction, and accidental triggering of interactive components by the user during interaction. By dividing the vehicle into regions and using a combination of voice and gesture interaction within the interaction region, interaction commands are simplified, thereby accurately recognizing user interaction commands and improving user experience.

[0080] Next, the interactive device for a vehicle according to an embodiment of this application is described with reference to the accompanying drawings.

[0081] Figure 4 This is a block diagram of the vehicle's interactive device according to an embodiment of this application.

[0082] like Figure 4 As shown, the vehicle's interactive device 10 includes: an acquisition module 100, a judgment module 200, and a control module 300.

[0083] The acquisition module 100 is used to acquire the user's voice interaction commands and / or gesture interaction commands;

[0084] The judgment module 200 is used to determine whether the voice interaction command meets the preset control conditions; and

[0085] The control module 300 is used to determine the target control command based on the voice interaction command and the gesture interaction command if the voice interaction command does not meet the preset control conditions, and control the vehicle to perform the corresponding interactive action based on the target control command.

[0086] According to one embodiment of this application, the determination module 200 is specifically used for:

[0087] Extracting keywords from voice interaction commands;

[0088] The keyword is matched with the command words in the preset command library. If a command word is matched, the voice interaction command is determined to meet the preset control conditions. Otherwise, the voice interaction command is determined not to meet the preset control conditions.

[0089] According to one embodiment of this application, the control module 300 is specifically used for:

[0090] Recognize the user's gesture data based on gesture interaction commands;

[0091] The user's gesture data is calculated based on a preset algorithm to obtain the user's gesture information, which includes the direction of the gesture and the vehicle interaction component corresponding to the direction of the gesture.

[0092] The target control command is determined based on the voice interaction command, the direction of the gesture, and the vehicle interaction component corresponding to the direction of the gesture.

[0093] Determine whether the voice interaction command and gesture interaction command meet the preset interaction conditions, and when the voice interaction command and gesture interaction command meet the preset interaction conditions, control the vehicle to execute the corresponding interaction action based on the target control command.

[0094] According to one embodiment of this application, the control module 300 is specifically used for:

[0095] Obtain the user's current cabin area based on the pre-defined cabin area;

[0096] It identifies whether the user's voice and gesture interaction commands are within the current cockpit area. When the user's voice and gesture interaction commands are within the current cockpit area, it determines that the voice and gesture interaction commands meet the preset interaction conditions.

[0097] According to one embodiment of this application, the pre-divided cabin area includes at least one of a single-mode, a two-two-mode, a one-three-mode, and a four-zero-mode.

[0098] The vehicle interaction device according to embodiments of this application acquires user voice interaction commands and / or gesture interaction commands. When the voice interaction command does not meet preset control conditions, it determines a target control command based on the voice interaction command and gesture interaction command, and controls the vehicle to execute corresponding interactive actions based on the target control command. This solves the problems of inaccurate vehicle recognition of difficult-to-recognize interaction commands in in-vehicle voice interaction, and accidental triggering of interaction components by the user during interaction. By dividing the vehicle into regions and using a combination of voice and gesture interaction within the interaction region, interaction commands are simplified, thereby accurately recognizing user interaction commands and improving user experience.

[0099] Figure 5 A schematic diagram of the structure of a vehicle provided in an embodiment of this application. The vehicle may include:

[0100] The memory 501, the processor 502, and the computer program stored on the memory 501 and capable of running on the processor 502.

[0101] When the processor 502 executes the program, it implements the vehicle interaction method provided in the above embodiments.

[0102] Furthermore, the vehicle also includes:

[0103] Communication interface 503 is used for communication between memory 501 and processor 502.

[0104] The memory 501 is used to store computer programs that can run on the processor 502.

[0105] The memory 501 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0106] If the memory 501, processor 502, and communication interface 503 are implemented independently, then the communication interface 503, memory 501, and processor 502 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 5 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0107] Optionally, in a specific implementation, if the memory 501, processor 502, and communication interface 503 are integrated on a single chip, then the memory 501, processor 502, and communication interface 503 can communicate with each other through an internal interface.

[0108] Processor 502 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0109] This embodiment also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the vehicle interaction method described above.

[0110] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0111] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0112] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0113] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which programs can be printed, because programs can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0114] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0115] Those skilled in the art will understand that all or part of the steps of the methods described in the above embodiments can be implemented by a program instructing related hardware, and the program can be stored in a computer-readable storage medium. When executed, the program includes one or a combination of the steps of the method embodiments.

[0116] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0117] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A vehicle interaction method, characterized in that, Includes the following steps: Obtain the user's voice and gesture interaction commands; Determine whether the voice interaction command meets the preset control conditions; as well as If the voice interaction command does not meet the preset control conditions, then a target control command is determined based on the voice interaction command and the gesture interaction command, and the vehicle is controlled to perform the corresponding interactive action based on the target control command. This includes: recognizing the user's gesture data according to the gesture interaction command; calculating the user's gesture data based on a preset algorithm to obtain the user's gesture information, wherein the gesture information includes the gesture pointing direction and the vehicle interaction component corresponding to the gesture pointing direction; and determining the target control command according to the voice interaction command, the gesture pointing direction, and the vehicle interaction component corresponding to the gesture pointing direction. The current cabin area of ​​the user is obtained based on the pre-defined cabin area; the user's voice interaction command and gesture interaction command are identified as being within the current cabin area; when the user's voice interaction command and gesture interaction command are within the current cabin area, it is determined that the voice interaction command and gesture interaction command meet the preset interaction conditions; and when the voice interaction command and gesture interaction command meet the preset interaction conditions, the vehicle is controlled to perform the corresponding interactive action based on the target control command.

2. The method according to claim 1, characterized in that, The step of determining whether the voice interaction command meets the preset control conditions includes: Extract keywords from the voice interaction commands; The keyword is matched with the command words in the preset command library. If the command word is matched, the voice interaction command is determined to meet the preset control conditions. Otherwise, the voice interaction command is determined not to meet the preset control conditions.

3. The method according to claim 1, characterized in that, The pre-defined cabin areas include at least one of the following: single-mode, two-two-mode, one-three-mode, and four-zero-mode.

4. A vehicle interaction device, characterized in that, include: The acquisition module is used to acquire the user's voice interaction commands and gesture interaction commands; The judgment module is used to determine whether the voice interaction command meets the preset control conditions; as well as The control module is configured to determine a target control command based on the voice interaction command and the gesture interaction command if the voice interaction command does not meet the preset control conditions, and control the vehicle to perform corresponding interactive actions based on the target control command. Specifically, the control module is configured to: recognize the user's gesture data according to the gesture interaction command; calculate the user's gesture data based on a preset algorithm to obtain the user's gesture information, wherein the gesture information includes the gesture pointing direction and the vehicle interaction component corresponding to the gesture pointing direction; and determine the target control command according to the voice interaction command, the gesture pointing direction, and the vehicle interaction component corresponding to the gesture pointing direction. The current cabin area of ​​the user is obtained based on the pre-defined cabin area; the user's voice interaction command and gesture interaction command are identified as being within the current cabin area; when the user's voice interaction command and gesture interaction command are within the current cabin area, it is determined that the voice interaction command and gesture interaction command meet the preset interaction conditions; and when the voice interaction command and gesture interaction command meet the preset interaction conditions, the vehicle is controlled to perform the corresponding interactive action based on the target control command.

5. The apparatus according to claim 4, characterized in that, The judgment module is specifically used for: Extract keywords from the voice interaction commands; The keyword is matched with the command words in the preset command library. If the command word is matched, the voice interaction command is determined to meet the preset control conditions. Otherwise, the voice interaction command is determined not to meet the preset control conditions.

6. A vehicle, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the program to implement the vehicle interaction method as described in any one of claims 1-3.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the vehicle interaction method as described in any one of claims 1-3.

Images