Human-computer interaction method, human-computer interaction device, readable storage medium and vehicle

Abstract

The invention discloses a man-machine interaction method, a man-machine interaction device, a readable storage medium and a vehicle, and relates to the technical field of new energy automobiles, the man-machine interaction method comprises the following steps: collecting first video data of a to-be-detected object; performing data processing on the first video data to obtain a gesture type of the to-be-detected object; determining a first event corresponding to the gesture type, and determining a first business application responding to the first event; and displaying that the first business application executes the first event. According to the method, the recognition accuracy of the user gesture is improved, and meanwhile, the operation convenience of man-machine interaction is improved.

Description

Technical Field

[0001] The present application relates to the technical field of new energy vehicles, and in particular to a human-computer interaction method, a human-computer interaction device, a readable storage medium and a vehicle. Background Art

[0002] At present, with the rise of technologies such as smart driving and smart cockpits, the complexity of human-computer interaction scenarios and the diversification of human-computer input methods have increased. With the diversification of input methods, the concurrency of multiple input methods has emerged, and problems such as operability, ease of use, and scalability have arisen. Therefore, existing human-computer interaction methods have technical problems such as low recognition accuracy and complicated operation steps. Summary of the invention

[0003] The embodiments of the present application provide a human-computer interaction method, a human-computer interaction device, a readable storage medium and a vehicle, which are used to solve technical problems in the prior art such as low recognition accuracy and complicated operation steps.

[0004] A first aspect of an embodiment of the present application provides a human-computer interaction method, comprising: Collecting first video data of the object to be detected; Processing the first video data to obtain a gesture type of the object to be detected; Determine a first event corresponding to the gesture type, and determine a first service application that responds to the first event; The first event of the first business application executing is displayed.

[0005] The human-computer interaction method in this embodiment processes the first video data to obtain the gesture type of the object to be detected, then determines the first event corresponding to the gesture type, and determines the first business application that responds to the first event, thereby improving the recognition accuracy of user gestures, simplifying the human-computer interaction steps, and improving the operational convenience of human-computer interaction.

[0006] In a second aspect of the embodiments of the present application, a human-computer interaction device is provided, including a processor and a memory, wherein a program or instruction is stored in the memory, and when the program or instruction is executed by the processor, the steps of the human-computer interaction method in any of the above embodiments are implemented. Therefore, the readable storage medium has all the beneficial effects of the human-computer interaction method in any of the above embodiments, which will not be repeated here.

[0007] In a third aspect of the embodiments of the present application, a readable storage medium is provided, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the human-computer interaction method in any of the above embodiments are implemented. Therefore, the readable storage medium has all the beneficial effects of the human-computer interaction method in any of the above embodiments, which will not be repeated here.

[0008] According to a fourth aspect of the present invention, a vehicle is proposed, comprising: a human-computer interaction device as defined in the above second aspect, and / or a readable storage medium as defined in the above third aspect, and thus having all the beneficial technical effects of the human-computer interaction device as defined in the above second aspect, and / or the readable storage medium as defined in the above third aspect, and no further details will be given here. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0010] Figure 1 A flowchart of a human-computer interaction method provided in an embodiment of the present application; Figure 2 A functional block diagram of a human-computer interaction system provided in an embodiment of the present application; Figure 3 A schematic diagram of a human-computer interaction system provided in an embodiment of the present application; Figure 4 This is a structural block diagram of a vehicle control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0011] In order to better understand the technical solutions provided by the embodiments of this specification, the technical solutions of the embodiments of this specification are described in detail below through the accompanying drawings and specific embodiments. It should be understood that the embodiments of this specification and the specific features in the embodiments are detailed descriptions of the technical solutions of the embodiments of this specification, rather than limitations on the technical solutions of this specification. In the absence of conflict, the embodiments of this specification and the technical features in the embodiments can be combined with each other.

[0012] In this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that the process, method, article or equipment including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or equipment. In the absence of more restrictions, the elements limited by the statement "comprise one..." do not exclude the existence of other identical elements in the process, method, article or equipment including the elements. The term "more than two" includes two or more than two situations.

[0013] In some embodiments, Figure 1 As shown, in an embodiment of the present application, a human-computer interaction method is provided, comprising: Step S101, collecting first video data of an object to be detected; Step S102, processing the first video data to obtain the gesture type of the object to be detected; Step S103, determining a first event corresponding to the gesture type, and determining a first service application that responds to the first event; Step S104: displaying a first event of the first business application executing the first event.

[0014] In this embodiment, a human-computer interaction method is proposed, which includes a module for collecting first video data of an object to be detected. The object to be detected is an object that needs to be detected, and the first video data is video data of the object to be detected.

[0015] Exemplarily, the object to be detected may be a driver inside a car.

[0016] Exemplarily, images of the object to be detected may be acquired, and then the images may be integrated into first video data.

[0017] Exemplarily, first video data of the object to be detected is collected by a camera.

[0018] The first video data is processed to obtain a gesture type of the object to be detected, where the gesture type is a type of a current gesture of the object to be detected.

[0019] Exemplarily, the first video data includes a hand image of the object to be detected. Through a preset gesture recognition algorithm, the hand image can be type-recognized to obtain the gesture type of the object to be detected.

[0020] According to the gesture type, a first event that needs to be operated on the object to be detected is determined, wherein the first event is an operation event corresponding to the gesture type.

[0021] Exemplarily, when the gesture type is the index finger and thumb being spread apart, the first event is an operation event of turning up the volume of a speaker.

[0022] For example, when the gesture type is an open index finger and thumb, the first event may be an operation event of increasing the volume of a speaker.

[0023] Exemplarily, when the gesture type is making a fist, the first event may be an operation event of closing the current application.

[0024] A first event corresponding to the gesture type is determined, and a first service application that responds to the first event is determined, wherein the first service application is an application that responds to the first event.

[0025] Exemplarily, when the first event is an operation event of closing the current application, the first service application may be a control application of the audio system.

[0026] Display the first event of the first business application executing Exemplarily, the vehicle may include a display screen, and the first business application is displayed on the display screen.

[0027] The human-computer interaction method in this embodiment processes the first video data to obtain the gesture type of the object to be detected, then determines the first event corresponding to the gesture type, and determines the first business application that responds to the first event, thereby improving the recognition accuracy of user gestures, simplifying the human-computer interaction steps, and improving the operational convenience of human-computer interaction.

[0028] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which processes the first video data to obtain the gesture type of the object to be detected, including: Step S201, performing data processing on the first video data to obtain second video data; Step S202: performing recognition processing on the second video data to obtain the gesture type.

[0029] In this embodiment, data processing is performed on the first video data to obtain second video data, and the second video data is video data after the first video data is optimized.

[0030] Exemplarily, the first video data may be synthesized or cropped to obtain the second video data.

[0031] Exemplarily, the first video data may be filtered to obtain the second video data.

[0032] The second video data is processed for recognition to obtain the gesture type.

[0033] Exemplarily, a preset gesture recognition model is obtained, and the second video data is recognized by the gesture recognition model to determine the gesture type.

[0034] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which determines a first event corresponding to a gesture type, including: Step S301, obtaining a plurality of preset gestures and a plurality of preset events, wherein the plurality of preset gestures correspond to the plurality of preset events one by one; Step S302, determining a target gesture from among a plurality of preset gestures according to the gesture type; Step S303: determining a first event among a plurality of preset events according to the target gesture.

[0035] In some embodiments, multiple preset gestures and multiple preset events are acquired, and the multiple preset gestures correspond to the multiple preset events one by one.

[0036] Exemplarily, the preset event may be an operation event defined by a user.

[0037] Exemplarily, the preset gesture may be a user-defined gesture.

[0038] The gesture type is compared with a plurality of preset gestures, and then a target gesture is selected from the plurality of preset gestures, wherein the target gesture is a preset gesture corresponding to the gesture type.

[0039] Exemplarily, the target gesture may be a gesture of an open index finger and thumb.

[0040] According to the target gesture, a first event among a plurality of preset events is determined.

[0041] Exemplarily, based on the correspondence between a plurality of preset gestures and a plurality of preset events, a first event corresponding to the target gesture is determined.

[0042] In some embodiments, a human-computer interaction method is provided in an embodiment of the present application, further comprising: Step S401, obtaining a plurality of preset business applications; Step S402, determining a first business application among multiple business applications according to the first event; Step S403: Send the first event to the first business application.

[0043] In this embodiment, a plurality of preset business applications are acquired, wherein the business application is a preset operation application.

[0044] Exemplarily, the multiple business applications may include business applications such as an audio application, a Bluetooth application, and a navigation application.

[0045] A first business application among a plurality of business applications is determined according to the first event.

[0046] Exemplarily, the first service application may be notified to execute the first event.

[0047] In some embodiments, an embodiment of the present application provides a human-computer interaction method. After determining a first business application among multiple business applications according to a first event, the method further includes: Step S501, detecting the running status of the first service application; Step S502, determining the running priority of the first event according to the running status; Step S503: Send the first event and the running priority to the first service application.

[0048] In this embodiment, after determining the first service application among the multiple service applications according to the first event, the running state of the first service application can be detected, wherein the running state indicates the running state of the first service application.

[0049] Exemplarily, the running status may be an event being executed or an event not being executed.

[0050] According to the running state, the running priority of the first event is determined, and then the first event and the running priority are sent to the first business application, wherein the running priority indicates the priority of executing the first event.

[0051] Exemplarily, when the running state is an event being executed, a real-time event currently executed by the first business application is obtained, the priorities of the real-time event and the first event are compared, and the running priority of the first event is determined.

[0052] Exemplarily, when the priority of the real-time event is higher than that of the first event, the running priority is set to a low priority.

[0053] Exemplarily, when the priority of the real-time event is lower than that of the first event, the running priority is set to a high priority.

[0054] Exemplarily, this embodiment can handle concurrent events and event distribution, such as: conflict handling when multiple screens execute gestures simultaneously, arbitration of multiple screens competing with the same window according to business needs, business arbitration of multi-screen multi-input response events, process state event arbitration, etc. The final arbitration result is output to the application business for response.

[0055] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which determines a first event corresponding to a gesture type, including: Step S601, collecting voice data of the object to be detected; Step S602, determining the voice command of the object to be detected according to the voice data; Step S603: determining a first event according to the voice instruction and the gesture type.

[0056] In this embodiment, voice data of the object to be detected is collected, wherein the voice data is voice data uttered by the object to be detected.

[0057] Exemplarily, the voice data may include a control voice of the object to be detected.

[0058] According to the voice data, a voice command of the object to be detected is determined, wherein the voice command is a command of the voice of the voice data.

[0059] Exemplarily, a speech recognition model is obtained, and speech data is recognized by the speech recognition model to obtain a voice instruction.

[0060] For example, the voice command may be a command to increase the volume of a stereo.

[0061] A first event is determined according to the voice command and the gesture type.

[0062] Exemplarily, a first candidate event is determined based on a voice instruction, and then a second candidate event is determined based on the gesture type. If the first candidate event and the second candidate event are different, the voice instruction is used as the basis, and the first candidate event is set as the first event.

[0063] In some embodiments, an embodiment of the present application provides a human-computer interaction method, which determines a first event corresponding to a gesture type, including: Step S601, collecting point cloud data of the object to be detected; Step S602, correcting and updating the gesture type according to the point cloud data to obtain an updated gesture type; Step S603: determining a first event according to the updated gesture type.

[0064] In this embodiment, point cloud data of the object to be detected is collected, wherein the point cloud data is point cloud data of the object to be detected.

[0065] Exemplarily, the vehicle may include a point cloud sensor, through which point cloud data of the object to be detected is collected.

[0066] According to the point cloud data, the gesture type is corrected and updated to obtain an updated gesture type.

[0067] Exemplarily, after the first video data is processed to obtain the gesture type of the object to be detected, the gesture type can be corrected according to the point cloud data to obtain an updated gesture type.

[0068] A first event is determined according to the updated gesture type.

[0069] In some embodiments, Figure 2 As shown, in an embodiment of the present application, a human-computer interaction system 1000 is provided, including: The data acquisition module 1002 is used to acquire first video data of the object to be detected.

[0070] In this embodiment, a human-computer interaction system 1000 is proposed. The human-computer interaction system 1000 is an operating system for human-computer interaction.

[0071] Exemplarily, the human-computer interaction system 1000 may be deployed inside an electric vehicle to facilitate passengers to control the electric vehicle.

[0072] The human-computer interaction system 1000 includes a data acquisition module 1002 , wherein the data acquisition module 1002 is a module for acquiring first video data of an object to be detected, the object to be detected is an object to be detected by the human-computer interaction system 1000 , and the first video data is video data of the object to be detected.

[0073] Exemplarily, the object to be detected may be a driver inside a car.

[0074] Exemplarily, the data acquisition module 1002 may acquire images of the object to be detected, and then integrate the images into first video data.

[0075] Exemplarily, the data acquisition module 1002 may include a camera.

[0076] The data processing module 1004 is in communication with the data acquisition module 1002 and is used to process the first video data to obtain the gesture type of the object to be detected.

[0077] The human-computer interaction system 1000 also includes a data processing module 1004, wherein the data processing module 1004 is used to process the data collected by the data acquisition module 1002. Specifically, the data processing module 1004 is used to process the first video data to obtain the gesture type of the object to be detected, where the gesture type is the type of the current gesture of the object to be detected.

[0078] Exemplarily, the first video data includes a hand image of the object to be detected, and the data processing module 1004 integrates a gesture recognition algorithm, which can perform type recognition on the hand image to obtain the gesture type of the object to be detected.

[0079] The event processing module 1006 is in communication with the data processing module 1004 and is used to determine a first event corresponding to the gesture type.

[0080] The human-computer interaction system 1000 also includes an event processing module 1006, which is in communication with the data processing module 1004 and can determine a first event that needs to be operated on the object to be detected according to the gesture type, wherein the first event is an operation event corresponding to the gesture type.

[0081] The data processing module 1004 includes a video processing module 10042 and a gesture recognition module 10044 .

[0082] Exemplarily, when the gesture type is the index finger and thumb being spread apart, the first event is an operation event of turning up the volume of a speaker.

[0083] For example, when the gesture type is an open index finger and thumb, the first event may be an operation event of increasing the volume of a speaker.

[0084] Exemplarily, when the gesture type is making a fist, the first event may be an operation event of closing the current application.

[0085] The business processing module 1008 is in communication with the event processing module 1006 and is configured to determine a first business application that responds to the first event.

[0086] The human-computer interaction system 1000 further includes a business processing module 1008 , which is in communication with the event processing module 1006 and can determine a first business application according to a first event, wherein the first business application is an application that responds to the first event.

[0087] Exemplarily, when the first event is an operation event of closing the current application, the first service application may be a control application of the audio system.

[0088] The application interaction module 1100 is in communication connection with the business processing module 1008 and is used to display a first event of execution of a first business application.

[0089] The human-computer interaction system 1000 also includes an application interaction module 1100, which is connected to the business processing module 1008 for displaying the first business application executing the first event. Exemplarily, the application interaction module 1100 may include a display screen, and the first business application is displayed on the display screen.

[0090] It should be noted that the system framework of the human-computer interaction system 1000 is formed based on the data acquisition module 1002, the data processing module 1004, the event processing module 1006, the business processing module 1008 and the application interaction module 1100. The framework improves the accurate human-computer interaction system 1000, improves the recognition accuracy of the human-computer interaction system 1000 for user gestures, and improves the operational convenience of the human-computer interaction system 1000. In addition, the extensible system framework expands the application scenarios of the human-computer interaction system 1000.

[0091] The human-computer interaction system 1000 in this embodiment is based on a complete and accurate system framework, which improves the recognition accuracy of the human-computer interaction system 1000 for user gestures, simplifies the interaction steps of the human-computer interaction system 1000, and improves the operational convenience of the human-computer interaction system 1000.

[0092] For example, Figure 3 As shown, the human-computer interaction system 1000 is composed of a platform, a local base library, a framework layer, a business arbitration processing center and an application layer.

[0093] In some embodiments, Figure 4As shown, a vehicle control device 1100 is proposed, and the vehicle control device 1100 includes a processor 1102 and a memory 1104. The memory 1104 stores a computer program, and when the computer program is executed by the processor 1102, the steps of the human-computer interaction method in any of the above embodiments are implemented. Therefore, the vehicle control device 1100 has all the beneficial effects of the human-computer interaction method in any of the above embodiments, which will not be repeated here.

[0094] In some embodiments, a readable storage medium is provided on which a program is stored. When the program is executed by a processor, the steps of the human-computer interaction method in any of the above embodiments are implemented, thereby having all the beneficial technical effects of the human-computer interaction method in any of the above embodiments.

[0095] In one embodiment of the present application, a vehicle is proposed, comprising: a human-computer interaction system as in any of the above embodiments, and / or a readable storage medium as in any of the above embodiments, and thus having all the beneficial technical effects of the human-computer interaction system as in any of the above embodiments, and / or the readable storage medium as in any of the above embodiments, and no further details will be given here.

[0096] It should be noted that in the above embodiments, the description of each embodiment has its own emphasis, and for parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0097] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may take the form of a computer program product implemented on one or more computer-readable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-readable program code.

[0098] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded computer, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0099] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0100] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0101] An embodiment of the present application further provides a computer program product, which includes computer software instructions. When the computer software instructions are executed on a processing device, the processing device executes a process of a human-computer interaction method.

[0102] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0103] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0104] In the several embodiments provided in the present application, it should be understood that the disclosed devices, apparatuses and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0105] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0106] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0107] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.

[0108] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

[0109] Although the preferred embodiments of this specification have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of this specification.

[0110] Obviously, those skilled in the art can make various changes and modifications to this specification without departing from the spirit and scope of this specification. Thus, if these modifications and variations of this specification fall within the scope of the claims of this specification and their equivalents, this specification is also intended to include these modifications and variations.

Claims

1. A human-computer interaction method, characterized in that: The method comprises: Collecting first video data of the object to be detected; Processing the first video data to obtain the gesture type of the object to be detected; Determining a first event corresponding to the gesture type, and determining a first service application that responds to the first event; The first event is displayed as being executed by the first service application.

2. The method according to claim 1, characterized in that The performing data processing on the first video data to obtain the gesture type of the object to be detected includes: Performing data processing on the first video data to obtain second video data; The second video data is processed for recognition to obtain the gesture type.

3. The method according to claim 1, characterized in that The determining a first event corresponding to the gesture type includes: Acquire a plurality of preset gestures and a plurality of preset events, wherein the plurality of preset gestures correspond to the plurality of preset events one by one; Determining a target gesture among the plurality of preset gestures according to the gesture type; The first event among the plurality of preset events is determined according to the target gesture.

4. The method according to claim 1, characterized in that: The method further comprises: Get multiple preset business applications; Determine, according to the first event, the first business application among the plurality of business applications; The first event is sent to the first service application.

5. The method according to claim 4, characterized in that After determining the first business application among the plurality of business applications according to the first event, the method further includes: Detecting the running status of the first service application; Determining the running priority of the first event according to the running status; The first event and the running priority are sent to a first service application.

6. The method according to any one of claims 1 to 5, characterized in that The determining a first event corresponding to the gesture type includes: Collecting voice data of the object to be detected; Determining a voice command of the object to be detected according to the voice data; The first event is determined according to the voice instruction and the gesture type.

7. The method according to any one of claims 1 to 5, characterized in that The determining a first event corresponding to the gesture type includes: Collecting point cloud data of the object to be detected; Correcting and updating the gesture type according to the point cloud data to obtain an updated gesture type; The first event is determined according to the updated gesture type.

8. A human-computer interaction device, characterized in that: include: processor; A memory, wherein a program or instruction is stored in the memory, and when the processor executes the program or instruction in the memory, the steps of the human-computer interaction method as described in any one of claims 1 to 7 are implemented.

9. A readable storage medium, characterized in that: The readable storage medium stores programs or instructions, and when the programs or instructions are executed by the processor, the steps of the vehicle interaction method as described in any one of claims 1 to 7 are implemented.

10. A vehicle, characterized in that: include: The human-computer interaction device as claimed in claim 8; and / or The readable storage medium as claimed in claim 9.

Images