Vehicle man-machine interaction method and device, electronic equipment and storage medium

Abstract

The invention provides a vehicle man-machine interaction method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a man-machine interaction instruction of a cabin position, generating a corresponding relation between the man-machine interaction instruction and a target cabin position which sends the man-machine interaction instruction, carrying out the instruction content recognition of the man-machine interaction instruction, and obtaining a target cabin position; determining a vehicle function to be played to the target cabin position according to the corresponding relation, acquiring passenger distribution of the cabin position and a current driving scene and / or passenger state of the vehicle, determining sound parameters of the vehicle function to be played to the target cabin position, and playing the sound parameters to the target cabin position. And controlling the directional sound production system to output the playing sound effect of the vehicle function to the target cabin position by adopting the sound parameters. According to the invention, the man-machine interaction instruction is identified and positioned, the sound parameters are dynamically adjusted, the directional sound production system is utilized to directionally output the playing sound effect of the vehicle function of each cabin position, and independent and differentiated man-machine interaction services are provided for passengers on different seats.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle human-computer interaction method, device, electronic device and storage medium. Background Art

[0002] With the development of smart cockpit technology, human-machine interaction (HMI) methods in modern vehicles are becoming increasingly diverse, with voice interaction becoming a key component. Voice interaction primarily communicates with drivers and passengers through in-car voice assistants, enabling control of vehicle functions such as navigation, music playback, and phone calls.

[0003] Currently, vehicle audio interaction typically covers the entire interior space. For example, when the driver uses voice control for navigation, the vehicle's system plays navigation instructions through the vehicle's speakers, and all passengers hear the same content. Similarly, if a passenger requests music, the sound is also output globally throughout the vehicle. However, this vehicle-based human-computer interaction method, with global audio input and output for the entire vehicle, cannot provide differentiated services for passengers in different seats and is difficult to meet the interaction needs of different passengers. Summary of the Invention

[0004] In view of this, the present application aims to propose a vehicle human-computer interaction method, device, electronic device and storage medium to solve the problem of global sound input and output for the entire vehicle, inability to provide differentiated services for passengers in different seats, and difficulty in meeting the interaction needs of different passengers.

[0005] According to a first aspect of the present application, a vehicle human-computer interaction method is provided, which is applied to a vehicle computer terminal, wherein the vehicle computer terminal is communicatively connected to a directional sound system configured at each cabin position of the vehicle, and the method includes: Acquiring a human-computer interaction instruction for the cockpit position, and generating a correspondence between the human-computer interaction instruction and a target cockpit position from which the human-computer interaction instruction is issued; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction; Identifying the content of the human-computer interaction command and determining the vehicle computer function to be played to the target cockpit position according to the corresponding relationship; Obtaining the occupant distribution at the cabin position, as well as the current driving scene and / or occupant status of the vehicle; Determining, based on the occupant distribution, the current driving scenario, and / or the occupant status, sound parameters of a vehicle-mounted function to be played to the target cockpit position; The directional sound system is controlled to output the playback sound effect of the vehicle function to the target cockpit position using the sound parameters.

[0006] Optionally, acquiring the human-computer interaction instruction for the cockpit position and generating a correspondence between the human-computer interaction instruction and the target cockpit position for issuing the human-computer interaction instruction includes: Monitoring the position of each cabin of the vehicle; In response to the collected cockpit position human-computer interaction instruction, identifying the location where the human-computer interaction instruction was issued, and determining the target cockpit position where the human-computer interaction instruction was issued; Generate a correspondence between the human-computer interaction instruction and the target cockpit position.

[0007] Optionally, the identifying the content of the human-computer interaction instruction and determining the vehicle-mounted function to be played to the target cockpit position according to the corresponding relationship includes: Performing command content recognition on the human-computer interaction command to obtain the command content of the human-computer interaction command, and determining the vehicle-computer function indicated by the command content; According to the vehicle computer function indicated by the instruction content and the corresponding relationship, the vehicle computer function to be played to the target cockpit position is determined.

[0008] Optionally, the performing instruction content recognition on the human-computer interaction instruction to obtain the instruction content of the human-computer interaction instruction and determining the vehicle-computer function indicated by the instruction content includes: If the human-computer interaction instruction is the voice interaction instruction, performing voice recognition on the voice interaction instruction to obtain instruction content of the voice interaction instruction and determine the indicated vehicle computer function; If the human-computer interaction instruction is the gesture interaction instruction, gesture recognition is performed on the gesture interaction instruction, and the indicated vehicle computer function is determined according to a preset mapping relationship between the vehicle computer function and the gesture.

[0009] Optionally, obtaining the occupant distribution in the cabin, and the current driving scene and / or occupant status of the vehicle includes: Acquiring vehicle position and environmental information, and identifying a current driving scene of the vehicle using the vehicle position and the environmental information; detecting a seat occupancy status of a vehicle cabin position, and determining an occupant distribution of the cabin position using the seat occupancy status; An image of the occupant in the cockpit is captured to obtain an occupant image, and the occupant status is identified using the occupant image.

[0010] Optionally, determining the sound parameters of the vehicle-mounted function to be played to the target cockpit position based on the occupant distribution, the current driving scene, and / or the occupant status includes: determining a sound field between the directional sound systems at the target cabin position based on the occupant distribution; According to the current driving scene and / or the passenger status, the sound parameters of the sound field are adjusted to obtain a target volume, a target frequency band, and a sound beam direction of the sound field.

[0011] Optionally, controlling the directional sound system to output the sound effect of the vehicle function to the target cockpit position using the sound parameters includes: monitoring interference sound waves between the sound fields of the directional sound emission system and filtering the interference sound waves; The directional sound system is controlled to output the playback sound effect of the vehicle function to the target cabin position using the target volume, target frequency band and sound beam direction.

[0012] According to a second aspect of the present application, a vehicle human-computer interaction device is provided, which is applied to a vehicle terminal, wherein the vehicle terminal is communicatively connected to a directional sound system configured at each cabin position of the vehicle, and the device includes: an instruction acquisition module, configured to acquire a human-computer interaction instruction for the cabin position and generate a correspondence between the human-computer interaction instruction and a target cabin position from which the human-computer interaction instruction is issued; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction; a command recognition module, configured to recognize the content of the human-computer interaction command and determine the vehicle-mounted function to be played to the target cockpit position according to the corresponding relationship; An information acquisition module, configured to acquire the occupant distribution in the cabin, as well as the current driving scene and / or occupant status of the vehicle; a parameter determination module, configured to determine, based on the occupant distribution, the current driving scenario, and / or the occupant status, sound parameters of the vehicle-mounted function to be played to the target cockpit position; The control output module is used to control the directional sound system to output the sound effect of the vehicle function to the target cockpit position using the sound parameters.

[0013] According to another aspect of the present application, an electronic device is provided, including: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the vehicle human-computer interaction method as described above.

[0014] According to another aspect of the present application, a readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps of the vehicle human-computer interaction method as described above are implemented.

[0015] The vehicle human-computer interaction method provided in the embodiment of the present application obtains human-computer interaction instructions at the cockpit position, generates a correspondence between the human-computer interaction instructions and the target cockpit position for issuing the human-computer interaction instructions, the human-computer interaction instructions including at least one of voice interaction instructions and gesture interaction instructions, identifies the instruction content of the human-computer interaction instructions, and determines the vehicle-computer function to be played to the target cockpit position based on the correspondence, obtains the occupant distribution at the cockpit position, and the current driving scene and / or occupant status of the vehicle, determines the sound parameters of the vehicle-computer function to be played to the target cockpit position based on the occupant distribution, and the current driving scene and / or occupant status, and controls the directional sound system to output the playback sound effects of the vehicle-computer function to the target cockpit position using the sound parameters. The embodiment of the present application identifies and locates various types of human-computer interaction instructions, determines the cabin position where the instructions are initiated, and accurately identifies the vehicle-machine functions that need to be played at each cabin position where the interaction instructions are initiated. It dynamically adjusts the sound parameters of the cabin sound field in combination with the status information of the vehicle and the occupants, and uses a directional sound system to directionally output the playback sound effects of the vehicle-machine functions to be executed at each cabin position, thereby realizing independent and differentiated human-computer interaction services for passengers in different seats, ensuring that the interactions between passengers in each seat are independent of each other, avoiding interaction interference and sound interference, and further meeting the interaction needs of different passengers.

[0016] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Various other advantages and benefits will become apparent to those skilled in the art upon reading the detailed description of the preferred embodiment below. The accompanying drawings are for illustration purposes only and are not to be considered as limiting the present application. The same reference symbols are used throughout the drawings to represent the same components. In the drawings: Figure 1 This is a flowchart of the steps of a vehicle human-computer interaction method provided by an embodiment of the present application; Figure 2 yes Figure 1 A flowchart of step 101 in a vehicle human-computer interaction method provided in an embodiment of the present application; Figure 3 yes Figure 1 A flowchart of step 102 in a vehicle human-computer interaction method provided in an embodiment of the present application; Figure 4 yes Figure 1 A flowchart of step 103 in a vehicle human-computer interaction method provided in an embodiment of the present application; Figure 5 yes Figure 1 A flowchart of step 104 in a vehicle human-computer interaction method provided in an embodiment of the present application; Figure 6 is a schematic diagram of a directional sound system in a vehicle human-computer interaction method provided by an embodiment of the present application; Figure 7 This is a schematic diagram of a scenario of a vehicle human-computer interaction method provided by an embodiment of the present application; Figure 8 This is a structural diagram of a vehicle human-computer interaction device provided in an embodiment of the present application; Figure 9 This is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, each embodiment of the present application will be described in detail below with reference to the accompanying drawings. However, it will be understood by those skilled in the art that in each embodiment of the present application, many technical details are proposed in order to enable the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solutions claimed in the present application can be implemented. The division of the following embodiments is for convenience of description and should not constitute any limitation on the specific implementation of the present application. The various embodiments can be combined with each other and referenced to each other under the premise of no contradiction.

[0019] Reference Figure 1 , shows a flowchart of the steps of the vehicle human-computer interaction method provided by an embodiment of the present application, which is applied to the vehicle terminal, and the vehicle terminal is communicatively connected to the directional sound system configured at each cabin position of the vehicle. The method may include: Step 101 : obtaining a human-computer interaction instruction of a cockpit position, and generating a correspondence between the human-computer interaction instruction and a target cockpit position for issuing the human-computer interaction instruction; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction.

[0020] In an embodiment of the present application, in order to solve the problem that the human-computer interaction mode based on the entire vehicle performs global sound input and output for the entire vehicle, cannot provide differentiated services for passengers in different seats, and is difficult to meet the interaction needs of different passengers, the embodiment of the present application uses a directional sound system configured in each cabin position of the vehicle to provide independent and non-interfering vehicle-computer functions to passengers in different cabin positions, thereby ensuring that the interactions between passengers in each seat are independent of each other, avoiding interaction interference and sound interference, and further meeting the interaction needs of different passengers.

[0021] It's important to note that when objects vibrate, they generate sound waves. Low-frequency sound waves typically propagate outward from the sound source. Sound waves audible to the human ear are low-frequency sound waves. Sound (audible to the human ear) propagates in all directions. In reality, as sound waves propagate, the sound pressure varies in each direction. By controlling and processing the sound source, it can be directed along a specific path, creating a directional sound source. Directional sound sources achieve directional propagation, propagating sound in a narrowband beam in a specified direction. This sends a "beam of sound," similar to the beam of light from a searchlight, so that only those in the direction covered by the beam can hear the sound.

[0022] Reference Figure 6 , showing a schematic diagram of a directional sound system in a vehicle human-computer interaction method provided by an embodiment of the present application. In the embodiment of the present invention, the directional sound system is arranged on the roof above the occupant's head and in the headrests of the front and rear seats, that is, the directional sound system includes a head directional sound system A and a headrest directional sound system B. Each position is covered by two directional sound systems, and the two sound systems at each position in the cabin are evenly equipped with an independent controller. The directional sound system devices for the driver's seat, the co-driver's seat, the left rear seat, and the right rear seat in the vehicle cabin are equipped with independent controllers. The controller can interact independently with the vehicle machine end in the cabin. It should be noted that the directional sound system can be a combination of a controller, a small speaker, and a microphone array, which is installed on the seat back or the headrest, and can emit sound in a specific direction to prevent the sound from spreading to other areas.

[0023] Specifically, refer to Figure 7, shows a scenario diagram of a vehicle human-computer interaction method provided by an embodiment of the present application, wherein each cabin position in the vehicle is equipped with two directional sound systems, each cabin position has a separate directional sound system controller, and the in-vehicle infotainment system on the vehicle side (In-Vehicle Infotainment The IVI (In-Vehicle Infotainment) system allows for interactive control of various locations. The in-vehicle infotainment system utilizes a dedicated onboard central processor (CPU), a vehicle bus system, and internet services to form a comprehensive in-vehicle information processing system. In this embodiment, an independent switch interface is provided on the in-vehicle display screen to select the interaction mode. These modes include normal interaction mode and independent interaction mode. The driver or passenger can select the vehicle interaction mode on their respective cockpit displays. The in-vehicle infotainment system features a master control switch for controlling the interaction mode. Normal interaction mode is the normal interaction mode under normal circumstances. Sound within the vehicle is not directional, and all passengers receive the same sound. In independent interaction mode, sound within the vehicle is directional, and the front passenger and rear passengers can independently use the control screen to control their entertainment preferences. Only entertainment applications from the vehicle computer functions, such as navigation, music, and video, are available on the front passenger and rear passenger control screens. Other vehicle control functions are only accessible to the driver on the IVI. This embodiment uses the independent interaction mode as an example.

[0024] In this embodiment, the vehicle-mounted computer communicates with a directional sound system located at each cabin position. The vehicle-mounted infotainment system receives human-computer interaction commands from each cabin position and generates a correspondence between the human-computer interaction commands and the target cabin position from which the commands were issued. The human-computer interaction commands include at least one of voice interaction commands and gesture interaction commands. Specifically, the vehicle-mounted computer monitors each cabin position for interaction commands. When a human-computer interaction command is detected from a cabin position, the computer identifies the location from which the command was issued and determines the target cabin position from which the command was issued. A correspondence between the human-computer interaction command and the target cabin position is generated for subsequent use, where the target cabin position is the cabin position from which the command was issued.

[0025] It should be noted that in this embodiment, the human-computer interaction instructions include at least one of voice interaction instructions and gesture interaction instructions. The cabin can be monitored in real time by sensors distributed at various cabin positions of the vehicle to monitor and identify voice interaction instructions or gesture interaction instructions, which will not be elaborated one by one here.

[0026] Step 102 : Identify the content of the human-computer interaction command and determine the vehicle computer function to be played to the target cockpit position based on the corresponding relationship.

[0027] In an embodiment of the present application, after monitoring and acquiring a human-computer interaction instruction, it is necessary to clarify the vehicle-machine function that the occupant needs to execute, identify the instruction content, determine the vehicle-machine function indicated by the instruction, and determine the vehicle-machine function to be played to the target cockpit position based on the corresponding relationship. Specifically, the instruction content of the human-computer interaction instruction is identified to obtain the instruction content of the human-computer interaction instruction, determine the vehicle-machine function indicated by the instruction content, and then determine the vehicle-machine function to be played to the target cockpit position based on the vehicle-machine function indicated by the instruction content and the corresponding relationship. It should be noted that the vehicle-machine function includes functions that can be executed on the vehicle-machine display screen and the cockpit domain display screen, such as display screen functions such as navigation, music playback, and video playback.

[0028] Step 103 : Obtain the occupant distribution in the cabin, as well as the current driving scene and / or occupant status of the vehicle.

[0029] In an embodiment of the present application, in order to meet the human-computer interaction needs in different driving scenarios and passenger states, the distribution of passengers in the cockpit position, as well as the current driving scenario and / or passenger state of the vehicle, is obtained to dynamically adjust the playback effect of the vehicle-mounted function. In this embodiment, it is necessary to obtain the distribution of passengers in the cockpit position, as well as the current driving scenario and / or passenger state of the vehicle. For example, when driving the vehicle, the driver may only need to pay attention to the navigation voice, but when the passenger in the co-pilot seat or the back row wants to play other music or other entertainment operations, the directional sound system will prevent the instructions between different passengers from interfering with each other, and the interaction of each cockpit position is relatively independent. Specifically, the directional sound system in the driver's seat can play the navigation voice first, while the directional sound system in the co-pilot seat or the back row can play other music without interfering with each other.

[0030] Specifically, the current driving scene of the vehicle is obtained by acquiring the vehicle position and environmental information and using vehicle position and environmental information recognition. The occupant distribution at the cabin position is determined by detecting the seat occupancy status at the vehicle's cabin position and using the seat occupancy status. The occupant status is obtained by acquiring images of the occupants at the cabin position and using occupant image recognition.

[0031] Step 104 : Determine the sound parameters of the vehicle computer function to be played to the target cockpit position based on the occupant distribution, the current driving scene and / or the occupant status.

[0032] In an embodiment of the present application, based on the acquired occupant distribution, the current driving scene and / or the occupant status, the sound parameters of the vehicle-mounted function to be played to the target cockpit position are dynamically adjusted and determined. Specifically, based on the occupant distribution, the sound field between the directional sound systems at the target cockpit position is determined, and then based on the current driving scene and / or the occupant status, the sound parameters of the sound field are adjusted to obtain the sound parameters of the vehicle-mounted function to be played to the target cockpit position, wherein the sound parameters include volume, frequency band and sound beam direction.

[0033] Specifically, the system can determine the sound field between the directional sound systems at the target cabin location based on the detected occupant distribution within the vehicle cabin. This field ensures that each occupant at the target cabin location clearly receives the sound output relevant to them, while preventing sounds from other cabin locations from interfering with other occupants. The sound field's acoustic parameters are then dynamically adjusted based on the current driving scenario and occupant status to optimize the sound output.

[0034] Step 105 : Control the directional sound system to output the sound effects of the vehicle computer function to the target cockpit position using the sound parameters.

[0035] In an embodiment of the present invention, after determining the sound field layout and sound parameters of the target cabin position, the in-vehicle infotainment system on the vehicle side controls the directional sound system to achieve the playback sound effect output of the vehicle function at the target cabin position, while monitoring and processing the interference sound waves between the sound fields to ensure the accuracy and comfort of the sound output.

[0036] The vehicle human-computer interaction method provided in the embodiment of the present application obtains human-computer interaction instructions at the cockpit position, generates a correspondence between the human-computer interaction instructions and the target cockpit position for issuing the human-computer interaction instructions, the human-computer interaction instructions including at least one of voice interaction instructions and gesture interaction instructions, identifies the instruction content of the human-computer interaction instructions, and determines the vehicle-computer function to be played to the target cockpit position based on the correspondence, obtains the occupant distribution at the cockpit position, and the current driving scene and / or occupant status of the vehicle, determines the sound parameters of the vehicle-computer function to be played to the target cockpit position based on the occupant distribution, and the current driving scene and / or occupant status, and controls the directional sound system to output the playback sound effects of the vehicle-computer function to the target cockpit position using the sound parameters. The embodiment of the present application identifies and locates various types of human-computer interaction instructions, determines the cabin position where the instructions are initiated, and accurately identifies the vehicle-machine functions that need to be played at each cabin position where the interaction instructions are initiated. It dynamically adjusts the sound parameters of the cabin sound field in combination with the status information of the vehicle and the occupants, and uses a directional sound system to directionally output the playback sound effects of the vehicle-machine functions to be executed at each cabin position, thereby realizing independent and differentiated human-computer interaction services for passengers in different seats, ensuring that the interactions between passengers in each seat are independent of each other, avoiding interaction interference and sound interference, and further meeting the interaction needs of different passengers.

[0037] Further, refer to Figure 2 , showing Figure 1 A flowchart of step 101 in a vehicle human-computer interaction method is provided. This method is basically the same as the vehicle human-computer interaction method provided in the first embodiment of the present application. Step 101 may include: Step 1011, monitoring the position of each cabin of the vehicle; Step 1012, in response to the collected cockpit position human-computer interaction instruction, identifying the location where the human-computer interaction instruction was issued, and determining the target cockpit position where the human-computer interaction instruction was issued; Step 1013: Generate a correspondence between the human-computer interaction instruction and the target cockpit position.

[0038] It should be noted that in the embodiment of the present invention, the cockpit is monitored in real time by sensors distributed at various cockpit positions of the vehicle to monitor whether interaction instructions are generated at various cockpit positions of the vehicle. The sensors can be devices such as microphones and cameras, which are used to capture human-computer interaction instructions such as voice and gestures issued by the occupants at the cockpit positions. In this embodiment, microphone arrays and cameras can be installed at the driver's seat, co-pilot seat, rear left seat and rear right seat respectively to monitor the voice and gesture signals at these cockpit positions in real time.

[0039] Specifically, when a human-machine interaction command is detected from a certain cockpit location, the location of the human-machine interaction command is identified through sensor data, and the target cockpit location is determined. For example, if the driver's seat microphone captures a voice interaction command, the interaction command is identified as coming from the driver's seat; if the rear left seat camera captures a gesture interaction command, the gesture is identified as coming from the rear left seat. Specifically, the location of the voice interaction command is identified through the microphone's location information and the volume of the voice interaction command, and the location of the gesture interaction command is identified through the location of the camera that detects the gesture interaction information.

[0040] In this embodiment, after determining the location from which the human-computer interaction command was issued, a correspondence between the human-computer interaction command and the target cockpit position is generated, where the target cockpit position is the cockpit position from which the human-computer interaction command was issued. For example, if a voice interaction command "Navigate to Location A" is detected from the driver's seat and the voice interaction command is identified as originating from the driver's seat, a correspondence between the human-computer interaction command and the target cockpit position is generated: "Driver's Seat - Navigate to Location A." This correspondence is stored in a cache for subsequent use.

[0041] The embodiments of the present invention ensure that each interaction command can establish a clear correspondence with the issuance location by identifying the issuance location of the human-computer interaction command, thereby distinguishing the interaction commands at different cabin locations, avoiding misidentification and command conflicts when multiple passengers issue commands, and improving the accuracy of interaction command processing.

[0042] Further, refer to Figure 3 , showing Figure 1 A flowchart of step 102 in a vehicle human-computer interaction method is provided. This method is substantially the same as the vehicle human-computer interaction method provided in the first embodiment of the present application. Step 102 may include: Step 1021 , performing command content recognition on the human-computer interaction command, obtaining the command content of the human-computer interaction command, and determining the vehicle-computer function indicated by the command content.

[0043] Step 1022 : Determine the vehicle computer function to be played to the target cockpit position according to the vehicle computer function indicated by the instruction content and the corresponding relationship.

[0044] It should be noted that in an embodiment of the present invention, after obtaining a human-computer interaction command, the command content is first recognized to determine the vehicle-mounted function indicated by the command. Specifically, the command content is parsed through voice recognition or gesture recognition and mapped to the vehicle-mounted function to determine the vehicle-mounted function indicated by the command content. After determining the vehicle-mounted function indicated by the command content, the generated human-computer interaction command is combined with the corresponding relationship between the generated human-computer interaction command and the target cabin location to determine the vehicle-mounted function to be played to the target cabin location. Vehicle-mounted functions include functions executable on the vehicle-mounted display screen and the cabin-domain display screen, such as navigation, music playback, video playback, and other display screen functions. Specifically, if the human-computer interaction command is a voice interaction command, voice recognition is performed on the voice interaction command to obtain the command content of the voice interaction command and determine the indicated vehicle-mounted function. If the human-computer interaction command is a gesture interaction command, gesture recognition is performed on the gesture interaction command. Based on the preset mapping relationship between vehicle-mounted function and gesture, the indicated vehicle-mounted function is determined. By recognizing the command content of the voice interaction command or gesture interaction command, the vehicle-mounted function required by the user is accurately identified. For example, if the recognized voice interaction command content is "Navigate to the company" and the corresponding relationship is "Driver's seat - Navigate to the company", it is determined that the navigation function needs to be played to the driver's seat.

[0045] The embodiment of the present invention accurately identifies the vehicle computer functions required by the user by recognizing the command content of voice interaction commands or gesture interaction commands, and determines the cabin position to which the vehicle computer functions need to be output based on the correspondence between the interaction commands and the target cabin position, ensuring that occupants in each seat position can obtain personalized interactive responses.

[0046] Specifically, step 1021 performs command content recognition on the human-computer interaction command to obtain the command content of the human-computer interaction command and determine the vehicle computer function indicated by the command content, including: If the human-computer interaction instruction is the voice interaction instruction, performing voice recognition on the voice interaction instruction to obtain instruction content of the voice interaction instruction and determine the indicated vehicle computer function; If the human-computer interaction instruction is the gesture interaction instruction, gesture recognition is performed on the gesture interaction instruction, and the indicated vehicle computer function is determined according to a preset mapping relationship between the vehicle computer function and the gesture.

[0047] It should be noted that in the above steps, when it is detected that the human-computer interaction command is a voice interaction command, the voice command is parsed by the voice recognition function, the command content is extracted, and the indicated vehicle function is determined based on the command content; when it is detected that the human-computer interaction command is a gesture interaction command, the gesture interaction command is parsed by the gesture recognition function, and the indicated vehicle function is determined based on a preset mapping relationship between vehicle functions and gestures. The mapping relationship between vehicle functions and gestures is pre-set and can be adjusted according to vehicle functions and user interaction requirements, and is not specifically limited here. In this embodiment, when multiple passengers issue commands simultaneously, the in-vehicle infotainment system on the vehicle side can process voice interaction commands and gesture interaction commands separately to ensure that each passenger can obtain an independent functional response.

[0048] For example, if the driver's microphone detects the voice interaction command "Navigate to the company," the voice interaction command is processed through the voice recognition function and parsed as "Navigate to the company." Based on the command content "Navigate to the company," the indicated vehicle function is determined to be "navigation." If the camera on the left rear seat detects the passenger's gesture interaction command, the gesture in the gesture interaction command is recognized and, based on the mapping relationship between vehicle function and gesture, the indicated vehicle function is determined. For example, if the user extends their finger to make an "OK" gesture, the in-cabin vehicle function mapped to the gesture is playing music, which is not specifically limited here.

[0049] The human-computer interaction of the vehicle-computer function in the embodiment of the present invention supports two interaction modes: voice and gesture, providing personalized functional responses. After receiving the voice or gesture command, the vehicle-computer end can quickly parse the command content and accurately determine the indicated vehicle-computer function, thereby improving the interaction efficiency and recognition accuracy.

[0050] Further, refer to Figure 4 , showing Figure 1 A flowchart of step 103 in a vehicle human-computer interaction method is provided. This method is substantially the same as the vehicle human-computer interaction method provided in the first embodiment of the present application. Step 103 may include: Step 1031: Acquire vehicle location and environment information, and use the vehicle location and environment information to identify the current driving scene of the vehicle; Step 1032 , detecting the seat occupancy status of the vehicle's cabin position, and determining the occupant distribution of the cabin position using the seat occupancy status; Step 1033 : Capture images of the occupants in the cockpit to obtain occupant images, and use the occupant images to identify the occupant status.

[0051] It should be noted that in an embodiment of the present invention, in order to combine the directional sound system with the dynamic sound field adjustment for use in the cockpit, according to the actual distribution of the passengers in the car and the requirements of interactive instructions, combined with the current driving scene of the vehicle and the status of the passengers, the direction and volume of the car-machine functions played by each directional sound system are dynamically adjusted to ensure that the passengers in each cockpit position can clearly receive the required car-machine functions, while avoiding the sound interference caused by the interaction needs between passengers. This embodiment obtains the current driving scene of the vehicle, the distribution of passengers in the cockpit position and the status of the passengers, so as to subsequently dynamically adjust the sound parameters of the car-machine functions played by each directional sound system, where the sound parameters include volume, frequency band and sound beam direction.

[0052] Specifically, the vehicle position and environmental information are obtained, and the vehicle's current driving scene is identified using the vehicle's position and environmental information. The vehicle's position and environmental information are obtained through the vehicle's built-in sensors (such as GPS, cameras, etc.), and the vehicle's current driving scene is identified based on the vehicle's position and environmental information. For example, if the vehicle's position and environmental information indicate that the vehicle is currently on a city road, the current driving scene is identified as "city road driving."

[0053] In this embodiment, the seat occupancy status of the vehicle's cabin position is detected, and the seat occupancy status is used to determine the occupant distribution in the cabin position. The seat occupancy status of the cabin position is detected by seat sensors (such as pressure sensors, weight sensors, etc.), and the occupant distribution is determined based on the seat occupancy status. For example, if the driver's seat is occupied by a user, it is determined that there is an occupant in the driver's seat, and the left rear seat is not occupied by a user, then it is determined that there is no occupant in the left rear seat. Based on the seat occupancy status, the occupant distribution is determined as there is an occupant in the driver's seat, there is an occupant in the right rear seat, and there is no occupant in the left rear seat.

[0054] In this embodiment, images of occupants in the cabin are captured to obtain occupant images, which are then used to identify occupant status. Cameras distributed throughout the cabin capture images of the occupants and use image recognition technology to identify their status. Specifically, the cameras capture images of the driver and passengers, and their status is identified by analyzing their facial expressions and posture. For example, if the occupant image shows the driver with their eyes closed and their head tilted, the driver's status is identified as "fatigue." If the occupant image shows a rear passenger smiling and looking at the screen, the rear passenger's status is identified as "relaxed." By monitoring the driver's status in real time, the system can identify whether the driver is fatigued or distracted, and promptly issue warnings or adjust function outputs to reduce driving risks. During driving, the system prioritizes driver interaction commands and dynamically adjusts vehicle-mounted computer function outputs based on the driver's status to ensure driving safety. When the driver is tired or distracted, refreshing sound effects with strong rhythm and exciting melodies will be automatically played to relieve the driver's fatigue without disturbing other passengers in the car. Or when a dangerous warning situation occurs, such as triggering a front collision warning or blind spot warning, the alarm sound will automatically cover the entire cabin and increase the sound pressure level to alert the passengers in the car.

[0055] The embodiments of the present invention utilize driving scene recognition, occupant distribution detection, and occupant status recognition to dynamically adjust the output of vehicle computer functions according to vehicle driving conditions and occupant status, ensuring that each occupant can obtain an independent functional response while providing a functional response that adapts to the scenario.

[0056] Further, refer to Figure 5 , showing Figure 1 A flowchart of step 104 in a vehicle human-computer interaction method is provided. This method is substantially the same as the vehicle human-computer interaction method provided in the first embodiment of the present application. Step 104 may include: Step 1041 , determining the sound field between the directional sound systems at the target cockpit location based on the occupant distribution; Step 1042 : Adjust the sound parameters of the sound field according to the current driving scene and / or passenger status to obtain the target volume, target frequency band, and sound beam direction of the sound field.

[0057] It should be noted that in embodiments of the present invention, the sound field between the directional sound systems at the target cabin location is determined based on the detected occupant distribution at the vehicle cabin location. This sound field is used to ensure that each occupant at the target cabin location can clearly receive the sound output relevant to them, while preventing sounds from other cabin locations from interfering with other occupants. For example, if the occupant distribution is detected as occupant in the driver's seat, occupant in the right rear seat, and no occupant in the left rear seat, then, based on the occupant distribution, the sound field between the directional sound systems at the target cabin location is determined such that the directional sound system in the driver's seat is responsible for outputting sound to the driver's seat, the directional sound system in the right rear seat is responsible for outputting sound to the right rear seat, and the directional sound system in the left rear seat is disabled to prevent sound interference.

[0058] In this embodiment, the sound parameters of the sound field are dynamically adjusted according to the current driving scene and passenger status to optimize the sound output effect. Specifically, the sound parameters of the sound field are adjusted according to the current driving scene and / or passenger status to obtain the target volume, target frequency band and sound beam direction of the sound field. For example, if the current driving scene is identified as "highway driving", the driver's status is "fatigue", and the rear passenger status is "relaxed", the in-vehicle infotainment system on the vehicle side adjusts the sound parameters of the sound field according to the driving scene and passenger status, adjusts the target volume of the driver's seat to a medium volume, and ensures that the target volume of the driver's seat is at a moderate level. To ensure that the driver can clearly hear the navigation prompts and refreshing music, the target volume of the right rear seat is a lower volume to avoid disturbing the driver while providing a comfortable entertainment experience for the rear passengers. The target frequency band of the driver's seat is medium and high frequencies to highlight the clarity of navigation prompts and refreshing music. The target frequency band of the right rear seat is medium and low frequencies to provide soothing background music and enhance the relaxation experience of the rear passengers. The sound beam direction of the driver's seat is straight ahead to ensure that the sound is directly transmitted to the driver's ears. The sound beam direction of the right rear seat is the right rear seat area to ensure that the sound is only transmitted to the rear passengers to avoid disturbing other passengers.

[0059] In some embodiments, an independent audio-visual space can be formed by dynamically adjusting the sound field. For example, the rear passenger selects the content to be played through the car computer, the left rear passenger chooses to play a movie, and the right rear passenger chooses to play music. The left sound field will be adjusted to focus on the dialogue frequency band in the film and television, and directionally enhance the dialogue sound in the 1000-4000Hz range. The left passenger can hear the dialogue content in the movie more comfortably and clearly, thereby improving the comfort of the passenger experience. At the same time, the volume is intelligently balanced. When the volume difference between the left and right seats is detected to be greater than a certain decibel, the overflow sound waves are automatically suppressed to prevent interference to the passenger on the right who is listening to music.

[0060] The embodiments of the present invention dynamically adjust the sound field layout according to the distribution of occupants, accurately transmit the sound to the target cabin position, ensure that each occupant can clearly receive the sound output related to them, avoid sound interference with other occupants, improve the clarity and audibility of the sound, and can dynamically adjust the sound parameters according to the current driving scene and occupant status to provide users with a personalized interactive experience.

[0061] Specifically, step 105 controls the directional sound system to output the sound effects of the vehicle function to the target cockpit position using sound parameters, including: Monitor the interference sound waves between the sound fields of the directional sound system and filter the interference sound waves; The directional sound control system uses the target volume, target frequency band and sound beam direction to output the playback sound effects of the vehicle function to the target cabin position.

[0062] It should be noted that in the above steps, after determining the sound field layout and sound parameters of the target cabin position, the directional sound system is controlled to realize the playback sound effect output of the vehicle function, while monitoring and processing the interference sound waves between the sound fields to ensure the accuracy and comfort of the sound output.

[0063] Specifically, the system monitors the interference sound waves between the sound fields of the directional sound systems, filters the interference sound waves, and controls the directional sound system to output the sound effects of the vehicle computer functions to the target cockpit position based on the determined target volume, target frequency band, and sound beam direction. The system monitors the interference sound waves between the directional sound systems in real time and uses sound wave filtering technology to process the interference sound waves to ensure that the sound output of each cockpit position is not interfered with by other sound fields. For example, if it is detected that the navigation prompt sound output by the directional sound system at the driver's seat overlaps with the music sound waves output by the directional sound system at the rear right seat, the interference sound waves are processed through sound wave filtering. The rear music sound waves in the driver's seat sound field are filtered to ensure that the driver only hears the navigation prompt sound, and the navigation prompt sound waves in the rear right seat are filtered to ensure that the rear passengers only hear the music sound.

[0064] The embodiment of the present invention uses a directional sound system to accurately transmit sound to the target cabin position, preventing the sound from spreading to other areas. It also monitors the interference sound waves between sound fields in real time, processes the interference sound waves, and ensures that the sound output at each cabin position is not interfered with by other sound fields.

[0065] In some embodiments, the vehicle human-computer interaction method provided by the present application supports multiple scenarios, such as family travel scenarios, business car scenarios, and self-driving tour scenarios. For example, in the family car scenario, it can ensure that each family member can enjoy audio content suitable for them. For example, the driver can focus on the navigation voice to ensure driving safety; the co-pilot passenger can close his eyes and rest or listen to light music to relax; and the children in the back seat can watch cartoons or listen to children's songs and enjoy a pleasant journey. The cabin directional sound system can effectively avoid interference between different audio content and enhance the harmony and comfort of family travel. In the business car scenario, the driver can focus on navigation information to ensure that the driving route is accurate; colleagues in the co-pilot seat can participate in video conferences and handle work affairs; and colleagues in the back seat can answer important calls and conduct business communications. The cabin directional sound system provides each passenger with an independent audio space, ensuring the smooth progress of business activities while also improving work efficiency. In the self-driving tour scenario, it brings a more diverse and private listening experience to passengers. When friends travel together, everyone may have different preferences. Some need a quiet rest environment, while others want to enjoy passionate music. Through the cabin directional sound system, each passenger can adjust the audio content and volume according to their own needs to achieve a personalized listening experience; it not only enhances the fun of self-driving tours, but also enhances the comfort between passengers.

[0066] Reference Figure 8 , shows a schematic structural diagram of a vehicle human-computer interaction device provided by an embodiment of the present application, which is applied to a vehicle terminal, wherein the vehicle terminal is communicatively connected to a directional sound system configured at each cabin position of the vehicle, and the device includes: An instruction acquisition module 201 is configured to acquire a human-computer interaction instruction for the cabin position and generate a correspondence between the human-computer interaction instruction and the target cabin position from which the human-computer interaction instruction is issued; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction; The instruction recognition module 202 is used to identify the instruction content of the human-computer interaction instruction and determine the vehicle function to be played to the target cockpit position according to the corresponding relationship; An information acquisition module 203 is used to acquire the occupant distribution in the cabin, as well as the current driving scene and / or occupant status of the vehicle; a parameter determination module 204 for determining sound parameters of a vehicle-mounted function to be played to the target cockpit position based on the occupant distribution, the current driving scene, and / or the occupant status; The control output module 205 is used to control the directional sound system to output the playing sound effect of the vehicle function to the target cockpit position using the sound parameters.

[0067] Furthermore, the instruction acquisition module 201 includes: A monitoring submodule, configured to monitor the position of each cabin of the vehicle; a first identification submodule, configured to, in response to a human-computer interaction instruction of a cockpit position being collected, identify a location where the human-computer interaction instruction is issued, and determine a target cockpit position where the human-computer interaction instruction is issued; The generating submodule is used to generate a corresponding relationship between the human-computer interaction instruction and the target cockpit position.

[0068] Furthermore, the instruction recognition module 202 includes: A second identification submodule is configured to identify the content of the human-computer interaction instruction, obtain the content of the human-computer interaction instruction, and determine the vehicle-computer function indicated by the content of the instruction; The first determining submodule is configured to determine the vehicle computer function to be played to the target cockpit position according to the vehicle computer function indicated by the instruction content and the corresponding relationship.

[0069] Furthermore, the second identification submodule includes: a first recognition unit, configured to, if the human-computer interaction instruction is the voice interaction instruction, perform voice recognition on the voice interaction instruction, identify the instruction content of the voice interaction instruction, and determine the indicated vehicle function; The second recognition unit is configured to perform gesture recognition on the gesture interaction instruction if the human-computer interaction instruction is the gesture interaction instruction, and determine the indicated vehicle computer function according to a preset mapping relationship between the vehicle computer function and the gesture.

[0070] Furthermore, the information acquisition module 203 includes: An acquisition submodule, configured to acquire vehicle position and environmental information, and identify a current driving scene of the vehicle using the vehicle position and environmental information; a detection submodule, configured to detect a seat occupancy status of a vehicle cabin position, and determine an occupant distribution of the cabin position using the seat occupancy status; The acquisition submodule is used to acquire images of the occupants in the cockpit to obtain occupant images, and identify the occupant status using the occupant images.

[0071] Furthermore, the parameter determination module 204 includes: a second determining submodule, configured to determine the sound field between the directional sound systems at the target cockpit position according to the occupant distribution; The adjustment submodule is used to adjust the sound parameters of the sound field according to the current driving scene and / or the passenger status to obtain the target volume, target frequency band and sound beam direction of the sound field.

[0072] Furthermore, the control output module 205 includes: a filtering submodule, configured to monitor interference sound waves between the sound fields of the directional sound emission system and filter the interference sound waves; The control submodule is used to control the directional sound system to output the playback sound effect of the vehicle function to the target cabin position using the target volume, target frequency band and sound beam direction.

[0073] The vehicle human-computer interaction device provided in the embodiment of the present application obtains human-computer interaction instructions at the cockpit position, generates a correspondence between the human-computer interaction instructions and the target cockpit position from which the human-computer interaction instructions are issued, the human-computer interaction instructions including at least one of voice interaction instructions and gesture interaction instructions, identifies the instruction content of the human-computer interaction instructions, and determines the vehicle-computer function to be played to the target cockpit position based on the correspondence, obtains the occupant distribution at the cockpit position, and the current driving scene and / or occupant status of the vehicle, determines the sound parameters of the vehicle-computer function to be played to the target cockpit position based on the occupant distribution, and the current driving scene and / or occupant status, and controls the directional sound system to output the playback sound effects of the vehicle-computer function to the target cockpit position using the sound parameters. The embodiment of the present application identifies and locates various types of human-computer interaction instructions, determines the cabin position where the instructions are initiated, and accurately identifies the vehicle-machine functions that need to be played at each cabin position where the interaction instructions are initiated. It dynamically adjusts the sound parameters of the cabin sound field in combination with the status information of the vehicle and the occupants, and uses a directional sound system to directionally output the playback sound effects of the vehicle-machine functions to be executed at each cabin position, thereby realizing independent and differentiated human-computer interaction services for passengers in different seats, ensuring that the interactions between passengers in each seat are independent of each other, avoiding interaction interference and sound interference, and further meeting the interaction needs of different passengers.

[0074] Reference Figure 9 , the embodiment of the present application also provides an electronic device, such as Figure 9 As shown, it includes a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor 301, the communication interface 302, and the memory 303 communicate with each other through the communication bus 304. Processor 301, memory 303 for storing processor-executable instructions; The processor 301 is configured to execute the instructions to implement the vehicle human-computer interaction method described below: Acquiring a human-computer interaction instruction for the cockpit position, and generating a correspondence between the human-computer interaction instruction and a target cockpit position from which the human-computer interaction instruction is issued; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction; Identifying the content of the human-computer interaction command and determining the vehicle computer function to be played to the target cockpit position according to the corresponding relationship; Obtaining the occupant distribution at the cabin position, as well as the current driving scene and / or occupant status of the vehicle; Determining, based on the occupant distribution, the current driving scenario, and / or the occupant status, sound parameters of a vehicle-mounted function to be played to the target cockpit position; The directional sound system is controlled to output the playback sound effect of the vehicle function to the target cockpit position using the sound parameters.

[0075] The communication bus mentioned in the terminal above can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into address buses, data buses, control buses, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0076] The communication interface is used for communication between the above terminal and other devices.

[0077] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0078] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0079] In another embodiment provided in the present application, a computer-readable storage medium is also provided, on which a computer program is stored. When the computer program is executed by a processor, the vehicle human-computer interaction method described in any of the above embodiments is implemented.

[0080] In the above embodiments, all or part of the embodiments can be implemented using software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, hard disk, tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0081] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0082] Each embodiment in this specification is described in a related manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiment is generally similar to the method embodiment, so the description is relatively simple. For related parts, refer to the description of the method embodiment.

[0083] The above description is only a preferred embodiment of the present application and is not intended to limit the scope of protection of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application are included in the scope of protection of the present application.

Claims

1. A vehicle human-computer interaction method, characterized in that: Applied to a vehicle terminal, the vehicle terminal is communicatively connected to a directional sound system configured at each cabin position of the vehicle, and the method includes: Acquiring a human-computer interaction instruction for the cockpit position, and generating a correspondence between the human-computer interaction instruction and a target cockpit position from which the human-computer interaction instruction is issued; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction; Identifying the content of the human-computer interaction command and determining the vehicle computer function to be played to the target cockpit position according to the corresponding relationship; Obtaining the occupant distribution at the cabin position, as well as the current driving scene and / or occupant status of the vehicle; Determining, based on the occupant distribution, the current driving scenario, and / or the occupant status, sound parameters of a vehicle-mounted function to be played to the target cockpit position; The directional sound system is controlled to output the playback sound effect of the vehicle function to the target cockpit position using the sound parameters.

2. The method according to claim 1, characterized in that The acquiring of the human-computer interaction instruction for the cockpit position and generating a correspondence between the human-computer interaction instruction and the target cockpit position for issuing the human-computer interaction instruction include: Monitoring the position of each cabin of the vehicle; In response to the collected cockpit position human-computer interaction instruction, identifying the location where the human-computer interaction instruction was issued, and determining the target cockpit position where the human-computer interaction instruction was issued; Generate a correspondence between the human-computer interaction instruction and the target cockpit position.

3. The method according to claim 1, characterized in that The identifying the content of the human-computer interaction instruction and determining the vehicle function to be played to the target cockpit position according to the corresponding relationship includes: Performing command content recognition on the human-computer interaction command to obtain the command content of the human-computer interaction command, and determining the vehicle-computer function indicated by the command content; According to the vehicle computer function indicated by the instruction content and the corresponding relationship, the vehicle computer function to be played to the target cockpit position is determined.

4. The method according to claim 3, characterized in that The performing instruction content recognition on the human-computer interaction instruction to obtain the instruction content of the human-computer interaction instruction and determining the vehicle-computer function indicated by the instruction content includes: If the human-computer interaction instruction is the voice interaction instruction, performing voice recognition on the voice interaction instruction to obtain instruction content of the voice interaction instruction and determine the indicated vehicle computer function; If the human-computer interaction instruction is the gesture interaction instruction, gesture recognition is performed on the gesture interaction instruction, and the indicated vehicle computer function is determined according to a preset mapping relationship between the vehicle computer function and the gesture.

5. The method according to claim 1, wherein The obtaining of the occupant distribution in the cockpit position, and the current driving scene and / or occupant status of the vehicle includes: Acquiring vehicle position and environmental information, and identifying a current driving scene of the vehicle using the vehicle position and the environmental information; detecting a seat occupancy status of a vehicle cabin position, and determining an occupant distribution of the cabin position using the seat occupancy status; An image of the occupant in the cockpit is captured to obtain an occupant image, and the occupant status is identified using the occupant image.

6. The method according to claim 1, characterized in that The determining, based on the occupant distribution, the current driving scenario, and / or the occupant status, of sound parameters of the vehicle-mounted function to be played to the target cockpit position includes: determining a sound field between the directional sound systems at the target cabin position based on the occupant distribution; According to the current driving scene and / or the passenger status, the sound parameters of the sound field are adjusted to obtain a target volume, a target frequency band, and a sound beam direction of the sound field.

7. The method according to claim 6, characterized in that The controlling the directional sound system to output the sound effect of the vehicle function to the target cockpit position using the sound parameters includes: monitoring interference sound waves between the sound fields of the directional sound emission system and filtering the interference sound waves; The directional sound system is controlled to output the playback sound effect of the vehicle function to the target cabin position using the target volume, target frequency band and sound beam direction.

8. A vehicle human-computer interaction device, characterized in that: Applied to the vehicle terminal, the vehicle terminal is communicatively connected to the directional sound system configured at each cabin position of the vehicle, and the device includes: an instruction acquisition module, configured to acquire a human-computer interaction instruction for the cabin position and generate a correspondence between the human-computer interaction instruction and a target cabin position from which the human-computer interaction instruction is issued; wherein the human-computer interaction instruction includes at least one of a voice interaction instruction and a gesture interaction instruction; a command recognition module, configured to recognize the content of the human-computer interaction command and determine the vehicle-mounted function to be played to the target cockpit position according to the corresponding relationship; An information acquisition module, configured to acquire the occupant distribution in the cabin, as well as the current driving scene and / or occupant status of the vehicle; a parameter determination module, configured to determine, based on the occupant distribution, the current driving scenario, and / or the occupant status, sound parameters of the vehicle-mounted function to be played to the target cockpit position; The control output module is used to control the directional sound system to output the sound effect of the vehicle function to the target cockpit position using the sound parameters.

9. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the instructions to implement the vehicle human-computer interaction method according to any one of claims 1 to 7.

10. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the vehicle human-computer interaction method according to any one of claims 1 to 7 is implemented.

Images