Intelligent cabin vehicle self-service voice interaction method, device, equipment and storage medium

Abstract

The application discloses an intelligent cabin vehicle self-service voice interaction method and device, equipment and storage medium, the method receives user voice instruction and carries out voiceprint identification, determines the user identity identifier, acquires the historical behavior data corresponding to the user identity identifier;When the historical behavior data meets the preset self-service trigger condition, the default execution instruction is generated and enters the preset waiting period, and whether there is a breaking instruction is monitored in the preset waiting period;According to the breaking monitoring result and time state in the preset waiting period, the default execution instruction is determined or the normal voice interaction process is turned in;The number of multi-round voice interactions in the driving scene can be significantly reduced to reduce the distraction risk, and the preset waiting period and the breaking instruction monitoring mechanism are combined to provide the opportunity for instant intervention for the user, so that the safety hidden danger caused by the misoperation is effectively avoided while the voice interaction efficiency and convenience are improved, and the balance between automatic execution and user control right is realized.

Description

Technical Field

[0001] This invention relates to the field of in-vehicle intelligent voice interaction technology, and in particular to an intelligent cockpit in-vehicle self-service voice interaction method, device, equipment and storage medium. Background Technology

[0002] With the rapid development of automotive intelligent technology, in-vehicle voice interaction systems have become a standard feature of smart cockpits, providing users with a convenient voice control experience, enabling drivers to control functions such as navigation, multimedia playback, and air conditioning adjustment through voice commands.

[0003] However, in existing in-vehicle voice interaction technologies, when users issue voice commands involving complex intentions or specific parameter selections, the system often cannot determine the final execution plan in one go. Instead, it needs to enter a multi-round dialogue process to guide the user to make multiple confirmations or selections.

[0004] This multi-turn interaction method can occupy a lot of the driver's attention while the vehicle is in motion, causing the driver's gaze to deviate from the road or increase cognitive load, thus bringing significant driving safety hazards and affecting the practicality and safety of the in-vehicle voice system in driving scenarios. Summary of the Invention

[0005] The main objective of this invention is to provide a smart cockpit in-vehicle self-service voice interaction method, device, equipment, and storage medium, aiming to solve the technical problem that in-vehicle voice interaction in complex scenarios causes driver distraction and thus poses a significant safety hazard.

[0006] In a first aspect, the present invention provides an in-vehicle self-service voice interaction method for an intelligent cockpit, the in-vehicle self-service voice interaction method comprising the following steps: Receive user voice commands and perform voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity. When the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. At the same time, during the preset waiting period, it is monitored whether there is an interruption instruction. Based on the interruption monitoring results and time status within the preset waiting period, determine the interaction flow to execute the default execution command or switch to regular voice.

[0007] Optionally, the step of receiving user voice commands and performing voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity includes: The system receives voice command signals from users in real time through an in-vehicle audio acquisition device, and preprocesses the voice command signals to extract unique voiceprint feature information. The voiceprint feature information is compared and matched with a pre-registered and stored voiceprint model library to determine the identity of the user who issued the command. Based on the user identity identifier, retrieve and retrieve historical behavior data associated with the user identity identifier from local storage unit or cloud server.

[0008] Optionally, when the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. Simultaneously, during the preset waiting period, it is monitored whether an interruption instruction exists, including: Determine the intent in the historical behavioral data Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service triggering conditions; In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction; The system uses in-vehicle voice prompts and a floating UI window on the display screen to indicate the upcoming operation and the remaining waiting time. The voice monitoring module is continuously activated to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption command.

[0009] Optionally, the determination of intent in the historical behavior data Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service trigger conditions, including: Filter out historical operation records that belong to the same intent category as the user's voice command from the historical behavior data; The cumulative number of occurrences of the historical operation records within a preset time window is counted to obtain the operation frequency. Calculate the proportion of records in the historical operation log where the same target option was selected out of the total number of records to obtain the desired result. Figure 1 Conformity ratio; When the operation frequency is greater than or equal to a preset operation frequency threshold, and the intention... Figure 1 When the consistency ratio is greater than or equal to a preset consistency ratio threshold, the historical behavior data is determined to meet the preset self-service triggering conditions.

[0010] Optionally, the meaning in the intention Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction, including: In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, historical operation records in the historical behavior data that belong to the same intent category as the user's voice command are filtered out. Count the cumulative number of times each candidate option was selected in the historical operation records; By comparing the cumulative counts, the candidate option with the highest cumulative count is determined as the target option with the highest frequency of occurrence; The execution parameters corresponding to the target option are encapsulated into default execution instructions.

[0011] Optionally, the step of determining whether to execute the default execution command or switch to regular voice based on the interruption monitoring results and time status within the preset waiting period includes: During the preset waiting period, the remaining duration is tracked in real time and the audio input stream is analyzed synchronously to determine whether preset interruption keywords or subsequent voice commands occur. If the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated, and the system switches to a multi-turn dialogue mode to respond to the user's intervention request. If no interruption command is detected after the preset waiting period expires, it is determined that the user has agreed by default, the function module corresponding to the default execution command is automatically triggered, and the execution result is fed back through voice or interface after the default execution command is executed.

[0012] Optionally, after determining whether to execute the default execution command or switch to regular voice interaction based on the interruption monitoring results and time status within the preset waiting period, the intelligent cockpit in-vehicle self-service voice interaction method further includes: Collect behavioral data from this interaction, associate this behavioral data with the user's identity identifier, and update the intention data in the historical behavioral data. Figure 1 Inconsistency ratio and operation frequency.

[0013] Secondly, to achieve the above objectives, the present invention also proposes an intelligent cockpit in-vehicle self-service voice interaction device, the intelligent cockpit in-vehicle self-service voice interaction device comprising: The data acquisition module is used to receive user voice commands and perform voiceprint recognition to determine the user's identity and acquire the historical behavior data corresponding to the user's identity. The instruction generation module is used to generate a default execution instruction and enter a preset waiting period when the historical behavior data meets the preset self-service triggering conditions, and at the same time monitor whether there is an interruption instruction during the preset waiting period. The interactive execution module is used to determine the interactive process of executing the default execution command or switching to regular voice based on the interruption monitoring results and time status within the preset waiting period.

[0014] Thirdly, to achieve the above objectives, the present invention also proposes an intelligent cockpit in-vehicle self-service voice interaction device, the intelligent cockpit in-vehicle self-service voice interaction device comprising: a memory, a processor, and an intelligent cockpit in-vehicle self-service voice interaction program stored in the memory and executable on the processor, the intelligent cockpit in-vehicle self-service voice interaction program being configured to implement the steps of the intelligent cockpit in-vehicle self-service voice interaction method described above.

[0015] Fourthly, to achieve the above objectives, the present invention also proposes a storage medium storing an intelligent cockpit in-vehicle self-service voice interaction program, wherein when the intelligent cockpit in-vehicle self-service voice interaction program is executed by a processor, it implements the steps of the intelligent cockpit in-vehicle self-service voice interaction method described above.

[0016] The intelligent cockpit in-vehicle self-service voice interaction method proposed in this invention receives user voice commands and performs voiceprint recognition to determine the user's identity and obtain historical behavior data corresponding to the user's identity. When the historical behavior data meets preset self-service triggering conditions, a default execution command is generated and a preset waiting period is entered. Simultaneously, during the preset waiting period, the system monitors for interruption commands. Based on the interruption monitoring results and time status during the preset waiting period, the system determines whether to execute the default execution command or switch to regular voice interaction. This method can accurately determine the user's identity and retrieve corresponding historical behavior data through voiceprint recognition, automatically generating a default execution command when the preset self-service triggering conditions are met. This significantly reduces the number of multi-round voice interactions in driving scenarios, thus reducing the risk of distraction. Combined with the preset waiting period and interruption command monitoring mechanism, it provides users with opportunities for immediate intervention, thereby improving the efficiency and convenience of voice interaction while effectively avoiding safety hazards caused by misoperation, achieving a balance between automated execution and user control. Attached Figure Description

[0017] Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of the present invention; Figure 2 This is a flowchart illustrating the first embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention; Figure 3 This is a flowchart illustrating the second embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention; Figure 4 This is a flowchart illustrating the third embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention; Figure 5 This is a flowchart illustrating the fourth embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention; Figure 6 This is a flowchart illustrating the fourth embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention; Figure 7 This is a schematic diagram of the voice self-service selection process of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention; Figure 8 This is a functional block diagram of the first embodiment of the intelligent cockpit vehicle-mounted self-service voice interaction device of the present invention.

[0018] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0019] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0020] The solution of this invention mainly involves: receiving user voice commands and performing voiceprint recognition to determine the user's identity and obtaining historical behavior data corresponding to the user's identity; when the historical behavior data meets preset self-service triggering conditions, generating a default execution command and entering a preset waiting period, while monitoring for interruption commands during the preset waiting period; and determining whether to execute the default execution command or switch to regular voice interaction based on the interruption monitoring results and time status during the preset waiting period. This solution can accurately determine the user's identity and call the corresponding historical behavior data through voiceprint recognition, automatically generating a default execution command when the preset self-service triggering conditions are met, thereby significantly reducing the number of multi-round voice interactions in driving scenarios to reduce the risk of distraction. Combined with the preset waiting period and interruption command monitoring mechanism, it provides users with opportunities for immediate intervention, thereby improving the efficiency and convenience of voice interaction while effectively avoiding safety hazards caused by misoperation, achieving a balance between automated execution and user control, and solving the technical problem in existing technologies where in-vehicle voice interaction in complex scenarios causes driver distraction and poses significant safety hazards.

[0021] Reference Figure 1 , Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of the present invention.

[0022] like Figure 1As shown, the device may include: a processor 1001, such as a CPU; a communication bus 1002; a user interface 1003; a network interface 1004; and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen or an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be high-speed RAM or non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0023] Those skilled in the art will understand that Figure 1 The device structure shown does not constitute a limitation on the device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0024] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating device, a network communication module, a user interface module, and an intelligent cockpit in-vehicle self-service voice interaction program.

[0025] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and performs the following operations: Receive user voice commands and perform voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity. When the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. At the same time, during the preset waiting period, it is monitored whether there is an interruption instruction. Based on the interruption monitoring results and time status within the preset waiting period, determine the interaction flow to execute the default execution command or switch to regular voice.

[0026] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and also performs the following operations: The system receives voice command signals from users in real time through an in-vehicle audio acquisition device, and preprocesses the voice command signals to extract unique voiceprint feature information. The voiceprint feature information is compared and matched with a pre-registered and stored voiceprint model library to determine the identity of the user who issued the command. Based on the user identity identifier, retrieve and retrieve historical behavior data associated with the user identity identifier from local storage unit or cloud server.

[0027] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and also performs the following operations: Determine the intent in the historical behavioral data Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service triggering conditions; In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction; The system uses in-vehicle voice prompts and a floating UI window on the display screen to indicate the upcoming operation and the remaining waiting time. The voice monitoring module is continuously activated to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption command.

[0028] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and also performs the following operations: Filter out historical operation records that belong to the same intent category as the user's voice command from the historical behavior data; The cumulative number of occurrences of the historical operation records within a preset time window is counted to obtain the operation frequency. Calculate the proportion of records in the historical operation log where the same target option was selected out of the total number of records to obtain the desired result. Figure 1 Conformity ratio; When the operation frequency is greater than or equal to a preset operation frequency threshold, and the intention... Figure 1 When the consistency ratio is greater than or equal to a preset consistency ratio threshold, the historical behavior data is determined to meet the preset self-service triggering conditions.

[0029] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and also performs the following operations: In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, historical operation records in the historical behavior data that belong to the same intent category as the user's voice command are filtered out. Count the cumulative number of times each candidate option was selected in the historical operation records; By comparing the cumulative counts, the candidate option with the highest cumulative count is determined as the target option with the highest frequency of occurrence; The execution parameters corresponding to the target option are encapsulated into default execution instructions.

[0030] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and also performs the following operations: During the preset waiting period, the remaining duration is tracked in real time and the audio input stream is analyzed synchronously to determine whether preset interruption keywords or subsequent voice commands occur. If the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated, and the system switches to a multi-turn dialogue mode to respond to the user's intervention request. If no interruption command is detected after the preset waiting period expires, it is determined that the user has agreed by default, the function module corresponding to the default execution command is automatically triggered, and the execution result is fed back through voice or interface after the default execution command is executed.

[0031] The device of this invention calls the intelligent cockpit in-vehicle self-service voice interaction program stored in the memory 1005 through the processor 1001, and also performs the following operations: Collect behavioral data from this interaction, associate this behavioral data with the user's identity identifier, and update the intention data in the historical behavioral data. Figure 1 Inconsistency ratio and operation frequency.

[0032] This embodiment, through the above-described scheme, receives user voice commands and performs voiceprint recognition to determine the user's identity and obtains the historical behavior data corresponding to the user's identity. When the historical behavior data meets preset self-service triggering conditions, a default execution command is generated and a preset waiting period is entered. Simultaneously, during the preset waiting period, the system monitors for interruption commands. Based on the interruption monitoring results and time status during the preset waiting period, the system determines whether to execute the default execution command or switch to a regular voice interaction flow. This approach accurately identifies the user and retrieves corresponding historical behavior data through voiceprint recognition, automatically generating a default execution command when preset self-service triggering conditions are met. This significantly reduces the number of multi-round voice interactions in driving scenarios, mitigating the risk of distraction. Furthermore, the combination of the preset waiting period and interruption command monitoring mechanism provides users with opportunities for immediate intervention. This improves the efficiency and convenience of voice interaction while effectively avoiding safety hazards caused by misoperation, achieving a balance between automated execution and user control.

[0033] Based on the above hardware structure, an embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention is proposed.

[0034] Reference Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention.

[0035] In the first embodiment, the intelligent cockpit in-vehicle self-service voice interaction method includes the following steps: Step S10: Receive user voice commands and perform voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity.

[0036] It should be noted that the uniqueness of voiceprint features is used to identify the current user, determine the user's identity, and obtain the historical behavior data corresponding to the user's identity. This provides an accurate data foundation for subsequent self-service trigger judgments based on personal habits and avoids the situation of habit data confusion when multiple people share a vehicle.

[0037] Step S20: When the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. At the same time, during the preset waiting period, it is monitored whether there is an interruption instruction.

[0038] It should be understood that after confirming that the user's historical behavior data meets the pre-set automation triggering criteria, the expected default execution instruction is generated first, but it does not take effect immediately. Instead, it enters a reserved buffer period, i.e., a preset waiting period. During this period, the system continuously monitors whether the user issues an intervention instruction and reserves the user's right to final confirmation or cancellation through a delayed execution mechanism, so as to balance the convenience of automation with the security of operation.

[0039] Step S30: Based on the interruption monitoring results and time status within the preset waiting period, determine the interaction flow of executing the default execution command or switching to regular voice.

[0040] Understandably, the final decision is made based on two key states: whether an interruption command is detected within the preset waiting period and whether the waiting time has expired. This determines whether to execute the default execution command or switch to the regular voice interaction process.

[0041] This embodiment, through the above-described scheme, receives user voice commands and performs voiceprint recognition to determine the user's identity and obtains the historical behavior data corresponding to the user's identity. When the historical behavior data meets preset self-service triggering conditions, a default execution command is generated and a preset waiting period is entered. Simultaneously, during the preset waiting period, the system monitors for interruption commands. Based on the interruption monitoring results and time status during the preset waiting period, the system determines whether to execute the default execution command or switch to a regular voice interaction flow. This approach accurately identifies the user and retrieves corresponding historical behavior data through voiceprint recognition, automatically generating a default execution command when preset self-service triggering conditions are met. This significantly reduces the number of multi-round voice interactions in driving scenarios, mitigating the risk of distraction. Furthermore, the combination of the preset waiting period and interruption command monitoring mechanism provides users with opportunities for immediate intervention. This improves the efficiency and convenience of voice interaction while effectively avoiding safety hazards caused by misoperation, achieving a balance between automated execution and user control.

[0042] Furthermore, Figure 3 This is a flowchart illustrating the second embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention, as shown below. Figure 3 As shown, based on the first embodiment, a second embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention is proposed. In this embodiment, step S10 specifically includes the following steps: Step S11: Receive the voice command signal issued by the user in real time through the vehicle-mounted audio acquisition device, and preprocess the voice command signal to extract unique voiceprint feature information.

[0043] It should be noted that the vehicle-mounted audio acquisition equipment can capture the user's original sound signal in real time, and after preprocessing to remove environmental interference, it can extract voiceprint information that can uniquely represent the user's individual biometrics, thereby realizing personalized voice interaction services.

[0044] Step S12: Compare and match the voiceprint feature information with the pre-registered and stored voiceprint model library to determine the identity of the user who issued the current command.

[0045] Understandably, the extracted voiceprint feature information is compared and verified with the pre-stored registered voiceprint models in the system. The matching results are used to confirm the specific identity of the current speaker, thereby generating a unique user identity identifier.

[0046] Step S13: Based on the user identity identifier, retrieve and retrieve historical behavior data associated with the user identity identifier from the local storage unit or cloud server.

[0047] It should be understood that by using a defined user identity as a retrieval index, historical behavioral data bound to that identity can be searched and retrieved in local storage units or cloud servers, ensuring that the system can accurately obtain personalized habit data of a specific user.

[0048] This embodiment, through the above-described scheme, receives voice command signals issued by the user in real time via an in-vehicle audio acquisition device, and preprocesses the voice command signals to extract unique voiceprint feature information. The voiceprint feature information is then compared and matched with a pre-registered and stored voiceprint model library to determine the identity of the user issuing the command. Based on the user identity, historical behavior data associated with the user identity is retrieved from local storage or a cloud server. This allows for the real-time extraction of unique voiceprint feature information by the in-vehicle audio acquisition device and comparison with the pre-stored voiceprint model library to accurately pinpoint the current user identity. Furthermore, based on this identity, historical behavior data strictly associated with the user is retrieved locally or from the cloud, effectively distinguishing different users in the vehicle to avoid confusion of habitual data. This ensures that subsequent self-service triggering logic is executed based on accurate personal habitual data, providing a reliable data foundation for personalized intelligent voice interaction.

[0049] Furthermore, Figure 4 This is a flowchart illustrating the third embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention, as shown below. Figure 4 As shown, based on the first embodiment, a third embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention is proposed. In this embodiment, step S20 specifically includes the following steps: Step S21: Determine the intent in the historical behavior data. Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service triggering conditions.

[0050] It should be noted that the acquisition of historical behavior data is quantitatively evaluated by calculating the proportion of users selecting the same target option in past operations and the cumulative number of operations to determine whether the user's usage habits of the command have sufficient stability and frequency. The core purpose is to verify the credibility of automated execution in the current scenario.

[0051] Furthermore, step S21 specifically includes the following steps: Filter out historical operation records that belong to the same intent category as the user's voice command from the historical behavior data; The cumulative number of occurrences of the historical operation records within a preset time window is counted to obtain the operation frequency. Calculate the proportion of records in the historical operation log where the same target option was selected out of the total number of records to obtain the desired result. Figure 1 Conformity ratio; When the operation frequency is greater than or equal to a preset operation frequency threshold, and the intention... Figure 1 When the consistency ratio is greater than or equal to a preset consistency ratio threshold, the historical behavior data is determined to meet the preset self-service triggering conditions.

[0052] It should be understood that by filtering historical operation records that belong to the same intent category as the current voice command, the cumulative number of occurrences within a preset time window is counted to obtain the operation frequency, and the proportion of records that selected the same target option to the total number of records is calculated to obtain the intent. Figure 1 Consistency ratio, followed by the frequency of the operation and intention Figure 1 The consistency ratios are compared with preset thresholds.

[0053] Step S22, in the intention Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction.

[0054] Understandably, given that the user's historical behavior meets the requirements of stability and frequency, the target option that has been selected the most times can be selected from past records as the optimal solution and set as the default execution command.

[0055] Furthermore, step S22 specifically includes the following steps: In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, historical operation records in the historical behavior data that belong to the same intent category as the user's voice command are filtered out. Count the cumulative number of times each candidate option was selected in the historical operation records; By comparing the cumulative counts, the candidate option with the highest cumulative count is determined as the target option with the highest frequency of occurrence; The execution parameters corresponding to the target option are encapsulated into default execution instructions.

[0056] It should be noted that, upon confirming the intention Figure 1 Provided that the consistency ratio and operation frequency meet the preset self-service triggering conditions, operation records of the same category as the current voice command are filtered from historical behavior data. User preferences are quantified by counting the cumulative number of selections of each candidate option. The candidate option with the highest cumulative number of selections is locked as the target option with the highest frequency of occurrence, and its corresponding execution parameters are encapsulated as the default execution command. Based on the highest frequency selection in the user's historical habits, the current intention can be accurately predicted, thereby generating the default execution plan that best matches the user's preferences, reducing the operation cost of secondary confirmation for the user, and realizing intelligent default recommendation based on personal habits.

[0057] Step S23: The operation to be performed and the remaining waiting time are prompted through the vehicle's voice broadcast and the floating UI window on the display screen.

[0058] It should be understood that during the preset waiting period, the user is given real-time feedback on the specific operation to be automatically executed and the remaining time before execution ends through both voice broadcast and the floating UI window on the display screen.

[0059] Step S24: Continuously activate the voice monitoring module to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption.

[0060] Understandably, keeping the voice monitoring module active during the preset waiting period, capturing and analyzing user voice input in real time to identify specific cancel keywords or interrupt commands, ensures that users can stop the automated process by voice at any time before the default command is officially executed.

[0061] This embodiment, through the above-described scheme, determines the intent within the historical behavioral data. Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service triggering conditions; in the intended Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution command; the upcoming operation content and remaining waiting time are prompted through in-vehicle voice broadcast and display UI floating window; the voice monitoring module is continuously activated to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption command, which can be achieved through intention... Figure 1 The dual verification of consistency ratio and operation frequency ensures the reliability of self-service triggering conditions. The target option with the highest frequency is determined as the default execution command to achieve accurate prediction of user habits, thereby significantly reducing the number of multi-round interactions in driving scenarios. At the same time, the dual prompt mechanism of in-vehicle voice broadcast and display UI floating window, as well as the monitoring of interruption commands during the waiting period, ensure that users have full knowledge and the right to intervene in time before the automation is executed. This improves the efficiency and convenience of voice interaction while effectively avoiding safety hazards caused by misoperation, and achieves a balance between automated execution and user control.

[0062] Furthermore, Figure 5 This is a flowchart illustrating the fourth embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention, as shown below. Figure 5 As shown, based on the first embodiment, a fourth embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention is proposed. In this embodiment, step S30 specifically includes the following steps: Step S31: Track the remaining duration in real time and analyze the audio input stream synchronously during the preset waiting period to determine whether a preset interruption keyword or subsequent voice command appears.

[0063] It should be noted that performing time status tracking and audio stream analysis tasks simultaneously within the preset waiting period ensures the flexibility and security of the interaction process, preventing the inability to promptly stop the automated process when user intervention is required.

[0064] Step S32: When the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated, and the process is switched to a multi-turn dialogue mode to respond to the user's intervention request.

[0065] Understandably, if a user's interruption command is detected before the preset waiting period expires, the current waiting timer process is immediately stopped, and the interaction state is switched to a multi-turn dialogue mode. This respects the user's real-time intervention wishes and ensures that the user can promptly stop the automated execution and re-engage in detailed interaction when they find that the default command does not meet their current needs.

[0066] Step S33: If no interruption command is detected after the preset waiting period expires, it is determined that the user agrees by default, the function module corresponding to the default execution command is automatically triggered, and the execution result is fed back through voice or interface after the default execution command is executed.

[0067] It should be understood that when the preset waiting period expires and the system does not detect any interruption command, it is regarded as the user's silent consent. The corresponding function module of the default execution command will be automatically triggered to complete the operation, and the execution result will be fed back through voice or interface after the execution is completed.

[0068] This embodiment, through the above-described scheme, tracks the remaining time in real time and analyzes the audio input stream synchronously within the preset waiting period to determine whether a preset interruption keyword or subsequent voice command appears. If the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated, and a multi-turn dialogue mode is switched to respond to the user's intervention request. If no interruption command is detected by the end of the preset waiting period, it is determined that the user has defaulted to consent, and the functional module corresponding to the default execution command is automatically triggered. After the default execution command is executed, the execution result is fed back through voice or interface. By tracking the remaining time in real time and analyzing the audio input stream synchronously within the preset waiting period, the system can accurately identify the user's intervention intent. Thus, it can immediately terminate the waiting process and switch to a multi-turn dialogue mode when an interruption command is detected, or automatically trigger a default execution command and feed back the result when no interruption command is detected by the end of the waiting period. This ensures that the user has the right to stop the automated process at any time, achieving seamless execution without secondary confirmation. This significantly reduces the interaction complexity and distraction risk in driving scenarios, effectively balancing the safety between automated execution efficiency and user control.

[0069] Furthermore, Figure 6This is a flowchart illustrating the fourth embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention, as shown below. Figure 6 As shown, based on the first embodiment, a fourth embodiment of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention is proposed. In this embodiment, after step S30, the intelligent cockpit in-vehicle self-service voice interaction method further includes the following steps: Step S40: Collect the behavioral data of this interaction, associate the behavioral data of this interaction with the user identity identifier, and update the intention in the historical behavioral data. Figure 1 Inconsistency ratio and operation frequency.

[0070] It should be noted that the behavioral data generated from this interaction is collected and bound to a defined user identity for storage. Simultaneously, the intent in historical behavioral data is recalculated and updated based on this data. Figure 1 The consistency ratio and operation frequency enable the system to dynamically adjust the self-service trigger judgment criteria according to the user's latest usage habits.

[0071] In the specific implementation, see Figure 7 , Figure 7 This is a schematic diagram of the voice self-service selection process of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention, as shown below. Figure 7 As shown, the voice self-service selection process is as follows: 1. User initiates voice command Example: Could you order me a Starbucks and deliver it to my office? 2. Obtain user ID through user voiceprint Note: The historical behavior records of this patent all rely on the user's registered voiceprint. 3. Determine if there is a significant amount of user behavior data to analyze regarding this behavior. If it is (Y): Proceed to the next step of judgment. If not (N): Execute the normal process and record user behavior for later analysis. Note: This patent sets a threshold, for example, if a single user engages in the same behavior more than ten times, it will be considered as valid user behavior analysis. 4. Determine if more than 80% of user behaviors are consistent choices. If (Y): Enable voice self-service selection If not (N): Execute the normal process and record user behavior for later analysis. 5. Voice-activated self-service selection of execution details For consistent user selections, maintain a 5-10 second countdown based on the content length, and automatically proceed to the next step via voice broadcast and UI floating window display; Users can also interrupt at any time using voice commands such as "Let me think about it" to return to the normal process.

[0072] It should be noted that the beneficial effects of this embodiment include: Safety and efficiency: Simplifies in-vehicle voice interaction steps, reduces driver distraction, and improves operational safety in driving scenarios; Intelligent personalization: Based on the analysis of historical behavioral data bound to voiceprints, it accurately identifies user habits and provides highly consistent default selections; User-friendly experience: 5-10 second countdown + dual voice / UI prompts, supports voice interruption to switch to regular processes, balancing efficiency and flexibility; Data iteration: Continuously accumulates user behavior data, gradually optimizes the accuracy of self-service selection judgment, and achieves long-term intelligent upgrades; Accurate identity: Voiceprint recognition is bound to a unique user ID, avoiding data confusion and ensuring the accuracy of personalized services; Easy deployment and adaptation: Based on the optimization of existing in-vehicle voice systems, no additional hardware modifications are required, adapting to the development trend of intelligent cockpits.

[0073] This embodiment, through the above-described scheme, collects behavioral data from the current interaction, associates this behavioral data with the user's identity identifier, and updates the intention data in the historical behavioral data. Figure 1 The consistency ratio and operation frequency can be analyzed by collecting behavioral data from this interaction and associating it with user identity identifiers, thereby updating the historical behavioral data in real time. Figure 1 By adjusting the consistency ratio and operation frequency, a data closed-loop iteration mechanism is formed, enabling the system to dynamically adjust the self-service trigger judgment criteria according to the latest user habits. This ensures that the self-service recommendation strategy remains accurate and timely as user habits change, reflects the system's self-learning ability, avoids model aging or misjudgment due to changes in user habits, and achieves continuous optimization of personalized services.

[0074] Accordingly, the present invention further provides an intelligent cockpit in-vehicle self-service voice interaction device.

[0075] Reference Figure 8 , Figure 8 This is a functional block diagram of the first embodiment of the intelligent cockpit vehicle-mounted self-service voice interaction device of the present invention.

[0076] In a first embodiment of the intelligent cockpit in-vehicle self-service voice interaction device of the present invention, the intelligent cockpit in-vehicle self-service voice interaction device includes: The data acquisition module 10 is used to receive user voice commands and perform voiceprint recognition to determine the user's identity and acquire the historical behavior data corresponding to the user's identity.

[0077] The instruction generation module 20 is used to generate a default execution instruction and enter a preset waiting period when the historical behavior data meets the preset self-service triggering conditions, and at the same time monitor whether there is an interruption instruction during the preset waiting period.

[0078] The interactive execution module 30 is used to determine the interactive process of executing the default execution command or switching to regular voice based on the interruption monitoring results and time status during the preset waiting period.

[0079] The data acquisition module 10 is further configured to receive voice command signals issued by the user in real time through the vehicle-mounted audio acquisition device, and preprocess the voice command signals to extract unique voiceprint feature information; compare and match the voiceprint feature information with a pre-registered and stored voiceprint model library to determine the identity of the user who issued the command; and retrieve and retrieve historical behavior data associated with the user identity from the local storage unit or cloud server based on the user identity.

[0080] The instruction generation module 20 is also used to determine the intent in the historical behavior data. Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service triggering conditions; in the intended Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution command; the operation content to be executed and the remaining waiting time are prompted through the in-vehicle voice broadcast and the UI floating window on the display screen; the voice monitoring module is continuously activated to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption command.

[0081] The instruction generation module 20 is further configured to: filter historical operation records from the historical behavior data that belong to the same intent category as the user's voice instruction; count the cumulative number of occurrences of the historical operation records within a preset time window to obtain the operation frequency; and calculate the proportion of records in the historical operation records that select the same target option to the total number of records to obtain the intent. Figure 1 Consistency ratio; when the operation frequency is greater than or equal to a preset operation frequency threshold, and the intention Figure 1 When the consistency ratio is greater than or equal to a preset consistency ratio threshold, the historical behavior data is determined to meet the preset self-service triggering conditions.

[0082] The instruction generation module 20 is also used in the intention Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the historical operation records in the historical behavior data that belong to the same intent category as the user's voice command are filtered out; the cumulative number of times each candidate option in the historical operation records is selected is counted; the cumulative number of times is compared, and the candidate option with the largest cumulative number of times is determined as the target option with the highest frequency of occurrence; the execution parameters corresponding to the target option are encapsulated as a default execution instruction.

[0083] The interactive execution module 30 is also used to track the remaining time in real time and analyze the audio input stream synchronously during the preset waiting period to determine whether a preset interruption keyword or subsequent voice command appears; when the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated and the multi-turn dialogue mode is switched to respond to the user's intervention needs; when no interruption command is detected after the preset waiting period expires, it is determined that the user agrees by default, the function module corresponding to the default execution command is automatically triggered, and the execution result is fed back through voice or interface after the default execution command is executed.

[0084] The interaction execution module 30 is further configured to collect behavioral data of the current interaction, associate the behavioral data of the current interaction with the user identity identifier, and update the intention in the historical behavioral data. Figure 1 Inconsistency ratio and operation frequency.

[0085] The steps for implementing each functional module of the intelligent cockpit in-vehicle self-service voice interaction device can be referred to in the various embodiments of the intelligent cockpit in-vehicle self-service voice interaction method of the present invention, and will not be repeated here.

[0086] Furthermore, this embodiment of the invention also proposes a storage medium storing an intelligent cockpit in-vehicle self-service voice interaction program. When the intelligent cockpit in-vehicle self-service voice interaction program is executed by a processor, it performs the following operations: Receive user voice commands and perform voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity. When the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. At the same time, during the preset waiting period, it is monitored whether there is an interruption instruction. Based on the interruption monitoring results and time status within the preset waiting period, determine the interaction flow to execute the default execution command or switch to regular voice.

[0087] Furthermore, when the intelligent cockpit in-vehicle self-service voice interaction program is executed by the processor, it also performs the following operations: The system receives voice command signals from users in real time through an in-vehicle audio acquisition device, and preprocesses the voice command signals to extract unique voiceprint feature information. The voiceprint feature information is compared and matched with a pre-registered and stored voiceprint model library to determine the identity of the user who issued the command. Based on the user identity identifier, retrieve and retrieve historical behavior data associated with the user identity identifier from local storage unit or cloud server.

[0088] Furthermore, when the intelligent cockpit in-vehicle self-service voice interaction program is executed by the processor, it also performs the following operations: Determine the intent in the historical behavioral data Figure 1 Whether the consistency ratio and operation frequency meet the preset self-service triggering conditions; In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction; The system uses in-vehicle voice prompts and a floating UI window on the display screen to indicate the upcoming operation and the remaining waiting time. The voice monitoring module is continuously activated to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption command.

[0089] Furthermore, when the intelligent cockpit in-vehicle self-service voice interaction program is executed by the processor, it also performs the following operations: Filter out historical operation records that belong to the same intent category as the user's voice command from the historical behavior data; The cumulative number of occurrences of the historical operation records within a preset time window is counted to obtain the operation frequency. Calculate the proportion of records in the historical operation log where the same target option was selected out of the total number of records to obtain the desired result. Figure 1 Conformity ratio; When the operation frequency is greater than or equal to a preset operation frequency threshold, and the intention... Figure 1 When the consistency ratio is greater than or equal to a preset consistency ratio threshold, the historical behavior data is determined to meet the preset self-service triggering conditions.

[0090] Furthermore, when the intelligent cockpit in-vehicle self-service voice interaction program is executed by the processor, it also performs the following operations: In the meaning Figure 1 When the consistency ratio and the frequency of the operation meet the preset self-service triggering conditions, historical operation records in the historical behavior data that belong to the same intent category as the user's voice command are filtered out. Count the cumulative number of times each candidate option was selected in the historical operation records; By comparing the cumulative counts, the candidate option with the highest cumulative count is determined as the target option with the highest frequency of occurrence; The execution parameters corresponding to the target option are encapsulated into default execution instructions.

[0091] Furthermore, when the intelligent cockpit in-vehicle self-service voice interaction program is executed by the processor, it also performs the following operations: During the preset waiting period, the remaining duration is tracked in real time and the audio input stream is analyzed synchronously to determine whether preset interruption keywords or subsequent voice commands occur. If the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated, and the system switches to a multi-turn dialogue mode to respond to the user's intervention request. If no interruption command is detected after the preset waiting period expires, it is determined that the user has agreed by default, the function module corresponding to the default execution command is automatically triggered, and the execution result is fed back through voice or interface after the default execution command is executed.

[0092] Furthermore, when the intelligent cockpit in-vehicle self-service voice interaction program is executed by the processor, it also performs the following operations: Collect behavioral data from this interaction, associate this behavioral data with the user's identity identifier, and update the intention data in the historical behavioral data. Figure 1 Inconsistency ratio and operation frequency.

[0093] Those skilled in the art will understand that all or part of the steps in the methods described above can be implemented by a program instructing related hardware. The program is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium is a computer-readable storage medium, including: USB flash drive, mobile hard drive, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and other media that can store program code.

[0094] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0095] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0096] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A smart cockpit in-vehicle self-service voice interaction method, characterized in that, The intelligent cockpit in-vehicle self-service voice interaction method includes: Receive user voice commands and perform voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity. When the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. At the same time, during the preset waiting period, it is monitored whether there is an interruption instruction. Based on the interruption monitoring results and time status within the preset waiting period, determine the interaction flow to execute the default execution command or switch to regular voice.

2. The intelligent cockpit in-vehicle self-service voice interaction method as described in claim 1, characterized in that, The process of receiving user voice commands and performing voiceprint recognition to determine user identity and obtain historical behavior data corresponding to the user identity includes: The system receives voice command signals from users in real time through an in-vehicle audio acquisition device, and preprocesses the voice command signals to extract unique voiceprint feature information. The voiceprint feature information is compared and matched with a pre-registered and stored voiceprint model library to determine the identity of the user who issued the command. Based on the user identity identifier, retrieve and retrieve historical behavior data associated with the user identity identifier from local storage unit or cloud server.

3. The intelligent cockpit in-vehicle self-service voice interaction method as described in claim 1, characterized in that, When the historical behavior data meets the preset self-service triggering conditions, a default execution instruction is generated and a preset waiting period is entered. Simultaneously, during the preset waiting period, it is monitored whether an interruption instruction exists, including: Determine whether the intent consistency ratio and operation frequency in the historical behavior data meet the preset self-service triggering conditions. When the intent consistency ratio and the operation frequency meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction; The system uses in-vehicle voice prompts and a floating UI window on the display screen to indicate the upcoming operation and the remaining waiting time. The voice monitoring module is continuously activated to monitor in real time whether the user issues a command containing a specific cancel keyword or interruption command.

4. The intelligent cockpit in-vehicle self-service voice interaction method as described in claim 3, characterized in that, The determination of whether the consistency ratio of intent and the frequency of operations in the historical behavior data meet the preset self-service triggering conditions includes: Filter out historical operation records that belong to the same intent category as the user's voice command from the historical behavior data; The cumulative number of occurrences of the historical operation records within a preset time window is counted to obtain the operation frequency. The consistency ratio of intent is obtained by calculating the proportion of records in the historical operation records that selected the same target option to the total number of records. When the operation frequency is greater than or equal to a preset operation frequency threshold, and the intent consistency ratio is greater than or equal to a preset consistency ratio threshold, the historical behavior data is determined to meet the preset self-service triggering conditions.

5. The intelligent cockpit in-vehicle self-service voice interaction method as described in claim 3, characterized in that, When the intent consistency ratio and the operation frequency meet the preset self-service triggering conditions, the target option with the highest frequency in the historical behavior data is determined as the default execution instruction, including: When the intent consistency ratio and the operation frequency meet the preset self-service triggering conditions, historical operation records in the historical behavior data that belong to the same intent category as the user's voice command are filtered out. Count the cumulative number of times each candidate option was selected in the historical operation records; By comparing the cumulative counts, the candidate option with the highest cumulative count is determined as the target option with the highest frequency of occurrence; The execution parameters corresponding to the target option are encapsulated into default execution instructions.

6. The intelligent cockpit in-vehicle self-service voice interaction method as described in claim 1, characterized in that, The interaction process of determining whether to execute the default execution command or switch to regular voice based on the interruption monitoring results and time status within the preset waiting period includes: During the preset waiting period, the remaining duration is tracked in real time and the audio input stream is analyzed synchronously to determine whether preset interruption keywords or subsequent voice commands occur. If the interruption command is detected before the preset waiting period expires, the waiting process is immediately terminated, and the system switches to a multi-turn dialogue mode to respond to the user's intervention request. If no interruption command is detected after the preset waiting period expires, it is determined that the user has agreed by default, the function module corresponding to the default execution command is automatically triggered, and the execution result is fed back through voice or interface after the default execution command is executed.

7. The intelligent cockpit in-vehicle self-service voice interaction method as described in claim 1, characterized in that, After determining whether to execute the default execution command or switch to regular voice interaction based on the interruption monitoring results and time status within the preset waiting period, the intelligent cockpit in-vehicle self-service voice interaction method further includes: Collect behavioral data of this interaction, associate the behavioral data of this interaction with the user identity identifier, and update the intent consistency ratio and operation frequency in the historical behavioral data.

8. A smart cockpit in-vehicle self-service voice interaction device, characterized in that, The intelligent cockpit in-vehicle self-service voice interaction device includes: The data acquisition module is used to receive user voice commands and perform voiceprint recognition to determine the user's identity and acquire the historical behavior data corresponding to the user's identity. The instruction generation module is used to generate a default execution instruction and enter a preset waiting period when the historical behavior data meets the preset self-service triggering conditions, and at the same time monitor whether there is an interruption instruction during the preset waiting period. The interactive execution module is used to determine the interactive process of executing the default execution command or switching to regular voice based on the interruption monitoring results and time status within the preset waiting period.

9. A smart cockpit in-vehicle self-service voice interaction device, characterized in that, The intelligent cockpit in-vehicle self-service voice interaction device includes: a memory, a processor, and an intelligent cockpit in-vehicle self-service voice interaction program stored in the memory and executable on the processor, wherein the intelligent cockpit in-vehicle self-service voice interaction program is configured to implement the steps of the intelligent cockpit in-vehicle self-service voice interaction method as described in any one of claims 1 to 7.

10. A storage medium, characterized in that, The storage medium stores an intelligent cockpit in-vehicle self-service voice interaction program, which, when executed by a processor, implements the steps of the intelligent cockpit in-vehicle self-service voice interaction method as described in any one of claims 1 to 7.

Images