Vehicle exterior voice control method, device and equipment

Abstract

The invention provides an out-of-vehicle voice control method, device and equipment. The method comprises the following steps: monitoring a real-time state of a vehicle; judging whether the real-time state meets an out-of-vehicle voice starting condition or not; if yes, starting an external voice function; and if not, turning off the voice function outside the vehicle. According to the invention, the starting and stopping of the out-of-vehicle voice function are dynamically controlled by monitoring the real-time state of the vehicle, the out-of-vehicle voice function is started only when the out-of-vehicle voice starting condition is met, unnecessary occupation of the internal memory and the computing power of the vehicle-mounted terminal is greatly reduced, the faults of jamming, black screen and the like caused by resource redundancy consumption of the low-internal-memory vehicle-mounted terminal are avoided, the vehicle-mounted terminal is smoother and safer to operate, and the vehicle-mounted terminal is more convenient to use. And the convenience of using the voice outside the vehicle by the user in an applicable scene is not influenced, and the balance between performance optimization and function practicability is realized.

Description

Technical Field

[0001] This invention relates to the field of automotive voice control technology, and in particular to an external voice control method, device, and equipment. Background Technology

[0002] With the development of in-vehicle intelligence, external voice control has become an important function to improve the convenience of vehicle use. Existing solutions mostly adopt a pure software architecture, relying on the vehicle's infotainment system to continuously run a voice recognition engine, performing audio acquisition, noise reduction, and recognition operations throughout the process. However, this technology has a key drawback: it requires a large amount of memory and computing power from the vehicle's infotainment system for a long time, resulting in a significant decrease in the smoothness of operation of infotainment systems with low memory (4G or below), frequently causing malfunctions such as freezing, black screens, and even restarts. This not only affects the user experience but may also interfere with the operation of the vehicle's core functions.

[0003] Therefore, existing vehicle external voice control technology suffers from the problem of unnecessary and continuous resource occupation. Summary of the Invention

[0004] This invention provides a method, apparatus, and device for external vehicle voice control, aiming to solve the problem of unnecessary and continuous resource occupation in existing external vehicle voice control technologies.

[0005] In a first aspect, embodiments of the present invention provide a method for external voice control, the method comprising: Monitor the real-time status of vehicles; Determine whether the real-time status meets the conditions for activating the external voice control. If the conditions are met, the external voice control function will be activated. If the requirements are not met, the external voice function will be turned off.

[0006] Secondly, embodiments of the present invention also provide an external voice control device, the device comprising: The monitoring unit is used to monitor the real-time status of the vehicle. The judgment unit is used to determine whether the real-time state meets the conditions for activating the external voice function; The activation unit is used to activate the external voice function if the conditions are met. The shut-off unit is used to disable the external voice function if the conditions are not met.

[0007] Thirdly, embodiments of the present invention also provide an electronic device, which is a server or a terminal. The electronic device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. The feature is that when the processor corresponding to the server and the processor corresponding to the terminal execute the computer program simultaneously, the vehicle external voice control method as described in any one of claims 1-7 is implemented.

[0008] Fourthly, embodiments of the present invention also provide a computer-readable storage medium storing a computer program, the computer program including program instructions that, when executed by a processor, can implement the method described in the first aspect.

[0009] This invention provides a method, apparatus, and device for external vehicle voice control. The method includes: monitoring the real-time status of the vehicle; determining whether the real-time status meets the conditions for activating external voice control; if the conditions are met, activating the external voice control function; if not, deactivating the external voice control function. This invention dynamically controls the activation and deactivation of the external voice control function by monitoring the real-time status of the vehicle, enabling the function only when the conditions are met. This significantly reduces unnecessary use of vehicle system memory and computing power, avoiding lag, black screens, and other malfunctions caused by redundant resource consumption in low-memory vehicle systems, making the vehicle system run more smoothly and safely. It also does not affect the user's convenience in using external voice control in applicable scenarios, achieving a balance between performance optimization and functional practicality. Attached Figure Description

[0010] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a flowchart illustrating the vehicle-external voice control method provided in an embodiment of the present invention; Figure 2 A schematic block diagram of an external voice control device provided in an embodiment of the present invention; Figure 3 A schematic block diagram of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0012] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0013] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "including" indicate the presence of the described features, integrals, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or collections thereof.

[0014] It should also be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0015] It should also be further understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. Embodiments of this invention provide a method, apparatus, and device for external vehicle voice control. For the external vehicle voice control method, please refer to... Figure 1 , Figure 1 This is a flowchart illustrating the vehicle external voice control method provided in an embodiment of the present invention. The method is applied to the controller of the vehicle infotainment system to achieve intelligent start and stop of the vehicle external voice function.

[0016] Figure 1 This is a flowchart illustrating the vehicle-exterior voice control method provided in an embodiment of the present invention. Figure 1 As shown, the method includes the following steps S110-S140.

[0017] S110, Monitor the real-time status of vehicles.

[0018] In this embodiment, the real-time status of the vehicle is monitored to control the start and stop of the external voice function based on the real-time status, thereby solving the problem of unnecessary continuous resource occupation in existing external voice control technologies.

[0019] S120. Determine whether the real-time status meets the conditions for enabling external voice control.

[0020] In this embodiment, it is determined whether the real-time status meets the conditions for enabling the external voice function. If it does, the user can use the external voice function normally; if it does not, the user cannot use the external voice function.

[0021] In one embodiment, step S120 includes: obtaining the real-time gear status of the vehicle based on the real-time status; if the real-time gear status is P gear, then it is determined that the external voice activation condition is met; if the real-time gear status is not P gear, then it is determined that the external voice activation condition is not met.

[0022] In this embodiment, the real-time gear status of the vehicle is obtained based on the real-time status; if the real-time gear status is P gear, it is determined that the conditions for activating the external voice function are met, thereby triggering the external voice function activation process; if the real-time gear status is not P gear, it is determined that the conditions for activating the external voice function are not met, and the external voice function deactivation operation is performed.

[0023] S130. If the conditions are met, the external voice function will be activated.

[0024] In this embodiment, if the conditions are met (i.e., the vehicle's real-time gear position is P), the external voice function is activated. Specifically, the external voice function can be enabled by loading an external voice recognition engine and supporting operating resources, ensuring that the audio acquisition, noise reduction, and recognition processes can respond normally.

[0025] In one embodiment, step S130 includes: loading external voice recognition engine resources and entering external audio acquisition state; sending the acquired external audio to the external voice recognition engine in real time; performing noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data; generating corresponding control commands based on the audio data; and executing corresponding operations based on the control commands.

[0026] In this embodiment, when the vehicle's real-time gear position is P, the external voice recognition engine and its supporting operating resources (including algorithm models, temporary data cache space, etc.) are loaded, and the vehicle enters the external audio acquisition state; the acquired external audio is sent to the preprocessing module of the external voice recognition engine in real time; the external audio is denoised by the preprocessing module to obtain denoised audio data; corresponding control commands are generated based on the audio data; and corresponding operations (such as unlocking, opening windows, etc.) are executed based on the control commands.

[0027] In one embodiment, after generating the corresponding control command based on the audio data, the method further includes: verifying the validity of the control command; if the control command is valid, performing the corresponding operation according to the control command; if the control command is invalid, providing a voice prompt to the user that the command is invalid.

[0028] In this embodiment, the validity of the control command is verified. The verification includes: checking whether the control command belongs to the preset external commands available outside the vehicle (such as unlocking, opening windows, etc.) and whether it is compatible with the current P gear state (for example, commands that require a driving gear, such as "shift to D gear" or "reverse", are directly determined to be invalid because they conflict with the P gear parking state); if the control command is valid, the corresponding operation is executed; if it is invalid, a voice prompt "Invalid command, please issue again" is given through the external speaker.

[0029] In one embodiment, the step of performing noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data includes: filtering environmental noise from the external audio in real time through the external voice recognition engine to obtain audio data that retains human voice.

[0030] In this embodiment, the preprocessing module of the vehicle external voice recognition engine filters out environmental noise (such as wind noise, traffic noise, etc.) in real time to obtain audio data that retains human voice, thus providing support for the accuracy of subsequent voice recognition.

[0031] S140. If not satisfied, disable the external voice function.

[0032] In this embodiment, if the condition is not met (i.e., the vehicle's real-time gear status is not in P gear), the external voice function is turned off. Specifically, the external voice function can be turned off by releasing the external voice recognition engine and its associated operating resources.

[0033] In one embodiment, step S140 includes: waiting for a preset time threshold, releasing the external voice recognition engine resources, and stopping the collection of external audio.

[0034] In this embodiment, if the real-time status does not meet the conditions for enabling external voice, the external voice recognition engine and its associated operating resources are immediately released after waiting for a preset time threshold (e.g., 30 seconds). At the same time, the external audio acquisition, noise reduction and recognition processes are stopped, and the response to external voice commands is prohibited to avoid unnecessary occupation of vehicle system performance and ensure the smooth operation of the vehicle system's core functions.

[0035] In summary, this invention dynamically controls the activation and deactivation of the external voice function by monitoring the vehicle's real-time status. The external voice function is activated only when the conditions for activation are met, significantly reducing unnecessary use of the vehicle's memory and computing power. This avoids lag, black screens, and other malfunctions caused by redundant resource consumption in low-memory vehicle systems, making the vehicle system run more smoothly and safely, without affecting the user's convenience in using external voice in applicable scenarios, thus achieving a balance between performance optimization and functional practicality.

[0036] Figure 2 This is a schematic block diagram of an external voice control device provided in an embodiment of the present invention. Figure 2 As shown, corresponding to the above-described external voice control method, this invention also provides an external voice control device, which is configured in the controller of the vehicle's infotainment system to realize intelligent start and stop of the external voice function. For details, please refer to... Figure 2 The vehicle external voice control device 700 includes: Monitoring unit 701 is used to monitor the real-time status of the vehicle; Judgment unit 702 is used to determine whether the real-time state meets the conditions for activating external voice control; The activation unit 703 is used to activate the external voice function if the conditions are met. The shut-off unit 704 is used to disable the external voice function if the conditions are not met.

[0037] In some embodiments, when the determining unit 702 performs the step of determining whether the real-time state meets the conditions for activating the external voice control, it is specifically used for: The real-time gear status of the vehicle is obtained based on the real-time status; if the real-time gear status is P gear, it is determined that the condition for activating the external voice control is met; if the real-time gear status is not P gear, it is determined that the condition for activating the external voice control is not met.

[0038] In some embodiments, when the activation unit 703 performs the step of activating the external voice function, it is specifically used for: Load the external voice recognition engine resources and enter the external audio acquisition state; send the acquired external audio to the external voice recognition engine in real time; perform noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data; generate corresponding control commands based on the audio data; and execute corresponding operations based on the control commands.

[0039] In some embodiments, after performing the step of generating corresponding control instructions based on the audio data, the activation unit 703 is further configured to: Verify the validity of the control command; if the control command is valid, execute the corresponding operation according to the control command; if the control command is invalid, provide the user with a voice prompt that the command is invalid.

[0040] In some embodiments, when the opening unit 703 performs the step of performing noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data, it is specifically used for: The external voice recognition engine filters out ambient noise from the external audio in real time to obtain audio data that retains human voice.

[0041] In some embodiments, when performing the step of disabling the external voice function, the shut-off unit 704 is specifically used for: Release the resources of the external voice recognition engine and stop collecting external audio.

[0042] In some embodiments, when performing the step of disabling the external voice function, the shut-off unit 704 is specifically used for: After waiting for a preset time threshold, release the external voice recognition engine resources and stop collecting external audio.

[0043] It should be noted that those skilled in the art can clearly understand that the specific implementation process of the above-mentioned vehicle external voice control device and each unit can be referred to the corresponding description in the foregoing method embodiments. For the sake of convenience and brevity, it will not be repeated here.

[0044] The aforementioned external voice control device can be implemented as a computer program, which can, for example... Figure 3 It runs on the electronic device shown.

[0045] Please see Figure 3 , Figure 3 This is a schematic block diagram of an electronic device provided in an embodiment of the present invention. The electronic device 800 can be a terminal or a server. The terminal can be an electronic device with communication functions. The server can be a standalone server or a server cluster composed of multiple servers.

[0046] See Figure 3 The electronic device 800 includes a processor 802, a memory, and a network interface 805 connected via a system bus 801. The memory may include a non-volatile storage medium 803 and internal memory 804.

[0047] The non-volatile storage medium 803 may store an operating system 8031 ​​and a computer program 8032. The computer program 8032 includes program instructions that, when executed, cause the processor 802 to perform an external voice control method.

[0048] The processor 802 provides computing and control capabilities to support the operation of the entire electronic device 800.

[0049] The internal memory 804 provides an environment for the execution of the computer program 8032 in the non-volatile storage medium 803. When the processor 802 corresponding to the server and the processor 802 corresponding to the terminal execute the computer program 8032 simultaneously, an external voice control method is implemented.

[0050] This network interface 805 is used for network communication with other devices. Those skilled in the art will understand that... Figure 3 The structure shown is merely a block diagram of a portion of the structure related to the present invention and does not constitute a limitation on the electronic device 800 to which the present invention is applied. The specific electronic device 800 may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0051] The processor 802 is used to run a computer program 8032 stored in the memory to perform the following steps: Monitor the vehicle's real-time status; determine whether the real-time status meets the conditions for activating the external voice function; if it does, activate the external voice function; if it does not, deactivate the external voice function.

[0052] In some embodiments, when the processor 802 implements the step of determining whether the real-time state meets the conditions for activating the external voice control, the specific steps are as follows: The real-time gear status of the vehicle is obtained based on the real-time status; if the real-time gear status is P gear, it is determined that the condition for activating the external voice control is met; if the real-time gear status is not P gear, it is determined that the condition for activating the external voice control is not met.

[0053] In some embodiments, when the processor 802 implements the step of activating the external voice function, it specifically implements the following steps: Load the external voice recognition engine resources and enter the external audio acquisition state; send the acquired external audio to the external voice recognition engine in real time; perform noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data; generate corresponding control commands based on the audio data; and execute corresponding operations based on the control commands.

[0054] In some embodiments, after implementing the step of generating corresponding control instructions based on the audio data, the processor 802 further implements the following steps: Verify the validity of the control command; if the control command is valid, execute the corresponding operation according to the control command; if the control command is invalid, provide the user with a voice prompt that the command is invalid.

[0055] In some embodiments, when the processor 802 performs noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data, the following steps are specifically implemented: The external voice recognition engine filters out ambient noise from the external audio in real time to obtain audio data that retains human voice.

[0056] In some embodiments, when implementing the step of disabling the external voice function, the processor 802 specifically implements the following steps: Release the resources of the external voice recognition engine and stop collecting external audio.

[0057] In some embodiments, when implementing the step of disabling the external voice function, the processor 802 specifically implements the following steps: After waiting for a preset time threshold, release the external voice recognition engine resources and stop collecting external audio.

[0058] It should be understood that, in this embodiment of the invention, the processor 802 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.

[0059] It will be understood by those skilled in the art that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program includes program instructions and can be stored in a storage medium, which is a computer-readable storage medium. The program instructions are executed by at least one processor in the computer system to implement the process steps of the embodiments of the above methods.

[0060] Therefore, the present invention also provides a storage medium. This storage medium can be a computer-readable storage medium. The storage medium stores a computer program, wherein the computer program includes program instructions. When executed by a processor, the program instructions cause the processor to perform the following steps: Monitor the vehicle's real-time status; determine whether the real-time status meets the conditions for activating the external voice function; if it does, activate the external voice function; if it does not, deactivate the external voice function.

[0061] In one embodiment, when the processor executes the program instructions to determine whether the real-time state meets the conditions for activating the external voice control, the specific steps are as follows: The real-time gear status of the vehicle is obtained based on the real-time status; if the real-time gear status is P gear, it is determined that the condition for activating the external voice control is met; if the real-time gear status is not P gear, it is determined that the condition for activating the external voice control is not met.

[0062] In one embodiment, when the processor executes the program instructions to activate the external voice function, it specifically implements the following steps: Load the external voice recognition engine resources and enter the external audio acquisition state; send the acquired external audio to the external voice recognition engine in real time; perform noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data; generate corresponding control commands based on the audio data; and execute corresponding operations based on the control commands.

[0063] In one embodiment, after executing the program instructions to generate corresponding control instructions based on the audio data, the processor further performs the following steps: Verify the validity of the control command; if the control command is valid, execute the corresponding operation according to the control command; if the control command is invalid, provide the user with a voice prompt that the command is invalid.

[0064] In one embodiment, when the processor executes the program instructions to perform noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data, the specific steps are as follows: The external voice recognition engine filters out ambient noise from the external audio in real time to obtain audio data that retains human voice.

[0065] In one embodiment, when the processor executes the program instructions to disable the external voice function, it specifically implements the following steps: Release the resources of the external voice recognition engine and stop collecting external audio.

[0066] In one embodiment, when the processor executes the program instructions to disable the external voice function, it specifically implements the following steps: After waiting for a preset time threshold, release the external voice recognition engine resources and stop collecting external audio.

[0067] The storage medium can be any computer-readable storage medium capable of storing program code, such as a USB flash drive, portable hard drive, read-only memory (ROM), magnetic disk, or optical disk.

[0068] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0069] In the several embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For example, the division of each unit is merely a logical functional division, and there may be other division methods in actual implementation. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed.

[0070] The steps in the method of this invention can be adjusted, merged, or reduced in order according to actual needs. The units in the device of this invention can be merged, divided, or reduced according to actual needs. Furthermore, the functional units in the various embodiments of this invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0071] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device (which may be a personal computer, a terminal, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention.

[0072] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A method for external voice control of a vehicle, characterized in that, The method includes: Monitor the real-time status of vehicles; Determine whether the real-time status meets the conditions for activating the external voice control. If the conditions are met, the external voice control function will be activated. If the requirements are not met, the external voice function will be turned off.

2. The vehicle exterior voice control method according to claim 1, characterized in that, The step of determining whether the real-time state meets the conditions for activating the external voice control includes: The real-time gear status of the vehicle is obtained based on the real-time status. If the real-time gear status is P gear, then the condition for activating the external voice control is met. If the real-time gear status is not in P gear, then the condition for activating the external voice control is not met.

3. The vehicle exterior voice control method according to claim 1, characterized in that, Enabling the external voice control function includes: Load external voice recognition engine resources and enter external audio acquisition state; The collected external audio data is sent to the external voice recognition engine in real time. The external audio is noise-reduced using the external voice recognition engine to obtain noise-reduced audio data. Generate corresponding control commands based on the audio data; Perform the corresponding operation according to the control command.

4. The vehicle exterior voice control method according to claim 3, characterized in that, After generating the corresponding control command based on the audio data, the method further includes: Verify the validity of the control commands; If the control command is valid, then the corresponding operation is performed according to the control command; If the control command is invalid, then the user will be prompted that the command is invalid via voice.

5. The vehicle exterior voice control method according to claim 3, characterized in that, The step of performing noise reduction processing on the external audio through the external voice recognition engine to obtain noise-reduced audio data includes: The external voice recognition engine filters out ambient noise from the external audio in real time to obtain audio data that retains human voice.

6. The vehicle exterior voice control method according to claim 1, characterized in that, The method of disabling the external voice function includes: Release the resources of the external voice recognition engine and stop collecting external audio.

7. The vehicle exterior voice control method according to claim 1, characterized in that, The method of disabling the external voice function includes: After waiting for a preset time threshold, release the external voice recognition engine resources and stop collecting external audio.

8. An external voice control device, characterized in that, The device includes: The monitoring unit is used to monitor the real-time status of the vehicle. The judgment unit is used to determine whether the real-time state meets the conditions for activating the external voice function; The activation unit is used to activate the external voice function if the conditions are met. The shut-off unit is used to disable the external voice function if the conditions are not met.

9. An electronic device, the electronic device being a server or terminal, the electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor corresponding to the server and the processor corresponding to the terminal execute the computer program simultaneously, the vehicle external voice control method as described in any one of claims 1-7 is implemented.

10. A computer-readable storage medium, characterized in that, The storage medium stores a computer program, which includes program instructions that, when executed by a processor, cause the processor to perform the vehicle external voice control method as described in any one of claims 1-7.

Images