Voice control method, device, equipment and medium

Abstract

The present application provides a voice control method, device, equipment and medium, the voice control method comprising: in response to receiving a voice command, determining whether the voice command specifies a display screen; in response to the voice command not specifying a display screen, determining the status of each display screen connected to a Bluetooth headset; determining a target display screen according to the status of each display screen connected to a Bluetooth headset; and responding to the voice command through the target display screen. The purpose of accurately distributing voice commands in a multi-display and multi-amplifier scenario is achieved, accurately meeting the actual needs of users, and helping to improve the user experience.

Description

Technical Field

[0001] The present application relates to the field of voice control technology, and in particular to a voice control method, device, equipment and medium. Background Art

[0002] With the development of intelligent and connected cars, multi-screen in-vehicle has become the mainstream. For example, some vehicles currently have three display screens in the cockpit, namely the central control screen located between the driver's seat and the co-pilot seat, the first pillow screen located behind the driver's seat, and the second pillow screen located behind the co-pilot seat.

[0003] Since each display screen supports multimedia data playback and voice control, when the user wants to control the playback content of a certain display screen by voice, the voice command spoken cannot be well responded by the desired display screen. For example, when a passenger sitting behind the front passenger seat wants to play "cartoons" on the second pillow screen behind the front passenger seat, when the user says "please play cartoons", the voice command may be responded by the central control screen, that is, the central control screen starts playing "cartoons", which obviously does not meet the actual needs of the user, but also brings additional troubles to the user, resulting in a bad driving experience.

[0004] In view of this, this application is hereby filed. Summary of the invention

[0005] A brief summary of one or more aspects is given below to provide a basic understanding of these aspects. This summary is not an exhaustive overview of all conceived aspects, and is neither intended to identify the key or critical elements of all aspects nor to define the scope of any or all aspects. Its only purpose is to give some concepts of one or more aspects in a simplified form as a prelude to a more detailed description that will be given later.

[0006] The present application provides a voice control method, apparatus, device and medium, which achieves the purpose of accurately distributing voice commands in a scenario with multiple display screens and multiple amplifiers, accurately meets the actual needs of users, and is conducive to improving the user experience.

[0007] In a first aspect, the present application provides a voice control method, comprising the following steps:

[0008] In response to receiving a voice instruction, determining whether the voice instruction specifies a display screen;

[0009] In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset;

[0010] Determine the target display screen according to the status of each display screen connected to the Bluetooth headset;

[0011] The target display screen responds to the voice command.

[0012] Furthermore, the step of determining the target display screen according to the state of each display screen being connected to the Bluetooth headset includes:

[0013] In response to the presence of a display screen connected to the Bluetooth headset, the display screen connected to the Bluetooth headset is determined as a target display screen.

[0014] Furthermore, the step of determining the target display screen according to the state of each display screen being connected to the Bluetooth headset includes:

[0015] In response to the absence of a display screen connected to the Bluetooth headset, a type of the voice command is determined, and a target display screen is determined according to the type of the voice command.

[0016] Furthermore, the types of the voice instructions include on-demand type and control type.

[0017] Further, the determining the type of the voice instruction includes:

[0018] The type of the voice instruction is determined according to key information included in the voice instruction.

[0019] Further, determining the type of the voice instruction according to key information included in the voice instruction includes:

[0020] In response to the key information included in the voice command being on-demand or search related information, determining that the type of the voice command is an on-demand type;

[0021] In response to the key information included in the voice instruction being stop or play related information, it is determined that the type of the voice instruction is a control type.

[0022] Further, determining the type of the voice instruction according to key information included in the voice instruction includes:

[0023] Determining text information corresponding to the voice command;

[0024] The type of the voice instruction is determined according to key information included in the text information.

[0025] Further, determining the target display screen according to the type of the voice command includes:

[0026] In response to the type of the voice command being an on-demand type, the target display screen is determined according to location information of a user who issues the voice command.

[0027] Further, determining the target display screen according to the location information of the user who issues the voice command includes:

[0028] The display screen closest to the user is determined according to the position information of the user who issued the voice command, and the display screen closest to the user is determined as the target display screen.

[0029] Further, determining the target display screen according to the type of the voice command includes:

[0030] In response to the type of the voice command being a control type, determining whether there is a display screen currently occupying the audio focus of the vehicle power amplifier;

[0031] In response to the existence of a display screen currently occupying the audio focus of the whole vehicle power amplifier, determining the display screen currently occupying the audio focus of the whole vehicle power amplifier as the target display screen;

[0032] In response to the fact that there is no display screen occupying the audio focus of the vehicle amplifier at present, the display screen closest to the user is determined according to the position information of the user who issued the voice command, and the display screen closest to the user is determined as the target display screen.

[0033] Furthermore, the step of determining the display screen closest to the user according to the location information of the user who issues the voice command includes:

[0034] Acquire an image of the user in the vehicle based on a vehicle-mounted camera, and determine the user's location information and location information of each display screen in the vehicle according to the image;

[0035] The display screen closest to the user is determined according to the user location information and location information of each display screen in the vehicle.

[0036] Furthermore, the step of determining the display screen closest to the user according to the location information of the user who issues the voice command includes:

[0037] The voice command is received by microphones arranged at different positions in the vehicle to obtain voice signal strengths corresponding to different microphones;

[0038] Determining the distance between each microphone and the user based on the voice signal strengths corresponding to different microphones;

[0039] The display screen closest to the user is determined according to the distance between each microphone and the user.

[0040] Furthermore, determining the display screen closest to the user according to the distance between each microphone and the user includes:

[0041] Determine a target microphone closest to the user according to the distance between each microphone and the user;

[0042] determining the position of the target microphone as the user position;

[0043] The display screen closest to the target microphone is determined as the display screen closest to the user.

[0044] Furthermore, determining the state of each display screen being connected to a Bluetooth headset includes:

[0045] Check the Bluetooth setting parameters of each display screen and determine whether the corresponding display screen is connected to a Bluetooth headset through the Bluetooth setting parameters.

[0046] Further, determining whether the voice instruction specifies a display screen includes:

[0047] Determining whether the voice command includes preset display screen identity information;

[0048] In response to the voice instruction including preset display screen identity information, determining that the voice instruction specifies a display screen;

[0049] In response to the voice instruction not including preset display screen identity information, it is determined that the voice instruction does not specify a display screen.

[0050] Furthermore, the method further includes: in response to the voice instruction specifying the display screen, determining the display screen specified by the voice instruction as the target display screen.

[0051] Furthermore, the display screens include at least two of a central control screen, a first screen located behind a driver's seat, and a second screen located behind a co-pilot's seat.

[0052] In a second aspect, the present application also provides a voice control device, comprising:

[0053] A first determination module, configured to determine, in response to receiving a voice instruction, whether the voice instruction specifies a display screen;

[0054] A second determination module is used to determine the state of each display screen being connected to a Bluetooth headset in response to the voice instruction not specifying a display screen;

[0055] The third determination module is used to determine the target display screen according to the state of each display screen being connected to the Bluetooth headset;

[0056] A response module is used to respond to the voice command through the target display screen.

[0057] In a third aspect, the present application further provides an electronic device, the electronic device comprising:

[0058] one or more processors;

[0059] A storage device for storing one or more programs;

[0060] When the one or more programs are executed by the one or more processors, the one or more processors implement the voice control method as described above.

[0061] In a fourth aspect, the present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the voice control method as described above.

[0062] The voice control method disclosed in the present application, when the voice command does not specify a display screen, determines the target display screen according to the status of multiple display screens being connected to Bluetooth headsets respectively, and controls the target display screen to respond to the voice command. When a display screen is connected to a Bluetooth headset, then the display screen is likely to be the display screen that the user wants to control by voice. Therefore, when the voice command does not specify a display screen, the target display screen is determined according to the status of multiple display screens being connected to Bluetooth headsets respectively, achieving the purpose of accurately distributing voice commands in a scenario with multiple display screens and multiple amplifiers, accurately meeting the actual needs of users, and helping to improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for describing the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0064] Figure 1 A flow chart of a voice control method provided in an embodiment of the present application Figure 1 ;

[0065] Figure 2 A flow chart of a voice control method provided in an embodiment of the present application Figure 2 ;

[0066] Figure 3 A flow chart of a voice control method provided in an embodiment of the present application Figure 3 ;

[0067] Figure 4 A flow chart of a voice control method provided in an embodiment of the present application Figure 4 ;

[0068] Figure 5 A flow chart of a voice control method provided in an embodiment of the present application Figure 5 ;

[0069] Figure 6 A flow chart of a voice control method provided in an embodiment of the present application Figure 6 ;

[0070] Figure 7 A flow chart of a voice control method provided in an embodiment of the present application Figure 7 ;

[0071] Figure 8 A schematic diagram of the structure of a voice control device provided in an embodiment of the present application;

[0072] Fig. 9 It is a schematic diagram of the structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION

[0073] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the invention are shown in the accompanying drawings.

[0074] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0075] As mentioned in the background technology, with the development of automobile intelligence and networking, multi-screen in-vehicle has become the mainstream. For example, some vehicles currently have three display screens in the cockpit, namely the central control screen located between the driver's seat and the co-pilot seat, the first pillow screen located behind the driver's seat, and the second pillow screen located behind the co-pilot seat.

[0076] Since each display screen supports multimedia data playback and voice control, when the user wants to control the playback content of a certain display screen by voice, the voice command spoken cannot be well responded by the desired display screen. For example, when a passenger sitting behind the front passenger seat wants to play "cartoons" on the second pillow screen behind the front passenger seat, when the user says "please play cartoons", the voice command may be responded by the central control screen, that is, the central control screen starts playing "cartoons", which obviously does not meet the actual needs of the user, but also brings additional troubles to the user, resulting in a bad driving experience.

[0077] In view of the above problems, the embodiment of the present application proposes a voice control solution. Specifically, the user can be limited to specify the identity information of the display screen when issuing a voice command. For example, the identity information corresponding to the central control screen is screen No. 1, the identity information corresponding to the first pillow screen behind the driver's seat is screen No. 2, and the identity information corresponding to the second pillow screen behind the co-pilot seat is screen No. 3. On this basis, the user can say "Please play the cartoon on screen No. 3" by voice, and the command will be distributed to screen No. 3 through voice recognition. Screen No. 3 responds to the voice command, that is, screen No. 3 performs the action of playing the cartoon, and other screens do not perform related actions. In this way, accurate distribution of voice commands can be achieved and accurate satisfaction of users' actual needs can be achieved. However, it is obvious that users need to know the identity information of each screen in advance, resulting in a high learning cost for users, and they cannot be arbitrary when issuing voice commands, but must say voice commands including the identity information of the screen as required, resulting in poor user experience and low intelligence.

[0078] In other embodiments, the accurate distribution of voice commands can also be achieved through the following voice control scheme. Specifically, according to the audio focus, which screen in the vehicle cockpit holds the audio focus (wherein the screen that is playing audio is the screen that holds the audio focus), the voice command is distributed to which screen, and it does not matter which user in which seat the voice command is issued. For example, a user in the cockpit says "Please play the cartoon" in voice. When the system recognizes the voice command, it detects which screen in the current cockpit holds the audio focus. Assuming that the central control screen holds the audio focus, the voice command is distributed to the central control screen, and the central control screen responds to the voice command, that is, the central control screen is controlled to play the cartoon. Obviously, this voice control scheme cannot meet all the needs of users. For example, when the screen allows the connection of Bluetooth headsets, there will be multiple screens holding the audio focus at the same time. For example, the second pillow screen behind the co-pilot seat is connected to a Bluetooth headset and is playing audio or video. At the same time, the central control screen is playing music through the vehicle speakers. If the voice command "Please pause the play" is recognized at this time, the voice command cannot be accurately responded to through the screen holding the audio focus.

[0079] In other embodiments, the precise distribution of voice commands can also be achieved through the following voice control scheme. Specifically, the screen is strongly related to the seat, for example, the passengers sitting in the driver's seat and the co-pilot seat can only control the central control screen by voice, and the passengers sitting in the back row can only control the corresponding pillow screen (for example, the rear passenger sitting behind the driver's seat can only control the pillow screen set behind the driver's seat, and the rear passenger sitting behind the co-pilot seat can only control the pillow screen set behind the co-pilot seat). However, this control method is not very convenient for users. For example, when the passenger sitting in the back row wants to stop playing the central control screen, the control function cannot be realized.

[0080] In summary, each of the above control solutions has some problems and cannot well meet the control needs of users. In view of this, the embodiment of the present application provides a voice control solution, which aims to accurately meet the various control needs of users.

[0081] Figure 1 This is a flow chart of a voice control method proposed in an embodiment of the present application. The voice control method is applicable to a scenario where multiple screens and multiple amplifiers are used and each screen supports multimedia playback and voice control. The voice control method can be executed by a voice control device, which can be implemented by software and / or hardware and can be integrated into a vehicle controller.

[0082] like Figure 1 As shown, the voice control method comprises the following steps:

[0083] S110. In response to receiving a voice instruction, determine whether the voice instruction specifies a display screen.

[0084] Specifically, whether the voice command specifies the display screen can be determined through voice recognition technology.

[0085] For example, if the voice command is "please play a song on the central control screen", it is determined that the voice command specifies a display screen, and the specified display screen is the "central control screen". If the voice command is "please play a song", it is determined that the voice command does not specify a display screen.

[0086] In some implementations, determining whether the voice instruction specifies a display screen includes:

[0087] Determine whether the voice instruction includes preset display screen identity information; in response to the voice instruction including the preset display screen identity information, determine that the voice instruction specifies the display screen; in response to the voice instruction not including the preset display screen identity information, determine that the voice instruction does not specify the display screen.

[0088] The display screen identity information is used to mark the corresponding display screen. For example, the identity information corresponding to the central control screen is screen No. 1, the identity information corresponding to the first pillow screen behind the driver's seat is screen No. 2, and the identity information corresponding to the second pillow screen behind the co-pilot seat is screen No. 3. On this basis, if the voice command includes "screen No. 1", "screen No. 2" or "screen No. 3", it is determined that the voice command specifies the screen.

[0089] In response to the voice command specifying a display screen, the display screen specified by the voice command is determined as a target display screen. For example, if the voice command includes a sound segment of "Screen No. 1", the central control screen is determined as the target display screen. If the voice command includes a sound segment of "Screen No. 2", the first pillow screen behind the driver's seat is determined as the target display screen. If the voice command includes a sound segment of "Screen No. 3", the second pillow screen behind the co-pilot seat is determined as the target display screen.

[0090] S120: In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset.

[0091] If the voice command does not specify a display screen, a certain strategy is required to determine the target display screen. In order to improve the accuracy of determining the target display screen, in this embodiment, the target display screen is determined according to the state of each display screen connected to the Bluetooth headset.

[0092] Specifically, if a display screen is connected to a Bluetooth headset, it means that the user has a history of interaction with the display screen, so it is considered that the display screen is likely to be the display screen that the user wants to control. Therefore, by determining the target display screen according to the status of each display screen connected to the Bluetooth headset, the accuracy of determining the target display screen can be improved, and the user's control needs can be met as much as possible.

[0093] Exemplarily, the Bluetooth setting parameters of each display screen may be checked to determine whether the corresponding display screen is connected to a Bluetooth headset based on the Bluetooth setting parameters.

[0094] S130, determining a target display screen according to the status of each display screen being connected to the Bluetooth headset.

[0095] Among them, each display screen includes at least two of a central control screen, a first screen located behind the driver's seat, and a second screen located behind the co-pilot's seat.

[0096] S140: Respond to the voice command through the target display screen.

[0097] The voice control method disclosed in this embodiment, when the voice command does not specify a display screen, determines the target display screen according to the status of the multiple display screens being connected to the Bluetooth headsets, and controls the target display screen to respond to the voice command. This achieves the purpose of accurately distributing voice commands in a scenario with multiple display screens and multiple amplifiers, accurately meets the actual needs of users, and is conducive to improving the user experience.

[0098] Based on the above embodiment, this embodiment further defines the above step S130 "determining the target display screen according to the state of each display screen connected to the Bluetooth headset", such as Figure 2 As shown, the voice control method comprises the following steps:

[0099] S210: In response to receiving a voice instruction, determine whether the voice instruction specifies a display screen.

[0100] S220: In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset.

[0101] S230: In response to the existence of a display screen connected to the Bluetooth headset, determine the display screen connected to the Bluetooth headset as a target display screen.

[0102] It can be understood that if a display screen is connected to a Bluetooth headset, it means that the user has a history of interaction with the display screen, so it is considered that the display screen is likely to be the display screen that the user wants to control. Therefore, by determining the display screen connected to the Bluetooth headset as the target display screen, the accuracy of determining the target display screen can be improved, and the user's control needs can be met as much as possible.

[0103] S240: Respond to the voice command through the target display screen.

[0104] Based on the above embodiment, this embodiment further defines the above step S130 "determining the target display screen according to the state of each display screen connected to the Bluetooth headset", such as Figure 3 As shown, the voice control method comprises the following steps:

[0105] S310: In response to receiving a voice instruction, determine whether the voice instruction specifies a display screen.

[0106] S320: In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset.

[0107] S330: In response to the absence of a display screen connected to the Bluetooth headset, determine the type of the voice command, and determine a target display screen according to the type of the voice command.

[0108] Among them, if there is no display screen connected to the Bluetooth headset, it is impossible to mine the interaction history between the user and the display screen through the dimension of whether the Bluetooth headset is connected. At this time, the target display screen can be further determined based on the type of voice command, aiming to improve the accuracy of determining the target display screen.

[0109] Exemplarily, the types of voice commands include on-demand type and control type.

[0110] Specifically, the type of voice command related to on-demand is the on-demand type, and the type of voice command related to pause or play is the control type. For example, voice commands such as "please play cartoons" and "please play songs" belong to on-demand type voice commands; voice commands such as "please pause play" and "please continue play" belong to control type voice commands.

[0111] When a user issues a voice command of a video-on-demand type, it is considered that the user has a need to watch the video. When the user has a need to watch the video, responding to the voice command through the display closest to the user can better meet the user's inner expectations. When a user issues a voice command of a control type, the scene background is explored. In most cases, there is a display screen currently playing content, and the user wants to control the content being played. Based on this feature, the target display screen can be reasonably determined to achieve the purpose of improving the accuracy of determining the target display screen and meeting the user's control needs.

[0112] It is understandable that the display screen is likely to be the display screen that the user wants to control. Therefore, by determining the display screen connected to the Bluetooth headset as the target display screen, the accuracy of determining the target display screen can be improved, and the user's control needs can be met as much as possible.

[0113] S340: Respond to the voice command through the target display screen.

[0114] Based on the above embodiment, this embodiment further defines the step S330 of "determining the type of the voice instruction". Figure 4 As shown, the voice control method comprises the following steps:

[0115] S410: In response to receiving a voice instruction, determine whether the voice instruction specifies a display screen.

[0116] S420: In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset.

[0117] S430: In response to the absence of a display screen connected to the Bluetooth headset, determine the type of the voice instruction according to key information included in the voice instruction, and determine the target display screen according to the type of the voice instruction.

[0118] In some embodiments, the key information included in the voice instruction can be determined by voice recognition technology, and then the type of the voice instruction can be determined based on the key information. Alternatively, the type of the voice instruction can be determined by a recognition model, and the voice instruction can be input into a trained model, and the model can output the corresponding type.

[0119] Furthermore, the determining the type of the voice command according to the key information included in the voice command includes: in response to the key information included in the voice command being on-demand or search related information, determining the type of the voice command to be on-demand type; in response to the key information included in the voice command being stop or play related information, determining the type of the voice command to be control type. For example, voice commands such as "please play cartoons" and "please play songs" are voice commands of the on-demand type; voice commands such as "please pause playing" and "please continue playing" are voice commands of the control type.

[0120] In some embodiments, determining the type of the voice instruction according to the key information included in the voice instruction includes: determining the text information corresponding to the voice instruction; determining the type of the voice instruction according to the key information included in the text information, that is, first converting the voice instruction into text, and then determining whether it includes preset keywords through keyword retrieval or matching, and if it does, the type of the voice instruction can be determined to be a type represented by the preset keywords. For example, if the text corresponding to the voice instruction includes the preset keywords "pause" or "continue playing", the type of the voice instruction is determined to be a control type.

[0121] S440: Respond to the voice command through the target display screen.

[0122] Based on the above embodiment, this embodiment further defines the following content in the above step S330: "determining the target display screen according to the type of the voice instruction", such as Figure 5 As shown, the voice control method comprises the following steps:

[0123] S510: In response to receiving a voice instruction, determine whether the voice instruction specifies a display screen.

[0124] S520: In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset.

[0125] S530: In response to the absence of a display screen connected to the Bluetooth headset, determine the type of the voice command.

[0126] S540: In response to the type of the voice command being an on-demand type, determine the target display screen according to the location information of the user who issues the voice command.

[0127] Among them, when the user issues a voice command of the on-demand type, it is believed that the user himself has the need to watch the broadcast. When the user himself has the need to watch the broadcast, responding to the voice command through the display screen closest to the user can better meet the user's inner expectations.

[0128] Exemplarily, determining the target display screen according to the location information of the user who issues the voice command includes: determining the display screen closest to the user according to the location information of the user who issues the voice command, and determining the display screen closest to the user as the target display screen.

[0129] S550: Respond to the voice command through the target display screen.

[0130] Based on the above embodiment, this embodiment further defines the following content in the above step S330: "determining the target display screen according to the type of the voice instruction", such as Figure 6 As shown, the voice control method comprises the following steps:

[0131] S610: In response to receiving a voice instruction, determine whether the voice instruction specifies a display screen.

[0132] S620: In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset.

[0133] S630: In response to the absence of a display screen connected to the Bluetooth headset, determine the type of the voice command.

[0134] S640: In response to the type of the voice instruction being a control type, determine whether there is currently a display screen occupying the audio focus of the vehicle amplifier.

[0135] S650a: In response to the existence of a display screen that currently occupies the audio focus of the vehicle power amplifier, determine the display screen that currently occupies the audio focus of the vehicle power amplifier as the target display screen.

[0136] S650b: In response to the fact that there is no display screen occupying the audio focus of the vehicle amplifier, determine the display screen closest to the user according to the position information of the user who issued the voice command, and determine the display screen closest to the user as the target display screen.

[0137] Specifically, when a user issues a control-type voice command, the scene background is mined. In most cases, a display screen is currently playing content, and the user wants to control the content being played. Based on this feature, it can be further determined whether there is a display screen that currently occupies the audio focus of the entire vehicle amplifier. In response to the existence of a display screen that currently occupies the audio focus of the entire vehicle amplifier, the display screen that currently occupies the audio focus of the entire vehicle amplifier is determined as the target display screen. In response to the absence of a display screen that currently occupies the audio focus of the entire vehicle amplifier, the display screen closest to the user is determined based on the location information of the user who issued the voice command, and the display screen closest to the user is determined as the target display screen. The purpose of improving the accuracy of determining the target display screen and meeting the user's control needs is achieved.

[0138] S660: Respond to the voice command through the target display screen.

[0139] In some implementations, the following content in the above embodiment "determining the display screen closest to the user based on the location information of the user who issued the voice command" is further limited. Specifically, determining the display screen closest to the user based on the location information of the user who issued the voice command includes: acquiring an image of the user in the car based on a car-mounted camera, determining the user location information and the location information of each display screen in the car based on the image; determining the display screen closest to the user based on the user location information and the location information of each display screen in the car.

[0140] In other embodiments, determining a display screen closest to a user based on location information of a user issuing a voice command includes: receiving the voice command through microphones disposed at different locations in the vehicle to obtain voice signal strengths corresponding to different microphones; determining a distance between each microphone and the user based on the voice signal strengths corresponding to the different microphones; and determining a display screen closest to the user based on the distance between each microphone and the user.

[0141] Furthermore, the display screen closest to the user is determined based on the distance between each microphone and the user, including: determining the target microphone closest to the user based on the distance between each microphone and the user; determining the position of the target microphone as the user position; and determining the display screen closest to the target microphone as the display screen closest to the user. Optionally, different microphones are set at different seat positions. Assuming that the passenger sitting in the front passenger seat issues a voice command, the voice signal strength received by the microphone closest to the passenger is the strongest. Therefore, the position of the passenger can be determined based on the position of the corresponding microphone.

[0142] On the basis of the above embodiments, further reference is made to Figure 7 The flowchart of a voice control method shown in FIG. 1 specifically includes the following steps:

[0143] S1. Receive voice commands.

[0144] S2. Perform voice recognition on the voice command and identify the sound zone information.

[0145] The voice zone information indicates the location information of the user who issues the voice command.

[0146] S3. Perform natural language understanding on the text information corresponding to the speech recognition.

[0147] Specifically, when a user issues a voice command, such as "pause playback" or "I want to listen to a song", the voice service recognizes the voice command as text, determines the user in which voice zone issued the command, and performs natural language understanding.

[0148] S4. Determine whether it is an instruction for specifying a screen. If so, execute step S5; otherwise, execute step S6.

[0149] Determine whether the voice command is a voice command for a specified screen, such as the voice command "pause playback on the central control screen" is a voice command for a specified screen.

[0150] S5. Distribute to corresponding screens.

[0151] Distribute directly to the screen specified by the user.

[0152] S6. Determine whether the user who issued the instruction is wearing a Bluetooth headset. If yes, execute step S7; otherwise, execute step S8.

[0153] S7. Distribute to the screen connected to the Bluetooth headset.

[0154] For voice commands that do not specify a screen, it is further determined whether the user is wearing a Bluetooth headset. If so, the voice command is distributed to the screen connected to the Bluetooth headset. For example, if the user in the second row left seat is wearing a Bluetooth headset, when the user issues a voice command "next song", the command is distributed to the left headrest screen in the second row.

[0155] S8. Determine the type of instruction. If it is a control instruction, execute step S9. If it is a video-on-demand instruction, execute step S12.

[0156] S9. Determine whether there is a screen holding the audio focus of the vehicle amplifier. If yes, execute S11; otherwise, execute S10.

[0157] For control instructions, further query which screen is using the vehicle amplifier to play audio and video.

[0158] S10. Distribute to the screen closest to the user.

[0159] If no screen holds the audio focus of the vehicle amplifier, the command will be distributed to the screen closest to the user, and a prompt will be displayed saying "There is currently no audio source being played."

[0160] S11, distributed to the screen holding the audio focus of the vehicle amplifier.

[0161] S12. Distribute to the screen closest to the user.

[0162] By combining whether the voice command specifies a screen, whether the user is wearing a Bluetooth headset, the user's audio zone, and whether there is a display holding the audio focus of the vehicle's power amplifier, the target display is comprehensively determined, thereby improving the accuracy of determining the target display. The voice command is then responded to through the target display, achieving the purpose of accurate distribution of voice control commands in scenarios with multiple displays and multiple amplifiers, accurately meeting the user's actual needs and helping to improve the user experience.

[0163] Figure 8 is a schematic diagram of the structure of a voice control device provided in an embodiment of the present application, which can be integrated into a controller of a vehicle. Figure 8 As shown, the device includes: a first determination module 810, used to determine whether the voice instruction specifies a display screen in response to receiving a voice instruction; a second determination module 820, used to determine the status of each display screen connected to a Bluetooth headset in response to the voice instruction not specifying a display screen; a third determination module 830, used to determine a target display screen according to the status of each display screen connected to the Bluetooth headset; and a response module 840, used to respond to the voice instruction through the target display screen.

[0164] Furthermore, the first determination module 810 is specifically used to determine whether the voice instruction includes preset display screen identity information; in response to the voice instruction including the preset display screen identity information, determine that the voice instruction specifies the display screen; in response to the voice instruction not including the preset display screen identity information, determine that the voice instruction does not specify the display screen.

[0165] Furthermore, the second determination module 820 is specifically used to check the Bluetooth setting parameters of each display screen, and determine whether the corresponding display screen is connected to a Bluetooth headset according to the Bluetooth setting parameters.

[0166] Further, the third determination module 830 includes a first determination unit and a second determination unit, wherein the first determination unit is used to: in response to the presence of a display screen connected to the Bluetooth headset, determine the display screen connected to the Bluetooth headset as the target display screen. The second determination unit is used to: in response to the absence of a display screen connected to the Bluetooth headset, determine the type of the voice instruction, and determine the target display screen according to the type of the voice instruction.

[0167] Furthermore, the types of the voice instructions include on-demand type and control type.

[0168] Furthermore, the second determination unit includes: a first determination subunit, configured to determine the type of the voice instruction according to key information included in the voice instruction.

[0169] The first determination subunit is specifically used for: in response to the key information included in the voice instruction being on-demand or search related information, determining the type of the voice instruction as on-demand type; in response to the key information included in the voice instruction being stop or play related information, determining the type of the voice instruction as control type.

[0170] Optionally, the first determining subunit is specifically used to: determine text information corresponding to the voice instruction; and determine the type of the voice instruction according to key information included in the text information.

[0171] Furthermore, the second determination unit includes a second determination subunit, which is used to determine the target display screen according to the location information of the user who issues the voice instruction in response to the type of the voice instruction being an on-demand type.

[0172] Furthermore, the second determining subunit is specifically used to: determine the display screen closest to the user according to the position information of the user who issues the voice command, and determine the display screen closest to the user as the target display screen.

[0173] Furthermore, the second determination unit includes a third determination subunit, which is used to determine whether there is currently a display screen occupying the audio focus of the entire vehicle power amplifier in response to the type of the voice command being a control type; a fourth determination subunit, which is used to determine the display screen currently occupying the audio focus of the entire vehicle power amplifier as the target display screen in response to the existence of a display screen occupying the audio focus of the entire vehicle power amplifier; and a fifth determination subunit, which is used to determine the display screen closest to the user according to the position information of the user who issued the voice command in response to the fact that there is currently no display screen occupying the audio focus of the entire vehicle power amplifier, and determine the display screen closest to the user as the target display screen.

[0174] Furthermore, the second determination subunit and the fifth determination subunit are specifically used to: obtain an image of the user in the car based on the onboard camera, determine the user's location information and the location information of each display screen in the car based on the image; determine the display screen closest to the user based on the user's location information and the location information of each display screen in the car. Alternatively, the voice command is received by microphones arranged at different positions in the car to obtain the voice signal strengths corresponding to different microphones; determine the distance between each microphone and the user based on the voice signal strengths corresponding to different microphones; determine the target microphone closest to the user based on the distance between each microphone and the user; determine the position of the target microphone as the user's position; determine the display screen closest to the target microphone as the display screen closest to the user.

[0175] Furthermore, the system further includes a fourth determining module for determining the display screen designated by the voice instruction as a target display screen in response to the display screen designated by the voice instruction.

[0176] Furthermore, the display screens include at least two of a central control screen, a first screen located behind a driver's seat, and a second screen located behind a co-pilot's seat.

[0177] The voice control device provided in the embodiment of the present disclosure can execute the steps in the voice control method provided in the method embodiment of the present disclosure, and the execution steps and beneficial effects are no longer repeated here.

[0178] Fig. 9 Schematic diagram of the structure of an electronic device in the embodiment of the present disclosure. Fig. 9 , which shows a structural schematic diagram of an electronic device 500 suitable for implementing the embodiments of the present disclosure. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0179] like Fig. 9 As shown, the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage device 508 into a random access memory (RAM) to implement the method of the embodiment described in the present disclosure. In RAM503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, ROM 502, and RAM503 are connected to each other via a bus 504. An I / O interface 505 is also connected to the bus 504. An input device 506, an output device 507, a storage device 508, and a communication device 509 are all connected to the I / O interface 505.

[0180] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart, thereby implementing the voice control method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0181] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0182] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device executes the method steps in the present application.

[0183] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0184] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0185] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other.

[0186] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and its core ideas of this application. The above is only the preferred implementation method of this application. It should be pointed out that due to the limitations of textual expression and the objective existence of infinite specific structures, ordinary technicians in this technical field can make several improvements, modifications or changes without departing from the principles of this application, and can also combine the above technical features in an appropriate manner; these improvements, modifications, changes or combinations, or the direct application of the concept and technical solution of the invention to other occasions without improvement, should be regarded as the scope of protection of this application.

Claims

1. A voice control method, characterized in that: include: In response to receiving a voice instruction, determining whether the voice instruction specifies a display screen; In response to the voice command not specifying a display screen, determining a status of each display screen being connected to a Bluetooth headset; Determine the target display screen according to the status of each display screen connected to the Bluetooth headset; The target display screen responds to the voice command.

2. The voice control method according to claim 1, characterized in that: The step of determining the target display screen according to the state of each display screen being connected to the Bluetooth headset comprises: In response to the presence of a display screen connected to the Bluetooth headset, the display screen connected to the Bluetooth headset is determined as a target display screen.

3. The voice control method according to claim 1, characterized in that: The step of determining the target display screen according to the state of each display screen being connected to the Bluetooth headset comprises: In response to the absence of a display screen connected to the Bluetooth headset, a type of the voice command is determined, and a target display screen is determined according to the type of the voice command.

4. The voice control method according to claim 3, characterized in that: The types of the voice instructions include on-demand type and control type.

5. The voice control method according to claim 3, characterized in that: The determining the type of the voice instruction includes: The type of the voice instruction is determined according to key information included in the voice instruction.

6. The voice control method according to claim 5, characterized in that: The determining the type of the voice instruction according to key information included in the voice instruction includes: In response to the key information included in the voice command being on-demand or search related information, determining that the type of the voice command is an on-demand type; In response to the key information included in the voice instruction being stop or play related information, it is determined that the type of the voice instruction is a control type.

7. The voice control method according to claim 5, characterized in that: The determining the type of the voice instruction according to key information included in the voice instruction includes: Determining text information corresponding to the voice command; The type of the voice instruction is determined according to key information included in the text information.

8. The voice control method according to claim 4, characterized in that: The step of determining the target display screen according to the type of the voice command comprises: In response to the type of the voice command being an on-demand type, the target display screen is determined according to location information of a user who issues the voice command.

9. The voice control method according to claim 8, characterized in that: The step of determining the target display screen according to the position information of the user who issues the voice command comprises: The display screen closest to the user is determined according to the position information of the user who issued the voice command, and the display screen closest to the user is determined as the target display screen.

10. The voice control method according to claim 4, characterized in that: The step of determining the target display screen according to the type of the voice instruction includes: In response to the type of the voice command being a control type, determining whether there is a display screen currently occupying the audio focus of the vehicle power amplifier; In response to the existence of a display screen currently occupying the audio focus of the whole vehicle power amplifier, determining the display screen currently occupying the audio focus of the whole vehicle power amplifier as the target display screen; In response to the fact that there is no display screen occupying the audio focus of the vehicle amplifier at present, the display screen closest to the user is determined according to the position information of the user who issued the voice command, and the display screen closest to the user is determined as the target display screen.

11. The voice control method according to claim 9 or 10, characterized in that: The step of determining the display screen closest to the user according to the position information of the user who issues the voice command comprises: Acquire an image of the user in the vehicle based on a vehicle-mounted camera, and determine the user's location information and location information of each display screen in the vehicle according to the image; The display screen closest to the user is determined according to the user location information and location information of each display screen in the vehicle.

12. The voice control method according to claim 9 or 10, characterized in that: The step of determining the display screen closest to the user according to the position information of the user who issues the voice command comprises: The voice command is received by microphones arranged at different positions in the vehicle to obtain voice signal strengths corresponding to different microphones; Determining the distance between each microphone and the user based on the voice signal strengths corresponding to different microphones; The display screen closest to the user is determined according to the distance between each microphone and the user.

13. The voice control method according to claim 12, characterized in that: The step of determining the display screen closest to the user according to the distance between each microphone and the user comprises: Determine a target microphone closest to the user according to the distance between each microphone and the user; determining the position of the target microphone as the user position; The display screen closest to the target microphone is determined as the display screen closest to the user.

14. The voice control method according to claim 1, characterized in that: Determining the state of each display screen being connected to a Bluetooth headset includes: Check the Bluetooth setting parameters of each display screen and determine whether the corresponding display screen is connected to a Bluetooth headset through the Bluetooth setting parameters.

15. The voice control method according to claim 1, characterized in that: The determining whether the voice instruction specifies a display screen includes: Determining whether the voice command includes preset display screen identity information; In response to the voice instruction including preset display screen identity information, determining that the voice instruction specifies a display screen; In response to the voice instruction not including preset display screen identity information, it is determined that the voice instruction does not specify a display screen.

16. The voice control method according to claim 1, characterized in that: Also includes: In response to the voice instruction designating a display screen, the display screen designated by the voice instruction is determined as a target display screen.

17. The voice control method according to claim 1, characterized in that: The display screens include at least two of a central control screen, a first screen located behind a driver's seat, and a second screen located behind a co-pilot's seat.

18. A voice control device, characterized in that: include: A first determination module, configured to determine, in response to receiving a voice instruction, whether the voice instruction specifies a display screen; A second determination module is used to determine the state of each display screen being connected to a Bluetooth headset in response to the voice instruction not specifying a display screen; The third determination module is used to determine the target display screen according to the state of each display screen being connected to the Bluetooth headset; A response module is used to respond to the voice command through the target display screen.

19. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the voice control method as described in any one of claims 1-17.

20. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the voice control method as described in any one of claims 1 to 17 is implemented.

Images