Voice interaction method and device, and storage medium

Abstract

The invention relates to the technical field of voice interaction, is applied to the fields of intelligent automobiles, Internet of Vehicles, mobile terminals and the like, and discloses a voice interaction method and device and a storage medium. The voice interaction method comprises the steps that when a first voice instruction of a first user is detected, a screen, such as a first screen, corresponding to the first user is firstly determined, then the first screen can be determined as a main voice screen, and the first screen is adopted to display a first voice interaction interface. In the process that the vehicle-mounted equipment receives the first voice instruction, if a second voice instruction initiated by a second user is detected and a screen corresponding to the second user is determined to be other screens, such as the second screen, the second screen is determined to be an auxiliary voice screen, and the second screen is adopted to display a second voice interaction interface. And meanwhile, displaying an interaction identifier representing that other user interactions exist by adopting a first screen. Based on the scheme, the multi-screen advantage can be fully played, multi-screen man-machine interaction is realized, and the user experience is effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of voice interaction technology, and in particular to a voice interaction method, device and storage medium. Background Art

[0002] Currently, voice assistants have been widely used in in-vehicle smart cockpits, realizing a variety of voice interaction functions, such as voice dialogue, voice wake-up, voice navigation, etc. In general, users generally interact with the computer through the main screen of the main driver's seat.

[0003] At present, with the development of vehicles, the in-vehicle system has developed from the main screen set in the main driver's seat to multiple screens. Taking a five-seater vehicle as an example, in addition to the main screen set in the main driver's seat, there are also screens set in front of the co-pilot and the back seats. This provides the hardware configuration conditions for users to perform voice interaction through multiple screens in the in-vehicle system. However, how to design the voice interaction method between users and multiple screens of the in-vehicle system to meet user needs and improve user experience is still an urgent problem to be solved. Summary of the invention

[0004] To solve the above problems, this article provides a voice interaction method, device and storage medium.

[0005] In a first aspect, the present invention provides a voice interaction method, which includes: detecting a first voice command of a first user; determining that a screen corresponding to a first position of the first user in a vehicle is a first screen, determining the first screen as a main voice screen, and using the first screen to display a first voice interaction interface corresponding to the first voice command; detecting a second voice command initiated by a second user; determining that a screen corresponding to a second position of the second user in the vehicle is a second screen, determining the second screen as a secondary voice screen, using the second screen to display a second voice interaction interface corresponding to the second voice command, and displaying a first interaction identifier on the first voice interaction interface, the first interaction identifier being used to indicate that there is currently a second user interacting with the second screen.

[0006] In this article, the above method can be used for vehicle-mounted equipment, and the vehicle-mounted equipment can be a car or a smart car, or it can be an electronic device installed on a car or a smart car. The first voice command can be a wake-up word, such as Xiaoyi, etc., or it can be a specific voice command, such as opening the car window, etc.; the first user can be the first speaking user mentioned later, and the second user can be the second speaking user mentioned later. The first position can be the seat of the first user in the vehicle determined by the vehicle-mounted device according to the sound source position of the first voice command; the first screen can be the screen corresponding to the first position determined by the vehicle-mounted device according to the preset relationship between the seat and the screen; the first voice interaction interface can be a voice assistant interface.

[0007] It can be understood that in this article, when a user initiates a voice interaction command, the vehicle-mounted equipment can detect the seat of each user who initiates the voice command in the vehicle based on the location of the sound source, activate the corresponding bearer screen according to the relationship between the in-vehicle screen and the seat distribution, and display the voice interaction content on the bearer screen.

[0008] In some embodiments, the first user may be the user who issues a voice command for the first time during a wake-up process, for example, a user who wakes up the vehicle's voice assistant for the first time. At this time, the corresponding first screen activated by the first user can be determined as the main voice screen, and other screens can be used as secondary voice screens. The first voice interaction interface will be displayed on the main voice screen; if it is detected at the same time that a second user has initiated a voice interaction command, the screen corresponding to the second user is the second screen, that is, the secondary voice screen, and the second voice interaction interface will be displayed on the second screen.

[0009] It can be understood that in this article, after the user activates the corresponding bearer screen, the voice interaction interface will be entered, and the voice command content of the corresponding user will be displayed in the voice interaction interface. The main voice screen can display the voice command content of the user interacting with the main voice screen and the interaction mark used to indicate that there are other users interacting with the secondary voice screen. The secondary voice screen can display the voice command content of the user interacting with the secondary voice screen.

[0010] Based on the above solution, the voice interactions of different users can be carried by their respective corresponding screens, and the user's voice interaction content will be displayed on the corresponding carrying screen, which can give full play to the advantages of multiple screens, realize multi-screen human-computer interaction, and effectively improve the user experience.

[0011] In a possible implementation, the first interaction identifier includes at least one of an interaction icon, a number of interactions, and an interaction position.

[0012] It can be understood that in this article, the first interaction identifier can be an interaction icon, used to prompt the first user that there are other people in the current car for voice interaction; it can be the number of interactions, used to display how many people are interacting in the current car; it can also be an interaction position, used to display the seats of other users who are performing voice interaction in the vehicle.

[0013] In a possible implementation, the first voice interaction interface displays the interaction content corresponding to the first voice instruction, and the second voice interaction interface displays the interaction content corresponding to the second voice instruction.

[0014] In a possible implementation, the detecting the second voice command initiated by the second user includes: detecting the second voice command initiated by the second user during the process of receiving the first voice command.

[0015] It can be understood that in this article, while the first user is speaking, the second user can initiate voice commands at the same time, and the interactive content corresponding to the second user's voice commands can be displayed on the carrier screen corresponding to the second user, that is, the voice interaction method mentioned in this article supports simultaneous interaction among multiple users and improves user experience.

[0016] In some embodiments, the process of receiving the first voice command may refer to any scenario in which the voice wake-up mark of the first screen has not disappeared or can identify that the interaction between the first user and the first screen is not completed.

[0017] In one possible implementation, the method also includes: in the process of receiving the first voice command, a third voice command initiated by a third user is detected; the screen corresponding to the third position of the third user in the vehicle is the first screen, and the first voice interaction interface displays the interactive content corresponding to the third voice command.

[0018] It can be understood that in this article, during the process of the first user interacting with the first screen, the third user can initiate voice commands at the same time. If the vehicle-mounted device detects that the screen corresponding to the seat where the third user is located is also the first screen, the voice interaction interface of the first screen can simultaneously display the voice interaction content of the third user, thereby improving the user interaction experience.

[0019] In some embodiments, if the in-vehicle device simultaneously detects that a fourth user or a fifth user or multiple users are interacting with the first screen via voice, the interactive content with the fourth user or the fifth user or multiple users will be displayed on the first screen at the same time.

[0020] In one possible implementation, the method also includes: in the process of receiving the second voice command, a fourth voice command initiated by a fourth user is detected; the screen corresponding to the fourth position of the fourth user in the vehicle is the second screen, and the second voice interaction interface displays a second interaction identifier, wherein the second interaction identifier is used to represent the number of people interacting with the second screen.

[0021] It can be understood that, in this article, during the process of the second user interacting with the second screen, the fourth user can initiate a voice command at the same time, and if the in-vehicle device detects that the screen corresponding to the seat where the fourth user is located is also the second screen, the voice interaction interface of the second screen can display the second interaction identifier. The second interaction identifier can be the number of people currently interacting with the second screen.

[0022] In a possible implementation, the method also includes: the second voice interaction interface displays the interaction content corresponding to the fourth voice instruction.

[0023] It can be understood that in this article, during the process of the second user interacting with the second screen, the fourth user can initiate voice commands at the same time. If the vehicle-mounted device detects that the screen corresponding to the seat where the fourth user is located is also the second screen, the voice interaction interface of the second screen can simultaneously display the voice interaction content of the fourth user.

[0024] In a possible implementation, the method further includes: the second voice interaction interface also displays a third interaction identifier, wherein the third interaction identifier is used to indicate that there is currently a first user interacting with the first screen.

[0025] It can be understood that in this article, when the first user and the second user interact at the same time, and the first screen corresponding to the first user and the second screen corresponding to the second user are different, an interaction mark can be displayed on the second screen to prompt the second user that there are multiple people in the current car for voice interaction.

[0026] In some embodiments, the third interaction identifier may be one or more of an interaction icon, a number of interactions, and an interaction position.

[0027] In one possible implementation, the method includes: determining a first position of a first user in a vehicle based on a sound source position of a first voice command, and determining a second position of a second user in the vehicle based on a sound source position of a second voice command; determining a screen corresponding to the first position as a first screen corresponding to the first user based on a relationship between a preset position and a screen, and determining a screen corresponding to the second position as a second screen corresponding to the second user.

[0028] It can be understood that in the embodiments of this article, the sound source of the voice command can be localized to determine the seat of the speaking user, and the vehicle-mounted equipment can determine the corresponding bearer screen when the user performs voice interaction based on the bearer screen preset rules formulated according to the in-vehicle screen and seat distribution.

[0029] In one possible implementation, the method includes: if it is determined that the screen corresponding to the first position of the first user in the vehicle is the third screen, and the third screen is in an abnormal state, based on a preset screen replacement rule, determining a replacement screen corresponding to the third screen as the first screen corresponding to the first user.

[0030] It can be understood that in this article, the vehicle-mounted equipment can formulate flow rules based on the distribution of screens and seats in the car. When some screens are in an abnormal state, for example, the screen is turned off, and the corresponding screen when the user performs voice interaction can be replaced with other screens. In some embodiments, the screen replacement rule can be a fixed setting of the replacement screen corresponding to each screen. In some embodiments, the screen replacement rule can also be to use the currently available screen closest to the user as the corresponding replacement screen. In this way, the interactive bearing screens of different seats can be determined, and the most convenient screen can be provided to passengers in each seat, thereby improving the user experience.

[0031] In one possible implementation, the method includes: the vehicle-mounted device's command processing of the first voice command takes precedence over the command processing of the second voice command, wherein the command processing includes at least one of a broadcast processing, a response processing, and an execution processing.

[0032] It can be understood that, in this article, the priority of the vehicle-mounted device in processing the voice command of the first speaking user at the level of answering, broadcasting, and execution can be set higher than the priority of processing the voice commands of other speaking users. In this way, the situation of chaotic voice interaction in the prior art can be avoided, such as multiple voice broadcasts sounding in the car at the same time, affecting the user interaction experience.

[0033] In a second aspect, this document provides an electronic device, comprising: a memory and a processor, wherein the memory is used to store instructions executed by one or more processors of the electronic device, and the processor is one of the one or more processors of the electronic device, and is used to execute the voice interaction method mentioned in this document.

[0034] In a third aspect, this document provides a vehicle-mounted device, including: a memory and a processor, the memory is used to store instructions executed by one or more processors of the vehicle-mounted device, and the processor is one of the one or more processors of the vehicle-mounted device, used to execute the voice interaction method mentioned in this document.

[0035] In a fourth aspect, this document provides a vehicle-mounted module, including: a processor and a memory, the memory stores a computer program, and the processor executes the computer program so that the vehicle-mounted module performs the voice interaction method mentioned in this document.

[0036] In a fifth aspect, this document provides a readable storage medium, wherein the readable storage medium stores instructions, and when the instructions are executed on an electronic device, the electronic device executes the voice interaction method mentioned in this document. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 According to some embodiments of the present invention, a schematic diagram of a scenario in which multiple screens are configured in a car is shown;

[0038] Figure 2AAccording to some embodiments of this document, a schematic diagram of a scenario of preemptive strategy voice interaction is shown;

[0039] Figure 2B According to some embodiments of the present invention, a screen diagram of a preemptive strategy voice interaction is shown;

[0040] Figure 3A According to some embodiments of this document, a schematic diagram of a scenario of concurrent strategic voice interaction is shown;

[0041] Figure 3B According to some embodiments of the present invention, a screen diagram of concurrent strategic voice interaction is shown;

[0042] Figure 4A According to some embodiments of this document, a schematic diagram of a first screen carrying method is shown;

[0043] Figure 4B According to some embodiments of this document, a schematic diagram of a second screen carrying method is shown;

[0044] Figure 4C According to some embodiments of this document, a schematic diagram of a third screen carrying method is shown;

[0045] Figure 4D According to some embodiments of this document, a schematic diagram of a fourth screen carrying method is shown;

[0046] Figure 5A According to some embodiments of the present invention, a schematic diagram of a scenario of a first main voice screen interaction mode is shown;

[0047] Figure 5B According to some embodiments of the present invention, a schematic diagram of a scenario of a second main voice screen interaction mode is shown;

[0048] Figure 5C According to some embodiments of the present invention, a schematic diagram of a scenario of a secondary voice screen interaction mode is shown;

[0049] Figure 6 According to some embodiments of this document, a flow chart of voice interaction is shown;

[0050] Figure 7 According to some embodiments of this document, a schematic diagram of a process of a main voice screen interaction mode is shown;

[0051] Figure 8 According to some embodiments of this document, a schematic diagram of a flow chart of a secondary voice screen interaction mode is shown;

[0052] Fig. 9 According to some embodiments herein, a vehicle architecture schematic diagram is shown. DETAILED DESCRIPTION

[0053] The illustrative embodiments of this document include, but are not limited to, a voice interaction method, device, and storage medium.

[0054] The following is a brief description of the application scenarios of the methods provided in the embodiments of this article.

[0055] Currently, some vehicles provide users with multi-screen human-computer interaction, such as Figure 1 As shown, the vehicle 10 is equipped with a central control screen 101, a driver's seat configuration screen 102, a co-driver's seat configuration screen 103 and a rear seat configuration screen 104. Users in different seats can initiate voice interactions with the voice assistants on the corresponding screens respectively to achieve the purpose of independent interaction.

[0056] The following introduces scenarios of multi-person voice interaction in some embodiments.

[0057] The following first introduces the scenario of voice interaction based on preemptive strategy.

[0058] The preemptive strategy for voice interaction means that after a seat wakes up the voice assistant, users in other seats cannot initiate voice interaction with the voice assistant at the same time until the voice assistant ends the current interaction process. Only then can users in other seats use the wake-up word to seize the interaction right. Figure 2A As shown, in vehicle 10, user A initiates a voice command of "close the windows" to the voice assistant. As shown in 2B, the voice assistant of vehicle 10 will be awakened and the voice interaction of "close the windows" will be displayed on the central control screen 101; if user B initiates a voice command of "play music" at this time, since user A has already awakened and occupied the voice assistant, the voice assistant will not respond to the voice command of user B. That is, the above method cannot support simultaneous interaction among multiple people, resulting in a poor user experience.

[0059] The following introduces the scenario of voice interaction based on concurrent strategy.

[0060] Concurrent strategy for voice interaction means that when multiple people issue commands to the voice assistant at the same time, the system will display multiple commands on the same screen and mark them in different positions. Figure 3A As shown, in the vehicle 10, user A initiates a voice command of "close the window", user B initiates a voice command of "play music", and user C initiates a voice command of "open the right rear window". Figure 3B As shown, the vehicle-mounted device will display multiple voice commands at the corresponding positions of the central control screen 101, and perform voice interaction at the same time. That is, although the above method can support multiple people to interact at the same time, there is still only one screen to display the user interaction content, and it is impossible to realize the interaction of multiple people and multiple screens, which also affects the user interaction experience.

[0061] Based on this, the embodiment of this article provides a voice interaction method. The vehicle-mounted device can first preset the bearing screens for users in different seats to perform human-computer interaction through preset rules. After that, when the vehicle-mounted device detects the user's voice command, it can determine the corresponding bearing screen of the user through the seat corresponding to the user's voice position. When it is detected that there are multiple people interacting at the same time, the voice interaction content of the corresponding user can be displayed based on the corresponding bearing screen. In this way, the most convenient bearing screen can be provided to users in each seat, giving full play to the advantages of multiple screens, realizing multi-screen human-computer interaction, and effectively improving the user experience.

[0062] It can be understood that the multi-user simultaneous interaction mentioned in this article means that other users issue interaction commands before the first user's interaction is completed, for example, before the voice wake-up mark disappears, or during the process of the vehicle-mounted device receiving voice commands.

[0063] In addition, in some embodiments, in the scenario of multiple people interacting at the same time, in addition to displaying the interaction content of the corresponding user, the bearer screen may also display other interaction identifiers to facilitate the user corresponding to the bearer screen to understand that there is currently multiple people interacting. For example, in some embodiments, the interaction identifier may be the number of people interacting with the current screen, or may be a voice interaction icon that indicates that there are other people interacting with other screens.

[0064] For example, in some embodiments, when the vehicle-mounted device detects that the first speaking user activates the voice assistant of the corresponding bearing screen (such as the first screen) for voice interaction, the voice interaction content corresponding to the current first speaking user will be displayed. At this time, if the vehicle-mounted device detects that a second speaking user interacts with the current voice screen, the current voice screen will simultaneously display the content of the second speaking user. If the vehicle-mounted device detects that a second speaking user interacts with other voice screens (such as the second screen), the voice screen corresponding to the current first speaking user will display an interactive icon to prompt the first speaking user that there are currently multiple people interacting. At the same time, the voice screen corresponding to the second speaking user will display the voice interaction content with the second speaking user. At this time, if a third speaking user interacts with the voice screen corresponding to the second speaking user, the voice screen will display the number of people who have voice interactions with the voice screen.

[0065] In some embodiments, the bearer screen corresponding to the first speaking user may be defined as the main voice screen, and other screens may be defined as secondary voice screens. The main voice screen will display the voice interaction content corresponding to the user whose bearer screen is the main voice screen. When other users are interacting with the secondary voice screen at the same time, the main voice screen will display an interaction icon to indicate that there are multiple people interacting at the moment; and the secondary voice screen will display the content of the current voice interaction with the secondary voice screen (i.e., the interaction content corresponding to the user whose bearer screen is the secondary voice screen) and the number of people interacting with the secondary voice screen.

[0066] In some embodiments, the vehicle-mounted device may predetermine different preset rules based on the distribution of screens and seats in the vehicle, thereby determining the screens that users in different seats interact with. Figure 4A As shown, in a five-seat vehicle 20, four screens are configured, namely, screen 201, screen 202, screen 203 and screen 204. The screen bearing the driver's seat 201A can be determined as screen 201, the screen bearing the co-pilot's seat 202A can be determined as screen 202, the screen bearing the second row left position 203A can be determined as screen 203, the screen bearing the second row middle position 201B can be determined as screen 201, and the screen bearing the second row right position 204A can be determined as screen 204. For another example, Figure 4B As shown, in a five-seat vehicle 20, three screens are configured, namely, screen 201, screen 202 and screen 203. The screen for the driver's seat 201A can be determined as screen 201 according to the principle of proximity, and the screen for the co-pilot seat 202A can be determined as screen 202 according to the principle of proximity. At the same time, the screens for the second row left position 203A, the second row middle position 203B and the second row right position 203C can be determined as screen 203. For another example, Figure 4C As shown, in a five-seat vehicle 20, two screens, screen 201 and screen 202, are configured. The screen for the driver's seat 201A can be determined as screen 201 based on the principle of proximity, and the screen for the co-pilot seat 202A can be determined as screen 202 based on the principle of proximity. At the same time, the screens for the second row left position 201B, the second row middle position 201C, and the second row right position 201D can be determined as screen 201. For another example, Figure 4D As shown, in the vehicle 20 configured with four screens, the Figure 4A The preset rules of the bearing screen of the vehicle 20 shown in the figure, if the screen 202 is in the off mode at this time, the bearing screen of the front passenger seat 201C can be re-determined as the screen 201 based on the flow rule (i.e. the preset screen replacement rule). In this way, the interactive bearing screens of different seats can be determined through the preset rules, and the most convenient screen can be provided to the user of each seat, thereby improving the user experience.

[0067] In some embodiments, the vehicle-mounted device can determine the primary and secondary voice screens according to the order in which the user initiates the voice interaction. The first speaking user activates the voice assistant of the corresponding carrier screen, and determines the screen as the primary voice screen, and the remaining screens are determined as secondary voice screens. The priority of the primary voice screen in answering, broadcasting, and execution can be set higher than that of the secondary voice screen. After the voice interaction ends, the primary and secondary voice screens are cancelled, and the primary and secondary voice screens are re-determined according to the order of initiating the voice interaction next time.

[0068] In this way, through the voice interaction method in this article, it is possible to clarify the voice interaction priority and screen priority, give full play to the advantages of multiple screens, achieve non-interference in voice interaction between different bearer screens, realize independent human-computer interaction on multiple screens, and effectively improve the user experience.

[0069] In some embodiments, the sound sensor in the vehicle will collect sound and convert the sound signal into a digital signal. The on-board device will recognize the digital signal, for example, detect the digital signal corresponding to the wake-up word (for example, open the window, etc.). At the same time, the sound sensor can locate the sound source to determine the seat of the speaking user. The on-board device can activate the voice assistant of the corresponding bearer screen according to the preset rules of the bearer screen. In the wake-up mode, the voice assistant will remain in the listening state and wait for the user's instructions.

[0070] In some embodiments, the sound sensor in the vehicle collects the sound and converts the sound into a digital signal. The vehicle-mounted equipment analyzes and processes the digital signal, identifies the text information in the digital signal, and displays it on the screen.

[0071] Combine the following Figure 5A Taking vehicle 20 as an example, the scenario in which the carrier screen corresponding to the second speaking user is the main voice screen is explained.

[0072] For example, Figure 5A As shown, the vehicle 20 is equipped with three screens, namely screen 201, screen 202 and screen 203. Figure 4BThe carrier screen preset rule of the vehicle 20 shown in the figure is that in the first time period, when the vehicle-mounted device detects that the user A on the right side of the second row first initiates the voice command of "turn on the music" and activates the corresponding carrier screen 203, the screen 203 will be determined as the main voice screen, and the screens 201 and 202 will be determined as the secondary voice screens. At the same time, the voice command 1 "turn on the music" of the user A on the right side of the second row will be displayed on the screen 203. At this time, if there is a second speaking user, that is, the user B in the middle of the second row, who simultaneously initiates the voice command "open the right rear window", and the carrier screen for voice interaction with the user B in the middle of the second row is also the screen 203, the screen 203 will simultaneously display the voice command 2 "open the right rear window" of the user B in the middle of the second row. In some embodiments, the priority of voice command 1 at the answering and broadcasting level is higher than that of voice command 2. For example, the vehicle-mounted device will first broadcast the voice command 1 "turn on the music" and then the voice command 2 "open the right rear window". In this way, the priority of voice interaction can be clarified and the user experience can be improved.

[0073] Combine the following Figure 5B Taking vehicle 20 as an example, the scenario in which the bearing screen corresponding to the second speaking user is the secondary voice screen is described.

[0074] For example, Figure 5B As shown, the vehicle 20 is equipped with three screens, namely screen 201, screen 202 and screen 203. Figure 4B The preset rules of the carrier screen of the vehicle 20 shown are that in the first time period, when the vehicle-mounted device detects that the second row right user A first initiates the voice command of "turn on the music" and activates the corresponding carrier screen 203, the screen 203 will be determined as the main voice screen, and the screens 201 and 202 will be determined as the secondary voice screens. At the same time, the voice command 1 "turn on the music" of the second row right user A will be displayed on the screen 203. At this time, if the second speaking user, the main driving user B, simultaneously initiates the voice command "open the right rear window", when the vehicle-mounted device detects that the corresponding carrier screen of the main driving user B is the screen 201, the interactive icon 2031 will be displayed on the screen 203 to remind the first speaking user, the second row right user A, that there is currently a multi-person interaction, and at the same time, the voice command 2 "open the right rear window" of the main driving user B will be displayed on the screen 201. Among them, screen 203 has a higher priority than screen 201 in terms of answering and broadcasting. For example, the vehicle-mounted device will first broadcast voice command 1 "turn on the music" and then broadcast voice command 2 "open the right rear window". In this way, the voice interaction priority and screen priority can be clearly defined, and independent human-computer interaction on multiple screens can be achieved, thereby improving the user experience.

[0075] Combine the following Figure 5C Taking vehicle 20 as an example, the scenario in which the bearing screen corresponding to the third speaking user is the secondary voice screen is described.

[0076] For example, Figure 5C As shown, the vehicle 20 is equipped with three screens, namely screen 201, screen 202 and screen 203. Figure 4B The preset rules of the carrier screen of the vehicle 20 shown in the figure are that when the first speaking user, the co-pilot user A, activates the screen 202 through the voice command 1 "turn on the music", the screen 202 will be determined as the main voice screen, and the screens 201 and 203 will be determined as the secondary voice screens. If the second speaking user, the second row right user B, activates the screen 203 through the voice command 2 "open the right rear window", if the vehicle-mounted device detects that the third speaking user, the second row middle user C, initiates the voice command "turn on the air conditioner", and the carrier screen for voice interaction with the second row middle user C is also the screen 203, a display box 2032 will pop up on the screen 203, showing the number of people "2" currently interacting with the screen 203. In this way, the interaction process of the second speaking user is not disturbed, and the multi-screen human-machine independent interaction is realized, which effectively improves the user experience.

[0077] In this way, through the voice interaction method in this article, we can clarify the voice interaction priority and screen priority, give full play to the advantages of multiple screens, and improve the user experience.

[0078] The following is based on Figure 6 The flow chart shown in FIG. 1 is used to describe the voice interaction method in the embodiment of this invention. The voice interaction method can be executed by the vehicle-mounted device, such as Figure 6 Specifically, the method comprises the following steps:

[0079] S601: Determine the bearing screen corresponding to each user's interaction.

[0080] It can be understood that in the embodiments of this article, in a vehicle equipped with multiple screens, different preset rules need to be pre-determined according to the distribution of screens and seats in the vehicle, thereby determining the screens that are used when users in different seats interact. Figure 4A , Figure 4B and Figure 4C As shown, vehicles with different configurations have different preset rules. For example, the screens carrying different seats can be determined as the screens closest to them based on the principle of proximity. Figure 4D As shown, when some screens are in the off mode, flow rules (i.e., screen replacement rules) can be formulated to redetermine the bearing screens corresponding to different seats. For example, after the bearing screens corresponding to some seats are turned off, their bearing screens can be redetermined as the central control screen. In some embodiments, the screen replacement rule can be a fixed setting of the replacement screen corresponding to each screen. In some embodiments, the screen replacement rule can also be to use the currently available screen closest to the user as the corresponding replacement screen. The preset rules for the bearing screens in the embodiments herein are not limited.

[0081] In some embodiments, the sound sensor in the vehicle-mounted device will collect sound and convert the sound signal into a digital signal. The vehicle-mounted device will recognize the digital signal, for example, detect the digital signal corresponding to the wake-up word (for example, open the window, etc.). At the same time, the sound sensor can locate the sound source to determine the seat of the speaking user. The vehicle-mounted device can activate the voice assistant of the corresponding bearer screen according to the preset rules of the bearer screen. In the wake-up mode, the voice assistant will remain in a listening state, waiting for the user's instructions.

[0082] S602: The first screen carrying the user instruction is defined as the main voice screen, and the remaining screens are defined as auxiliary voice screens.

[0083] It can be understood that in the embodiments of this article, the user can wake up the voice assistant of the current seat's screen through a wake-up word (for example, opening the window, etc.). If the vehicle-mounted device detects that the user who currently initiates the voice interaction is the first speaking user, the vehicle-mounted device will determine the screen that the user is interacting with as the main voice screen, and determine other screens as secondary voice screens.

[0084] In some embodiments, after the voice interaction ends, for example, the voice wake-up mark disappears, the main voice screen and the secondary voice screen will be cancelled, and the main voice screen and the secondary voice screen will be re-determined according to the order of initiating the voice interaction next time.

[0085] S603: For the main voice screen, the interaction content of the first speaking user is displayed. If there is a second speaking user interaction, when the bearing screen of the second speaking user is the same as the main voice screen, the content of the second speaking user is displayed; when the bearing screen of the second speaking user is different from the main voice screen, only the interaction icon is displayed.

[0086] It can be understood that in the embodiment of this article, after the vehicle-mounted device determines the bearer screen corresponding to the first speaking user as the main voice screen, the main voice screen will display the interactive content with the first speaking user. At this time, if the vehicle-mounted device detects that the second speaking user has activated the corresponding bearer screen, and the bearer screen is the main voice screen, the main voice screen will also display the content of the second speaking user; if the vehicle-mounted device detects that the bearer screen corresponding to the second speaking user is the secondary voice screen, the main voice screen will display the interactive icons, such as Figure 5B The icon 2031 is used to prompt the first speaking user that there are multiple people in the car currently performing voice interaction.

[0087] In some embodiments, in addition to displaying the interaction icon, the main voice screen may also display the interaction position corresponding to the speaking user whose carrying screen is the secondary voice screen, the number of people currently interacting, etc. This document does not limit this.

[0088] S604: For the secondary voice screen, if the hosting screen of the second speaking user is the same as this screen, the interaction content of the second speaking user is displayed; if there are third or more speaking users whose hosting screens are the same as this screen, the number of users interacting simultaneously is displayed.

[0089] It can be understood that in the embodiment of this article, when the vehicle-mounted device detects that the bearing screen corresponding to the second speaking user is the secondary voice screen, the secondary voice screen will display the current interaction content with the second speaking user. At this time, if the vehicle-mounted device detects that a third speaking user has activated the corresponding bearing screen, and the bearing screen corresponding to the third speaking user is the secondary voice screen, the secondary voice screen will display the number of people interacting with the secondary voice screen, such as Figure 5C The display frame 2032 is displayed so that the interaction process of the second speaking user is not disturbed.

[0090] In some embodiments, the secondary voice screen may also display the interaction content between the third speaking user and the secondary voice screen; the secondary voice screen may also display an interaction icon to remind the second speaking user that the first speaking user is currently interacting with the main voice screen. This document does not limit this.

[0091] The following is based on Figure 7 The flowchart shown in the figure details the interaction mode of the main voice screen in the voice interaction method in the embodiment of this article. Specifically, the method can be executed by the vehicle-mounted device, and the method includes the following steps:

[0092] S701: accepting a voice input from a first speaking user, and using a bearing screen corresponding to the first speaking user as a main voice screen.

[0093] It can be understood that in the embodiment of this article, after the vehicle-mounted device detects the wake-up word, it will wake up the bearer screen corresponding to the first speaking user according to the bearer screen preset rules. In the wake-up mode, the voice assistant of the bearer screen will remain in the monitoring state and wait for the user's instructions. At the same time, the vehicle-mounted device will determine the bearer screen corresponding to the first speaking user as the main voice screen, and the remaining screens will be determined as secondary voice screens.

[0094] S702: Control the main voice screen to display the first speaking user interaction result.

[0095] It can be understood that in the embodiment of this article, the sound sensor in the vehicle-mounted device will collect the voice of the first speaking user and convert the sound signal into a digital signal. The vehicle-mounted device will analyze and process the digital signal, identify the text information in the digital signal, and display it on the main voice screen.

[0096] S703: Determine whether there is a second speaking user interacting at the same time. If yes, proceed to S705; if no, proceed to S704.

[0097] It can be understood that in the embodiments of the present invention, when the main voice screen carries out human-computer interaction, the vehicle-mounted device will determine whether there is a second speaking user performing voice interaction with the carrying screen at the same time. If there is a second speaking user performing voice interaction at the same time, it will jump to S705 to determine whether the carrying screen corresponding to the second speaking user is the main voice screen; if only the first speaking user is performing voice interaction at present, that is, there is no second speaking user, it will jump to S704 to directly end the voice interaction process after the interaction of the first speaking user ends.

[0098] In some embodiments, simultaneous interaction means that the second speaking user issues an interaction instruction before the interaction of the first speaking user is completed, for example, before the voice wake-up mark disappears, or during the process of the in-vehicle device receiving the voice instruction.

[0099] S704: End.

[0100] It can be understood that in the embodiment of this article, when the first speaking user interacts with the main voice screen, if the vehicle-mounted device does not detect the presence of a second speaking user interacting at the same time, the voice interaction process is directly terminated after the first speaking user's interaction ends.

[0101] S705: Determine whether the screen carrying the second speaking user is the main voice screen. If yes, proceed to S706; if no, proceed to S707.

[0102] It can be understood that in the embodiments of the present invention, when the first speaking user interacts with the main voice screen, if the vehicle-mounted device detects that there is a second speaking user interacting with the vehicle-mounted screen at the same time, the vehicle-mounted device needs to determine whether the bearer screen corresponding to the second speaking user is the main voice screen according to preset rules. If the bearer screen corresponding to the second speaking user is the main voice screen, jump to S706 and display the content of the second speaking user on the main voice screen at the same time; if the bearer screen corresponding to the second speaking user is not the main voice screen but other secondary voice screens, jump to S707 and display the interactive icon on the main voice screen.

[0103] S706: Control the main voice screen to simultaneously display the second speaking user content.

[0104] It can be understood that in the embodiment of this article, if the vehicle-mounted device detects that the carrier screen corresponding to the second speaking user is the main voice screen, the vehicle-mounted device will recognize the text information in the voice command and display it on the main voice screen.

[0105] In some embodiments, when the main voice screen carries out human-computer interaction, if the vehicle-mounted device simultaneously detects that there are multiple people such as a third speaking user or a fourth speaking user having voice interaction with the main voice screen, the main voice screen will simultaneously display the interaction content with the third speaking user or the fourth speaking user.

[0106] S707: Control the main voice screen to display other people's interaction icons.

[0107] It can be understood that in the embodiment of this article, if the vehicle-mounted device detects that the bearing screen corresponding to the second speaking user is not the main voice screen but other secondary voice screens, an interactive icon will be displayed on the main voice screen, such as Figure 5B The icon 2031 is used to prompt the first speaking user that there are multiple people in the car currently performing voice interaction.

[0108] In some embodiments, when the main voice screen carries out human-computer interaction, if the vehicle-mounted device simultaneously detects that there are multiple people performing voice interaction with other secondary voice screens, only one interaction icon is displayed on the main voice screen.

[0109] The following is based on Figure 8 The flowchart shown in the figure details the secondary voice screen interaction mode in the embodiment of this article. Specifically, the method can be executed by the vehicle-mounted device, and the method includes the following steps:

[0110] S801: Accepting a voice input from a second speaking user, and determining that the screen corresponding to the second speaking user is a secondary voice screen.

[0111] It can be understood that in the embodiment of this article, after the first speaking user activates the voice assistant of the corresponding bearing screen, the vehicle-mounted device will determine it as the main voice screen, and other screens will be determined as secondary voice screens. At this time, if the vehicle-mounted device detects that a second speaking user initiates a voice command at the same time, and the vehicle-mounted device detects that the bearing screen corresponding to the second speaking user is another secondary voice screen according to the preset rules of the bearing screen, the vehicle-mounted device will wake up the secondary voice screen corresponding to the second speaking user. In the wake-up mode, the voice assistant of the secondary voice screen corresponding to the second speaking user will remain in the monitoring state and wait for the user's command.

[0112] S802: Control the secondary voice screen corresponding to the second speaking user to display the interaction result of the second speaking user.

[0113] It can be understood that in the embodiment of this article, the sound sensor in the secondary voice screen corresponding to the second speaking user will collect the voice of the second speaking user and convert the sound signal into a digital signal. The vehicle-mounted equipment will analyze and process the digital signal, identify the text information in the digital signal, and display it on the secondary voice screen corresponding to the second speaking user.

[0114] S803: Determine whether there is a third speaking user interacting at the same time. If yes, proceed to S805; if no, proceed to S804.

[0115] It can be understood that in the embodiment of the present invention, when the second speaking user is performing voice interaction with the secondary voice screen, the vehicle-mounted device will determine whether there is a third speaking user performing voice interaction with the bearing screen at the same time. If there is a third speaking user performing voice interaction at the same time, the process will go to S805 to determine whether the bearing screen corresponding to the third speaking user is the same secondary voice screen as the bearing screen corresponding to the second speaking user; if there is no third speaking user at present, the process will go to S804 to directly end the voice interaction process after the second speaking user interaction ends.

[0116] In some embodiments, simultaneous interaction means that the third speaking user issues an interaction instruction before the interaction of the second speaking user is completed, for example, before the voice wake-up mark disappears, or during the process of the in-vehicle device receiving the voice instruction.

[0117] S804: End.

[0118] It can be understood that in the embodiment of this document, if the in-vehicle device does not detect the presence of a third speaking user interacting simultaneously, the voice interaction process is directly terminated after the second speaking user ends the interaction.

[0119] S805: Determine whether the screen carrying the third speaking user is the same voice screen. If yes, proceed to S806; if no, proceed to S807.

[0120] It can be understood that in the embodiments of the present invention, when the second speaking user interacts with the secondary voice screen, if the vehicle-mounted device detects that there is a third speaking user interacting with the bearing screen at the same time, the vehicle-mounted device needs to determine according to preset rules whether the bearing screen corresponding to the third speaking user is the same secondary voice screen as the bearing screen corresponding to the second speaking user. If it is the same secondary voice screen, go to S806 to display the number of simultaneous speakers on the secondary voice screen; if it is not the same secondary voice screen, go to S807 to directly end the voice interaction process of the secondary voice screen after the second speaking user interaction ends.

[0121] S806: Control the secondary voice screen corresponding to the second speaking user to display the number of users speaking simultaneously.

[0122] It can be understood that in the embodiment of this article, if the vehicle-mounted device detects that the bearing screen corresponding to the third speaking user and the bearing screen corresponding to the second speaking user are the same secondary voice screen, the secondary voice screen will display the number of people interacting with the secondary voice screen, such as Figure 5C The display frame 2032 is displayed so that the interaction process of the second speaking user is not disturbed.

[0123] In some embodiments, if the vehicle-mounted device detects that the bearing screen corresponding to the third speaking user and the bearing screen corresponding to the second speaking user are the same secondary voice screen, the secondary voice screen may also display the interactive content with the third speaking user. This document does not limit this.

[0124] S807: End.

[0125] It can be understood that in the embodiment of this article, if the vehicle-mounted device detects that the bearing screen corresponding to the third speaking user is not the same secondary voice screen as the bearing screen corresponding to the second speaking user, the voice interaction process of the secondary voice screen corresponding to the second speaking user is directly terminated after the interaction of the second speaking user ends. And the interaction content corresponding to the third speaking user is displayed on the bearing screen corresponding to the third speaking user.

[0126] In this way, through the method in the embodiment of this article, multiple screens can be fully utilized to provide voice interaction services for nearby speaking users, and the most convenient screen can be provided for passengers in each seat, giving full play to the advantages of multiple screens, providing human-computer interaction services for multiple people at the same time, and not disturbing each other, thereby improving the user experience. The method of displaying the interactive content of multiple people on the main voice screen at the same time can be compatible with the situation where only one screen is available in the whole car; the method of displaying other people's interaction icons on the main voice screen can prompt the first speaking user that there are other speaking users in the car interacting with other screens; the secondary voice screen can directly display the interactive content of the second speaking user, and when carrying multiple people to interact, the number can be displayed to ensure that the interaction process of the second speaking user is not disturbed. In addition, the voice interaction priority and screen priority can be clearly defined, and the tendency can be reflected during the interaction, and the interactive instructions received by the vehicle-mounted equipment first are executed first, avoiding the confusion of voice interaction in the prior art.

[0127] This article provides an electronic device, including: a memory and a processor, wherein the memory is used to store instructions executed by one or more processors of the electronic device, and the processor is one of the one or more processors of the electronic device, and is used to execute the voice interaction method mentioned in this article.

[0128] This article provides a vehicle-mounted device, including: a memory and a processor, the memory is used to store instructions executed by one or more processors of the vehicle-mounted device, and the processor is one of the one or more processors of the vehicle-mounted device, which is used to execute the voice interaction method mentioned in this article.

[0129] This article provides a vehicle-mounted module, including: a processor and a memory, the memory stores a computer program, and the processor executes the computer program so that the vehicle-mounted module executes the voice interaction method mentioned in this article.

[0130] This article provides a readable storage medium, wherein the readable storage medium stores instructions, and when the instructions are executed on an electronic device, the electronic device executes the voice interaction method mentioned in this article.

[0131] It can be understood that the voice interaction method provided in the embodiments of this document is applicable to any vehicle-mounted device with a voice interaction function, and the embodiments of this document do not limit the type and form of the vehicle-mounted device. The vehicle-mounted device mentioned in the embodiments of this document can be used in any type of vehicle, such as Fig. 9 As shown, the embodiment of this article takes vehicle 100 as an example to introduce the vehicle mentioned in this article.

[0132] The vehicle 100 may include various subsystems, such as a travel system 102, a sensor system 104, a control system 106, one or more peripheral devices 108, and a power source 110, an onboard device 112, and a user interface 116. Optionally, the vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple elements. In addition, each subsystem and element of the vehicle 100 may be interconnected by wire or wirelessly.

[0133] Some or all functions of the vehicle 100 are controlled by the vehicle-mounted device 112. The vehicle-mounted device 112 may include at least one processor 113, which executes instructions 115 stored in a non-transitory computer-readable medium such as a memory 114. The vehicle-mounted device 112 may also be a plurality of computing devices that control individual components or subsystems of the vehicle 100 in a distributed manner. It is understood that in the embodiments of this document, the processor may be used to execute the voice interaction method mentioned in the embodiments of this document.

[0134] The memory 114 may contain instructions 115 (e.g., program logic) that may be executed by the processor 113 to perform various functions of the vehicle 100, including those described above. The memory 114 may also contain additional instructions, including instructions to send data to, receive data from, interact with, and / or control one or more of the travel system 102, the sensor system 104, the control system 106, and the peripherals 108.

[0135] The onboard device 112 may control functions of the vehicle 100 based on input received from various subsystems (e.g., the travel system 102, the sensor system 104, and the control system 106) and from the user interface 116. In some embodiments, the onboard device 112 may provide control over many aspects of the vehicle 100 and its subsystems.

[0136] In some embodiments, the vehicle-mounted device may also be a device including other vehicle-mounted components, such as multiple display screens, sound sensors, etc. In some embodiments, the vehicle-mounted device may also not include other vehicle-mounted components, such as a vehicle may include a display screen, a sound sensor, etc., but the vehicle-mounted device may realize the control of various components in the vehicle such as the display screen, the sound sensor, etc.

[0137] The travel system 102 may include components that provide powered movement for the vehicle 100. In some embodiments, the travel system 102 may include an engine 118, an energy source 119, a transmission 120, and wheels 121. The engine 118 may be an internal combustion engine, an electric motor, an air compression engine, or a combination of other types of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air compression engine. The engine 118 converts the energy source 119 into mechanical energy.

[0138] Examples of energy source 119 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. Energy source 119 may also provide energy to other systems of vehicle 100.

[0139] The transmission 120 can transmit mechanical power from the engine 118 to the wheels 121. The transmission 120 may include a gearbox, a differential, and a drive shaft. In some embodiments, the transmission 120 may also include other devices, such as a clutch. Among them, the drive shaft may include one or more shafts that can be coupled to one or more wheels 121.

[0140] The sensor system 104 may include several sensors that sense information about the environment surrounding the vehicle 100. For example, the sensor system 104 may include a global positioning system 122 (the global positioning system may be a global positioning system (GPS) system, or may be a Beidou system or other positioning systems), an inertial measurement unit (IMU) 124, a radar 126, and a camera 130. The sensor system 104 may also include sensors of the internal systems of the monitored vehicle 100 (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors may be used to detect objects and their corresponding characteristics (position, shape, direction, speed, etc.). Such detection and recognition are key functions for the safe operation of the vehicle 100.

[0141] The global positioning system 122 may be used to estimate the geographic location of the vehicle 100. The IMU 124 is used to sense the position and orientation changes of the vehicle 100 based on inertial acceleration. In some embodiments, the IMU 124 may be a combination of an accelerometer and a gyroscope.

[0142] The radar 126 may utilize radio signals, light signals, or laser signals to sense objects within the surrounding environment of the vehicle 100 .

[0143] The camera 130 may be used to capture multiple images of the surrounding environment of the vehicle 100. The camera 130 may be a still camera or a video camera.

[0144] The control system 106 is for controlling the operation of the vehicle 100 and its components. The control system 106 may include various elements, including a steering system 132 , a throttle 134 , a brake unit 136 , and a computer vision system 140 .

[0145] The steering system 132 is operable to adjust the forward direction of the vehicle 100. For example, in some embodiments, it may be a steering wheel system.

[0146] The throttle 134 is used to control the operating speed of the engine 118 and, in turn, the speed of the vehicle 100 .

[0147] The brake unit 136 is used to control the deceleration of the vehicle 100. The brake unit 136 can use friction to slow down the wheel 121. In some other embodiments, the brake unit 136 can convert the kinetic energy of the wheel 121 into electric current. The brake unit 136 can also take other forms to slow down the rotation speed of the wheel 121 to control the speed of the vehicle 100.

[0148] The computer vision system 140 can be operated to process and analyze the images captured by the camera 130 in order to identify objects and / or features in the environment surrounding the vehicle 100. The above-mentioned objects and / or features may include traffic signs, road boundaries, and obstacles. The computer vision system 140 can use object recognition algorithms, structure from motion (SFM) algorithms, video tracking, and other computer vision techniques. In some embodiments, the computer vision system 140 can be used to map the environment, track objects, estimate the speed of objects, etc.

[0149] The vehicle 100 interacts with external sensors, other vehicles, other computer systems, or users through peripherals 108. The peripherals 108 may include a wireless communication system 146, an onboard computer 148, a microphone 150, and / or a speaker 152.

[0150] In some embodiments, the peripheral device 108 provides a means for a user of the vehicle 100 to interact with the user interface 116. For example, the onboard computer 148 can provide information to the user of the vehicle 100. The user interface 116 can also operate the onboard computer 148 to receive input from the user. The onboard computer 148 can be operated via a touch screen. In other cases, the peripheral device 108 can provide a means for the vehicle 100 to communicate with other devices located in the vehicle. For example, the microphone 150 can receive audio (e.g., voice commands or other audio input) from a user in the vehicle 100. Similarly, the speaker 152 can output audio to the user of the vehicle 100.

[0151] The wireless communication system 146 can communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system 146 can use 4G cellular communication, such as a long term evolution (LTE) system, a universal mobile telecommunication system (UMTS), etc. The wireless communication system 146 can use a wireless local area network (WLAN) communication. In some embodiments, the wireless communication system 146 can use an infrared link or Bluetooth to communicate directly with the device.

[0152] The power source 110 can provide power to various components of the vehicle 100. In one embodiment, the power source 110 can be a rechargeable lithium-ion or lead-acid battery. One or more battery packs of such batteries can be configured so that the power source 110 provides power to various components of the vehicle 100. In some embodiments, the power source 110 and the energy source 119 can be implemented together.

[0153] The user interface 116 is used to provide information to or receive information from a user of the vehicle 100. Optionally, the user interface 116 may include one or more input / output devices within the set of peripherals 108, such as a wireless communication system 146, an onboard computer 148, a microphone 150, and a speaker 152.

[0154] The embodiments disclosed herein may be implemented in hardware, software, firmware, or a combination of these implementation methods. The embodiments herein may be implemented as a computer program or program code executed on a programmable system, the programmable system comprising at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0155] Program code can be applied to input instructions to perform the functions described herein and generate output information. The output information can be applied to one or more output devices in a known manner. For purposes of this article, a processing system includes any system having a processor such as, for example, a digital signal processor, a microcontroller, an application specific integrated circuit, or a microprocessor.

[0156] Program code can be implemented with high-level programming language or object-oriented programming language to communicate with the processing system. When necessary, program code can also be implemented with assembly language or machine language. In fact, the mechanism described herein is not limited to the scope of any specific programming language. In either case, the language can be a compiled language or an interpreted language.

[0157] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. For example, instructions may be distributed over a network or through other computer-readable media. Therefore, a machine-readable medium may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including, but not limited to, a floppy disk, an optical disk, an optical disk, a magneto-optical disk, a read-only memory (ROM), a random access memory (RAM), a magnetic card or an optical card, an erasable programmable read-only memory (EPROM), a flash memory, an electrically erasable programmable read-only memory (EEPROM), or a tangible machine-readable memory for transmitting information (e.g., a carrier wave, an infrared signal digital signal, etc.) using the Internet in an electrical, optical, acoustic, or other form of propagation signal. Accordingly, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a form readable by a machine (eg, a computer).

[0158] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.

[0159] It should be noted that the units / modules mentioned in the various device embodiments of this article are all logical units / modules. Physically, a logical unit / module can be a physical unit / module, or a part of a physical unit / module, or can be implemented as a combination of multiple physical units / modules. The physical implementation of these logical units / modules themselves is not the most important. The combination of functions implemented by these logical units / modules is the key to solving the technical problems proposed in this article. In addition, in order to highlight the innovative part of this article, the above-mentioned device embodiments of this article do not introduce units / modules that are not closely related to solving the technical problems proposed in this article, which does not mean that there are no other units / modules in the above-mentioned device embodiments.

[0160] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0161] While the present invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the present invention.

Claims

1. A voice interaction method, characterized in that: include: detecting a first voice command of a first user; Determining that a screen corresponding to a first position of the first user in the vehicle is a first screen, determining that the first screen is a main voice screen, and using the first screen to display a first voice interaction interface corresponding to the first voice command; detecting a second voice command initiated by a second user; Determine that the screen corresponding to the second position of the second user in the vehicle is the second screen, determine that the second screen is the secondary voice screen, use the second screen to display the second voice interaction interface corresponding to the second voice command, and display the first interaction identifier on the first voice interaction interface, wherein the first interaction identifier is used to indicate that the second user is currently interacting with the second screen.

2. The method according to claim 1, characterized in that The first interaction identifier includes at least one of an interaction icon, a number of interactions, and an interaction position.

3. The method according to claim 1, characterized in that The first voice interaction interface displays the interaction content corresponding to the first voice instruction, and the second voice interaction interface displays the interaction content corresponding to the second voice instruction.

4. The method according to claim 1, characterized in that: The detecting a second voice instruction initiated by a second user includes: detecting the second voice instruction initiated by the second user during the process of receiving the first voice instruction.

5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: In the process of receiving the first voice command, detecting a third voice command initiated by a third user; The screen corresponding to the third position of the third user in the vehicle is the first screen, and the first voice interaction interface displays the interaction content corresponding to the third voice command.

6. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: In the process of receiving the second voice command, detecting a fourth voice command initiated by a fourth user; The screen corresponding to the fourth position of the fourth user in the vehicle is the second screen, and the second voice interaction interface displays a second interaction identifier, which is used to represent the number of people interacting with the second screen.

7. The method according to claim 6, characterized in that The method further comprises: The second voice interaction interface also displays the interaction content corresponding to the fourth voice command.

8. The method according to claim 1, characterized in that: The method further comprises: The second voice interaction interface displays a third interaction identifier, and the third interaction identifier is used to indicate that the first user is currently interacting with the first screen.

9. The method according to any one of claims 1 to 8, characterized in that: The method comprises: Determine a first position of the first user in the vehicle based on the sound source position of the first voice command, and determine a second position of the second user in the vehicle based on the sound source position of the second voice command; Based on a preset relationship between a position and a screen, the screen corresponding to the first position is determined as the first screen corresponding to the first user, and the screen corresponding to the second position is determined as the second screen corresponding to the second user.

10. The method according to any one of claims 1 to 8, characterized in that: If it is determined that the screen corresponding to the first position of the first user in the vehicle is the third screen, and the third screen is in an abnormal state, a replacement screen corresponding to the third screen is determined as the first screen corresponding to the first user based on a preset screen replacement rule.

11. The method according to any one of claims 1 to 8, characterized in that: The command processing of the first voice command takes precedence over the command processing of the second voice command; The instruction processing includes at least one of a broadcast processing, a response processing, and an execution processing.

12. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store instructions executed by one or more processors of the electronic device, and the processor is one of the one or more processors of the electronic device, and is used to execute the voice interaction method described in any one of claims 1-11.

13. A vehicle-mounted device, characterized in that: include: A memory and a processor, wherein the memory is used to store instructions executed by one or more processors of the vehicle-mounted device, and the processor is one of the one or more processors of the vehicle-mounted device, and is used to execute the voice interaction method described in any one of claims 1-11.

14. A vehicle-mounted module, characterized in that: include: A processor and a memory, wherein the memory stores a computer program, and the processor executes the computer program so that the vehicle-mounted module executes the voice interaction method according to any one of claims 1 to 11.

15. A readable storage medium, characterized in that: The readable medium stores instructions, which, when executed on an electronic device, enable the electronic device to execute the voice interaction method according to any one of claims 1 to 11.

Images