Vehicle and voice interaction method

Abstract

A voice interaction method, comprising: in the process of controlling a first display screen of a vehicle in a cross-screen mode on the basis of a first voice control instruction from a first sound area, in response to a second voice control instruction from a second sound area, displaying in the first display screen a voice window corresponding to the second sound area. Also provided are a controller, a computer-readable storage medium, and a vehicle.

Description

Vehicle and voice interaction methods

[0001] Related cross-references

[0002] This application is based on and claims priority to Chinese Patent Application No. 202410501612.2, filed on April 24, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of intelligent driving technology, and in particular to a vehicle and a voice interaction method thereof. Background Technology

[0004] The vehicle can be equipped with multiple displays, each located in a different audio zone. Currently, for each audio zone, the vehicle can only interact with the displays located in that specific audio zone based on voice control commands from the driver and passengers within that zone.

[0005] This shows that the freedom of voice interaction in vehicles is currently quite low. Summary of the Invention

[0006] This application provides a vehicle and its voice interaction method, which can solve the problem of low degree of freedom in current vehicle voice interaction. The technical solution is as follows:

[0007] On the one hand, a voice interaction method is provided, the method comprising:

[0008] During the process of controlling the vehicle's first display screen across screens based on a first voice control command from the vehicle's first voice zone, in response to a second voice control command from the vehicle's second voice zone, a voice window corresponding to the second voice zone is displayed on the first display screen;

[0009] The first display screen also shows the voice window corresponding to the first audio zone.

[0010] On the other hand, a controller is provided, the controller comprising:

[0011] processor;

[0012] Memory used to store the processor's executable instructions;

[0013] The processor is configured to execute the instructions to implement the vehicle control method as described above.

[0014] In another aspect, a computer-readable storage medium is provided, wherein when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the vehicle control method as described above.

[0015] In another aspect, a vehicle is provided, the vehicle including the controller as described above.

[0016] The beneficial effects of the technical solution provided in this application can include at least the following:

[0017] This application provides a vehicle and a voice interaction method therewith. In the process of controlling the vehicle's first display screen across screens based on a first voice control command from a first voice zone, the method can also respond to a second voice control command from a second voice zone by displaying a voice window corresponding to the second voice zone on the first display screen. Therefore, this method supports cross-screen control of the first display screen, and while controlling the first display screen across screens from the first voice zone, it can also respond to control of the first display screen from the second voice zone, thus effectively improving the freedom and flexibility of voice interaction.

[0018] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0019] Figure 1 is a flowchart of a voice interaction method according to an exemplary embodiment;

[0020] Figure 2 is a flowchart of another voice interaction method provided according to an exemplary embodiment;

[0021] Figure 3 is a schematic diagram of a first display screen showing a voice window according to an exemplary embodiment;

[0022] Figure 4 is a schematic diagram of the response result of a second voice command according to an exemplary embodiment;

[0023] Figure 5 is a block diagram of a controller provided according to an exemplary embodiment. Detailed Implementation

[0024] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0025] This application provides a vehicle equipped with multiple displays. These displays may include: a central control screen, a passenger-side display, a first rear-seat display (also referred to as a left rear-seat display), and a second rear-seat display (also referred to as a right rear-seat display). The first rear-seat display can be mounted on the back of the driver's seat. The second rear-seat display can be mounted on the back of the passenger-side seat.

[0026] The vehicle's cabin may include multiple sound zones, each corresponding to a physical space within the cabin. These multiple sound zones may include: a driver's sound zone, a front passenger sound zone, a first rear sound zone (also known as a left rear sound zone), and a second rear sound zone (also known as a right rear sound zone).

[0027] These multiple displays can correspond one-to-one with the multiple audio zones, and each display can be located in a corresponding audio zone. Furthermore, for each audio zone, the vehicle can interact with the driver and passengers by controlling the display located in that zone based on voice control commands from that zone.

[0028] This application provides a voice interaction method applied to a vehicle (such as a vehicle controller). Referring to Figure 1, the method includes:

[0029] Step 101: During the process of controlling the vehicle's first display screen across screens based on the first voice control command from the vehicle's first voice zone, in response to the second voice control command from the vehicle's second voice zone, the voice window corresponding to the second voice zone is displayed on the first display screen.

[0030] The first display screen also displays a voice window corresponding to the first audio zone. The first display screen can be any of the vehicle's multiple display screens. For example, the first display screen can be the vehicle's central control screen. The first audio zone can be any audio zone in the vehicle other than the one displayed on the first display screen. The second audio zone is different from the first audio zone.

[0031] Each voice zone corresponds to a voice window that allows occupants within that zone to interact with the vehicle's first display screen. During interaction, the first display screen can be controlled across different voice zones. That is, not only can the voice zone containing the first display screen control it, but voice zones outside the first display screen's zone can also control it. This allows the vehicle to interact not only with occupants within the first display screen's voice zone, but also with occupants within voice zones outside the first display screen's zone, thus improving the flexibility of voice interaction. Here, "display screen controlled by voice zone" means that the display screen is controlled by voice control commands originating from that voice zone.

[0032] In summary, this application provides a voice interaction method. During the process of controlling a vehicle's first display screen across screens based on a first voice control command from a first voice zone, this method can respond to a second voice control command from a second voice zone by displaying a voice window corresponding to the second voice zone on the first display screen. Therefore, this method supports cross-screen control of the first display screen, and while controlling the first display screen from the first voice zone, it can also respond to control of the first display screen from the second voice zone, thus effectively improving the freedom and flexibility of voice interaction.

[0033] Figure 2 is a flowchart of another voice interaction method provided in an embodiment of this application, which can be applied to vehicles. Referring to Figure 2, the method may include:

[0034] Step 201: During the process of controlling the vehicle's first display screen across screens based on the first voice control command from the vehicle's first voice zone, in response to the second voice control command from the vehicle's second voice zone, the voice window corresponding to the second voice zone is displayed on the first display screen.

[0035] The first display screen also displays a voice window corresponding to the first audio zone. The first display screen can be any of the vehicle's multiple display screens. For example, the first display screen can be the vehicle's central control screen. The first audio zone can be any audio zone in the vehicle other than the one displayed on the first display screen. The second audio zone is different from the first audio zone.

[0036] Each voice zone corresponds to a voice window that allows occupants within that zone to interact with the vehicle's first display screen. During interaction, the first display screen can be controlled across different voice zones. That is, not only can the voice zone containing the first display screen control it, but voice zones outside the first display screen's zone can also control it. This allows the vehicle to interact not only with occupants within the first display screen's voice zone, but also with occupants within voice zones outside the first display screen's zone, thus improving the flexibility of voice interaction. Here, "display screen controlled by voice zone" means that the display screen is controlled by voice control commands originating from that voice zone.

[0037] Understandably, if the first display screen is not located in the second audio zone, the second voice control command may include: an identifier for the first display screen, and control operations for the vehicle. This identifier can be used to uniquely identify the first display screen, such as its name. If the first display screen is located in the second audio zone, the second voice command does not need to include the identifier for the first display screen; it only needs to indicate control operations for the vehicle.

[0038] For example, assuming the first display screen is the central control screen, and the second audio zone is not the driver's audio zone where the central control screen is located, then the second voice control command could be "Central control XX", where XX can be a control operation for the vehicle. For example, it could be "Open music on the central control screen," "Open map on the central control screen," "Navigate to location A on the central control screen," or "Navigate to location A, view on the central control screen." If the second audio zone is the driver's audio zone where the central control screen is located, then the second voice control could be "Open music," "Open map," or "Navigate to location A."

[0039] In this embodiment, the voice window corresponding to the first audio region and the voice window corresponding to the second audio region may be displayed in different positions on the first display screen. Alternatively, the voice window corresponding to the first audio region and the voice window corresponding to the second audio region may be the same window.

[0040] It is understandable that when the first display screen is in a cross-screen interaction state (i.e., under cross-screen control), the voice windows corresponding to different audio zones on different sides of the vehicle may be displayed in different positions on the first display screen. In this case, if the first and second audio zones are located on different sides of the vehicle, the voice windows corresponding to the first and second audio zones may be displayed in different positions on the first display screen. If the first and second audio zones are located on the same side of the vehicle, the voice windows corresponding to the first and second audio zones are the same window. That is, multiple audio zones located on the same side of the vehicle share a single voice window.

[0041] For example, assuming the vehicle is a five-seater, the driver's voice area and the left rear voice area can share a voice window, and the passenger's voice area and the right rear voice area can share a voice window.

[0042] Alternatively, when the first display screen is in cross-screen interaction mode, the voice windows corresponding to different rows of the vehicle can be displayed in different positions on the first display screen. In this case, if the first and second voice zones are located in different rows of the vehicle, the voice windows corresponding to the first and second voice zones can be displayed in different positions on the first display screen. If the first and second voice zones are located in the same row of the vehicle, the voice windows corresponding to the first and second voice zones are the same window.

[0043] Understandably, before determining whether the first and second sound zones are located on the same side of the vehicle, the vehicle can first determine the second sound zone. Specifically, the vehicle is equipped with multiple sound acquisition devices, each corresponding to a specific sound zone. The vehicle can identify the target sound acquisition device that acquires the second voice control command and define the sound zone where that target sound acquisition device is located as the second sound zone.

[0044] Optionally, if the first and second sound zones are located on different sides of the vehicle, and the voice windows corresponding to the first and second sound zones are displayed in different positions on the first display screen, the voice window corresponding to the target sound zone located on the left side of the vehicle can be displayed in the upper left corner of the first display screen, and the voice window corresponding to the target sound zone located on the right side of the vehicle can be displayed in the upper right corner of the first display screen. Here, the target sound zone is one of the first and second sound zones.

[0045] Alternatively, the voice windows corresponding to the first and second audio zones can both be displayed in the middle area of ​​the upper half of the first display screen. Furthermore, the voice window for the target audio zone located on the left side of the vehicle can be displayed in the left half (or upper half) of this middle area, and the voice window for the target audio zone located on the right side of the vehicle can be displayed in the right half (or lower half) of this middle area. This embodiment does not limit the display positions of the voice windows corresponding to the first and second audio zones; it only requires that the display positions of the voice windows corresponding to the first and second audio zones be different.

[0046] It is understandable that when the first display screen shows the voice window corresponding to the second audio zone, the vehicle can control the second display screen in the second audio zone to cancel the display of the voice window corresponding to the second audio zone shown on the second display screen.

[0047] Step 202: In the voice window corresponding to the second voice zone, display the text of the second voice control command.

[0048] In response to the second voice control command, the vehicle can also obtain the text of the second voice control command and display the text in the voice window corresponding to the second voice zone displayed on the first display screen.

[0049] For example, the vehicle can display the text while displaying the voice window.

[0050] For example, suppose the first display screen is the central control screen, the second audio zone is the driver's audio zone, and the voice window corresponding to the driver's audio zone is displayed in the upper left corner of the first display screen. Suppose the second voice command is "Open map", then as shown in Figure 3, the upper left corner of the central control screen can display voice window 01, which displays the text "Open map".

[0051] Assuming the first voice zone is the passenger-side voice zone, and the vehicle has already controlled the first display screen based on the first voice control command from the first voice zone before receiving the second voice control command. Assuming the voice window corresponding to the passenger-side voice zone is displayed in the upper right corner of the first display screen, it can also be seen from Figure 3 that a voice window 02 is also displayed in the upper right corner of the central control screen.

[0052] In this embodiment, when the voice window corresponding to the first voice zone and the voice window corresponding to the second voice zone are the same window, the process of displaying the text of the second voice control command in the voice window corresponding to the second voice zone may include: if the second voice control command meets preset conditions, it is determined that the second voice zone has taken over control of the first display screen, that is, the control of the first display screen belongs to the second voice zone, and then the text of the second voice control command is displayed in the voice window corresponding to the second voice zone. The preset conditions for the second voice zone may be pre-stored by the vehicle.

[0053] For example, assuming that voice zones on the same side of the vehicle share a single voice window, if the second voice zone is the front voice zone, the preset conditions could include: the vehicle is operating in a full-time wake-up-free mode, the second voice control command contains a first preset wake-up word, and the format of the second voice control command is the format of a voice control command in OneShot mode; or, a touch operation on the steering wheel button is received before the second voice control command is received. If the second voice zone is the rear voice zone, the preset condition could be: the second voice control command contains a second preset wake-up word. Both the first and second preset wake-up words can be pre-stored by the vehicle. OneShot is a voice interaction mode that allows users to issue control commands directly without waiting for wake-up feedback, and supports wake-up + recognition, wake-up + dictation, and wake-up + semantic operation methods.

[0054] Therefore, multiple audio zones sharing a voice window will compete for control of the first display screen. The audio zone that gains control will only interrupt the voice control commands input from the non-controlling audio zone. Correspondingly, the non-controlling audio zone will not exit cross-screen interaction, but will continue to control the first display screen after gaining control again. Furthermore, the display screen containing the non-controlling audio zone will not take over displaying the voice window corresponding to that audio zone.

[0055] It is understandable that, when the first and second voice zones do not share a voice window, the process of the vehicle interacting with the first display screen based on the first voice control command from the first voice zone is independent of the process of interacting with the first display screen based on the second voice control command from the second voice zone, and they will not interrupt each other.

[0056] Step 203: Execute the second voice control command.

[0057] After receiving the second voice control command, the vehicle can also execute the second voice empty command, that is, control the vehicle according to the control operation indicated by the second voice empty command.

[0058] For example, assuming the second voice control command is "open map", the vehicle can activate the map application installed in the vehicle's operating system and control the first display screen to show the application interface of the map application.

[0059] Step 204: Display the first prompt message.

[0060] The first notification message indicates that the second voice control command has been executed. This allows drivers and passengers to easily know the execution status of the second voice control command.

[0061] Optionally, the first prompt can be a text prompt or a voice prompt. If the first prompt is a text prompt, the vehicle can display the text prompt in the voice window corresponding to the second audio zone. If the first prompt is a voice prompt, the vehicle can broadcast the first prompt while dynamically displaying a speaker icon in the voice window corresponding to the second audio zone.

[0062] For example, if the second voice command is "open the car window", then the first prompt message can be "the car window is open".

[0063] Step 205: Display the response result after the second voice control command is executed in the area outside all voice windows on the first display screen.

[0064] The response result may include information to be presented to the driver and passengers after the second voice control command is executed. Optionally, the response result may be displayed in the form of a card.

[0065] Optionally, the vehicle can control the first display screen to show the response result after the second voice control command is executed, below the voice window corresponding to the second voice zone.

[0066] For example, suppose the first display screen is the central control screen, the second audio zone is the driver's audio zone, and the voice window corresponding to the driver's audio zone is displayed in the upper left corner of the first display screen. Suppose the second voice command is "How's the weather?", then as shown in Figure 4, below the voice window 01 displayed in the upper left corner of the central control screen, a weather card 03 can be displayed, which shows the weather.

[0067] In this embodiment, in response to a second voice control command from the second voice zone, the vehicle can also control the first display screen to display an identifier for the second voice zone, so as to remind the driver and passengers of the voice zone currently being controlled across screens on the first display screen. The identifier for the second voice zone can be used to uniquely identify the second voice zone. For example, it can be the name of the second voice zone.

[0068] Optionally, the vehicle may display the identifier of the second audio zone in the voice window corresponding to the second audio zone displayed on the first display screen.

[0069] For example, referring to Figure 3, the first voice window 01 can display the label "Driver" for the first voice zone, and the second voice window 02 can display the label "Passenger" for the second voice zone.

[0070] In this embodiment, in response to a second voice control command from a second audio zone, the vehicle can also control a second display screen located in the second audio zone to display a second prompt message. This second prompt message indicates that the first display screen is being controlled across screens. For example, the second prompt message could be the text "Cross-screen control in progress".

[0071] Optionally, the location of the second prompt information on the second display screen can be: the display location of the voice window corresponding to the second audio zone on the second display screen.

[0072] In this embodiment, when the first display screen is a central control screen, after the vehicle enters a first preset state, it can exit the voice windows corresponding to other voice zones on the first display screen besides the voice zone where the central control screen is located. The first preset state includes: reversing state and / or turning state.

[0073] Therefore, once the vehicle enters the first preset state, all other voice zones exit the voice window on the central control screen, and the vehicle will only continue to recognize voice control commands from the driver's voice zone. In other words, at this time, the vehicle will only respond to the driver's voice control commands to control the central control screen. This improves vehicle driving safety.

[0074] In this embodiment, when the first display screen is a central control screen, and the central control screen also displays a voice window corresponding to the audio zone of the central control screen, the vehicle can exit all voice windows on the first display screen after entering the second preset state. The second preset state includes: incoming call status or U-turn status. This improves vehicle driving safety.

[0075] In this embodiment of the application, the vehicle can also control the second audio zone to exit cross-screen control of the first display screen.

[0076] In the first optional implementation, the vehicle's cross-screen interaction mode is a single-interaction mode. In this mode, the vehicle recognizes and executes a second voice control command each time it controls the first display screen. After displaying the first prompt, the vehicle can then exit the voice window corresponding to the second audio zone on the first display screen.

[0077] It is understandable that exiting the voice window corresponding to the second audio zone on the first display screen can include: the second audio zone relinquishing its cross-screen control over the first display screen, meaning that voice control commands from the second audio zone no longer have control over the first display screen. Furthermore, if the voice window corresponding to the second audio zone displayed on the first display screen only corresponds to the second audio zone, i.e., the second audio zone does not share a voice window with other audio zones, then exiting the voice window corresponding to the second audio zone can also include: controlling the first display screen to undisplay the voice window.

[0078] In the second optional implementation, the vehicle's cross-screen interaction mode is a continuous interaction mode. In this mode, the vehicle can continuously recognize and execute voice control commands from the second voice zone within the target duration corresponding to that zone, enabling continuous interaction based on those commands. If the vehicle determines that the display duration of the voice window corresponding to the second voice zone has reached the target duration, it can exit the voice window corresponding to the second voice zone on the first display screen. The target duration for the second voice zone can be pre-stored by the vehicle.

[0079] For example, when a vehicle is controlling a first display screen across screens based on a first voice control command from the vehicle's first voice zone, if it receives a second voice control command from a second voice zone, it can start timing. Then, after the timing duration reaches the target duration corresponding to the second voice zone, the vehicle can exit the voice window corresponding to the second voice zone on the first display screen.

[0080] Optionally, the vehicle can start a countdown or a countdown after receiving a second voice control command from the second voice zone.

[0081] In the third alternative implementation, the vehicle can receive an exit control command and then, in response to the exit control command, exit the voice window corresponding to the second audio zone on the first display screen.

[0082] The exit control command can be a voice command or triggered by a touch operation on a preset button. For example, the voice command could be: "Exit cross-screen control", "Exit control", or "I'm not controlling anymore".

[0083] Optionally, the exit control command can originate from the second audio zone, meaning it can be issued by the driver or passenger located in the second audio zone. For example, if the driver or passenger located in the second audio zone does not need to control the first display screen across screens via the second audio zone, they can issue a voice-based exit control command.

[0084] Optionally, the preset button can be the exit control displayed on the second-zone screen. This exit control can display a second prompt message. Alternatively, if the second-zone is the driver's zone, the preset button can be the steering wheel control button.

[0085] As described above, in the first and second implementation methods, the vehicle automatically exits the voice window corresponding to the second audio zone on the first display screen. In the third implementation method, the vehicle passively exits the voice window corresponding to the second audio zone on the first display screen in response to an exit control command issued by the driver or passenger.

[0086] It is understandable that whether the exit is automatic or involuntary, the cross-screen state of the first display screen will not be interrupted after exiting. "Not interrupting the cross-screen interaction state of the first display screen" means that the vehicle will not immediately cancel the display of the response results of the voice control commands shown before exiting, following the exit of the voice window.

[0087] In this embodiment, even after exiting the voice window corresponding to the second audio zone on the first display screen, the vehicle can still control the second display screen located in the second audio zone to display the corresponding voice window. That is, after exiting the voice window corresponding to the second audio zone on the first display screen, the second display screen can take over displaying that voice window. Subsequently, based on voice control commands from the second audio zone, the vehicle can control the second display screen to interact with the driver and passengers.

[0088] Optionally, if the vehicle loses power while the first display screen is in cross-screen interaction mode, the first display screen can be controlled to maintain the cross-screen interaction state before the power outage after power is restored. That is, the cross-screen interaction state of the first display screen can be remembered from the last time.

[0089] In this context, controlling the first display screen to maintain the cross-screen interactive state before the power outage can refer to: controlling the first display screen to display the voice window that was displayed before the power outage, as well as the response results of the voice control commands.

[0090] It's understandable that after the vehicle is powered back on, it will control the first display screen to show the default content, meaning it will no longer display content that is in cross-screen mode.

[0091] It is understood that the order of the steps in the voice interaction method provided in this application embodiment can be appropriately adjusted, and the steps can be added or removed as appropriate. For example, steps 202 to 205 can also be deleted as appropriate. Any variations that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application, and therefore will not be elaborated further.

[0092] In summary, this application provides a voice interaction method. During the process of controlling a vehicle's first display screen across screens based on a first voice control command from a first voice zone, this method can respond to a second voice control command from a second voice zone by displaying a voice window corresponding to the second voice zone on the first display screen. Therefore, this method supports cross-screen control of the first display screen, and while controlling the first display screen from the first voice zone, it can also respond to control of the first display screen from the second voice zone, thus effectively improving the freedom and flexibility of voice interaction.

[0093] This application embodiment provides a controller, as shown in FIG5, which includes a processor 301. The processor 301 is used for:

[0094] During the process of controlling the vehicle's first display screen across screens based on the first voice control command from the vehicle's first voice zone, in response to the second voice control command from the vehicle's second voice zone, the voice window corresponding to the second voice zone is displayed on the first display screen;

[0095] The first display screen also shows the voice window corresponding to the first audio zone.

[0096] Optionally, the voice window corresponding to the first audio zone and the voice window corresponding to the second audio zone may be displayed in different positions on the first display screen.

[0097] Optionally, if the first and second audio zones are located on different sides of the vehicle, the voice window corresponding to the first audio zone and the voice window corresponding to the second audio zone will be displayed in different positions on the first display screen.

[0098] Optionally, the voice window corresponding to the target sound zone located on the left side of the vehicle is displayed in the upper left corner of the first display screen;

[0099] The voice window corresponding to the target sound zone located on the right side of the vehicle is displayed in the upper right corner of the first display screen;

[0100] The target pitch range is one of the pitch ranges between the first and second pitch ranges.

[0101] Optionally, the voice window corresponding to the first voice region and the voice window corresponding to the second voice region can be the same window.

[0102] Optionally, if the first and second audio zones are located on the same side of the vehicle, the voice window corresponding to the first audio zone and the voice window corresponding to the second audio zone are the same window.

[0103] Optionally, the processor 301 can also be used for:

[0104] The text of the second voice control command is displayed in the voice window corresponding to the second voice zone;

[0105] Execute the second voice control command;

[0106] The first prompt message is displayed, indicating that the second voice control command has been executed.

[0107] Optionally, the voice window corresponding to the first audio region and the voice window corresponding to the second audio region are the same window. The processor 301 can be used for:

[0108] If the second voice control command meets the preset conditions, the second voice zone will be determined to interrupt control of the first display screen, and the text of the second voice control command will be displayed in the voice window corresponding to the second voice zone.

[0109] Optionally, the processor 301 can also be used for:

[0110] After displaying the first prompt message, exit the voice window corresponding to the second audio zone on the first display screen.

[0111] Optionally, the processor 301 can also be used for:

[0112] The second display screen located in the second audio zone is controlled to display a second prompt message, which is used to indicate that the first display screen is being controlled across screens.

[0113] Optionally, the processor 301 can also be used for:

[0114] Control the first display screen to show the identifier of the second audio zone.

[0115] Optionally, the vehicle's cross-screen interaction mode is a continuous interaction mode. The processor 301 can also be used for:

[0116] If the display duration of the voice window corresponding to the second audio zone reaches the target duration corresponding to the second audio zone, then exit the voice window corresponding to the second audio zone on the first display screen.

[0117] Optionally, the processor 301 can also be used for:

[0118] When exiting the voice window corresponding to the second audio zone on the first display screen, control the second display screen located in the second audio zone to display the voice window corresponding to the second audio zone.

[0119] Optionally, the first display screen is a central control screen; the processor 301 can also be used for:

[0120] After the vehicle enters the first preset state, exit the voice window corresponding to other audio zones on the first display screen, except for the audio zone where the central control screen is located.

[0121] The first preset state includes: reversing state and / or turning state.

[0122] Optionally, the processor 301 can also be used for:

[0123] Receive exit control command;

[0124] In response to the exit control command, the voice window corresponding to the second audio zone on the first display screen is exited, and the second display screen located in the second audio zone is controlled to display the voice window corresponding to the second audio zone.

[0125] Optionally, the first display screen is a central control screen, which also displays the voice window corresponding to the audio zone where the central control screen is located. The processor 301 can also be used for:

[0126] After the vehicle enters the second preset state, exit all voice windows on the first display screen;

[0127] The second preset state includes: incoming call state or U-turn state.

[0128] Optionally, the processor 301 can also be used to: control the first display screen in the area outside all voice windows to display the response result after the second voice control command is executed.

[0129] Optionally, the processor 301 can also be used for:

[0130] If the first display screen loses power during cross-screen interaction, then after the first display screen is powered on again, it will maintain the cross-screen interaction state it was in before the power outage.

[0131] In summary, this application provides a controller that, during the process of controlling a vehicle's first display screen across screens based on a first voice control command from a first voice zone, can also respond to a second voice control command from a second voice zone by displaying a voice window corresponding to the second voice zone on the first display screen. Therefore, this controller can support cross-screen control of the first display screen, and while controlling the first display screen across screens from the first voice zone, it can also respond to control of the first display screen from the second voice zone, thus effectively improving the freedom and flexibility of voice interaction.

[0132] Please refer to Figure 5. The controller 300 also includes a memory 303. The processor 301 and the memory 303 are connected, for example, via a bus 302.

[0133] Processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. Processor 301 may also be a combination that implements computational functions, such as including one or more microprocessor combinations, a combination of a DSP and a microprocessor, etc.

[0134] Bus 302 may include a pathway for transmitting information between the aforementioned components. Bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus, etc. Bus 302 may be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used to represent it in Figure 5, but this does not mean that there is only one bus or one type of bus.

[0135] The memory 303 stores a computer program corresponding to the voice interaction method of the above embodiments of this application. The computer program is controlled and executed by the processor 301. The processor 301 executes the computer program stored in the memory 303 to implement the content shown in the foregoing method embodiments.

[0136] This application also provides a computer-readable storage medium that, when the instructions in the computer-readable storage medium are executed by the processor of an electronic device, enables the electronic device to perform the method provided in the above-described method embodiments.

[0137] This application also provides a vehicle that includes the controller provided in the above-described device embodiments.

[0138] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0139] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0140] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0141] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0142] In this application, unless otherwise expressly specified and limited, the terms "installation," "connection," "joining," and "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components, unless otherwise expressly limited. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances.

[0143] Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of this application.

Claims

1. A voice interaction method, the method comprising: During the process of controlling the vehicle's first display screen across screens based on a first voice control command from the vehicle's first voice zone, in response to a second voice control command from the vehicle's second voice zone, a voice window corresponding to the second voice zone is displayed on the first display screen; The first display screen also shows the voice window corresponding to the first audio zone.

2. The method according to claim 1, wherein the voice window corresponding to the first voice region and the voice window corresponding to the second voice region are displayed in different positions on the first display screen.

3. According to claim 2, if the first audio region and the second audio region are located on different sides of the vehicle, the voice window corresponding to the first audio region and the voice window corresponding to the second audio region are displayed in different positions on the first display screen.

4. The method according to claim 3, wherein the voice window corresponding to the target sound zone located on the left side of the vehicle is displayed in the upper left corner of the first display screen; The voice window corresponding to the target sound zone located on the right side of the vehicle is displayed in the upper right corner of the first display screen; in, The target pitch range is one of the first pitch range and the second pitch range.

5. The method according to claim 1, wherein the voice window corresponding to the first voice region and the voice window corresponding to the second voice region are the same window.

6. According to the method of claim 5, if the first audio region and the second audio region are located on the same side of the vehicle, then the voice window corresponding to the first audio region and the voice window corresponding to the second audio region are the same window.

7. The method according to any one of claims 1 to 6, after displaying a voice window corresponding to the second voice zone on the first display screen in response to a second voice control command from the second voice zone of the vehicle, the method further comprises: The text of the second voice control command is displayed in the voice window corresponding to the second voice zone; Execute the second voice control command; The system displays a first prompt message indicating that the second voice control command has been executed.

8. The method according to claim 7, wherein the voice window corresponding to the first voice region and the voice window corresponding to the second voice region are the same window; in the voice window corresponding to the second voice region, the text of the second voice control command is displayed, including: If the second voice control command meets the preset conditions, it is determined that the second voice zone interrupts the control of the first display screen, and the text of the second voice control command is displayed in the voice window corresponding to the second voice zone.

9. The method according to claim 8, wherein the cross-screen interaction mode of the vehicle is a single-interaction mode; the method further includes: After displaying the first prompt message, exit the voice window corresponding to the second audio zone in the first display screen.

10. The method according to any one of claims 1 to 6, wherein the method further comprises: The second display screen located in the second audio zone is controlled to display a second prompt message, which is used to indicate that the first display screen is being controlled across screens.

11. The method according to any one of claims 1 to 6, wherein the method further comprises: Control the first display screen to show the identifier of the second audio zone.

12. The method according to any one of claims 1 to 6, wherein the cross-screen interaction mode of the vehicle is a continuous interaction mode; after displaying a voice window corresponding to the second voice zone on the first display screen in response to a second voice control command from the second voice zone of the vehicle, the method further includes: If the display duration of the voice window corresponding to the second audio region reaches the target duration corresponding to the second audio region, then exit the voice window corresponding to the second audio region on the first display screen.

13. The method according to claim 9 or 12, further comprising: When exiting the voice window corresponding to the second audio zone on the first display screen, the second display screen located in the second audio zone is controlled to display the voice window corresponding to the second audio zone.

14. The method according to any one of claims 1 to 6, wherein the first display screen is a central control screen; the method further includes: After the vehicle enters the first preset state, exit the voice window corresponding to the other voice zones in the first display screen except for the voice zone where the central control screen is located; The first preset state includes: reversing state and / or turning state.

15. The method according to any one of claims 1 to 6, wherein the method further comprises: Receive exit control command; In response to the exit control command, the voice window corresponding to the second audio zone in the first display screen is exited, and the second display screen located in the second audio zone is controlled to display the voice window corresponding to the second audio zone.

16. The method according to any one of claims 1 to 6, wherein the first display screen is a central control screen, and the central control screen further displays a voice window corresponding to the audio zone where the central control screen is located; the method further includes: After the vehicle enters the second preset state, all voice windows on the first display screen will be closed. The second preset state includes: incoming call state or U-turn state.

17. The method according to any one of claims 1 to 6, wherein after executing the control operation indicated by the second voice control command, the method further comprises: Control the first display screen to show the response result after the second voice control command is executed in the area outside all voice windows.

18. The method according to any one of claims 1 to 6, further comprising: If the first display screen loses power during cross-screen interaction, then after the first display screen is powered on again, the first display screen will be controlled to maintain the cross-screen interaction state before the power outage.

19. A controller, comprising: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the method as described in any one of claims 1-18.

20. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the method as described in any one of claims 1 to 18.

21. A vehicle comprising the controller as claimed in claim 19.

Images