Multi-screen voice interaction method, device, equipment and computer-readable storage medium

Abstract

The present disclosure relates to a multi-screen voice interaction method, apparatus, device and computer-readable storage medium, the method comprising: in response to a wake-up voice, selecting a target screen from multiple screens connected to the vehicle computer for wake-up; judging whether a non-target screen in the multiple screens has been awakened, and if awakened, playing the wake-up greeting voice from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near. The present disclosure achieves the effect of simulating a voice assistant replying to the user's wake-up voice in the process of walking from the sound field position corresponding to the awakened non-target screen to the sound field position corresponding to the target screen by utilizing audio playback devices with different sound fields. The area of ​​the voice broadcast in the vehicle is no longer rigid and fixed during the user's voice interaction, making the voice interaction more flexible and natural, thereby improving the user's voice interaction experience.

Description

Technical Field

[0001] The present disclosure relates to the field of voice interaction technology, and in particular to a multi-screen voice interaction method, apparatus, device, and computer-readable storage medium. Background Art

[0002] With the vigorous development of the automotive industry and vehicle intelligent control, intelligent interaction between people and vehicles may become a future development trend.

[0003] At present, users can already conveniently realize a variety of functions by interacting with voice assistants. However, in the existing voice interaction process, voice broadcasts are mostly broadcast through speakers in fixed positions in the car, and the sound area is rigid and fixed. How to improve this voice interaction method and thus meet users' good voice interaction experience in the car has become an urgent problem to be solved in the industry. Summary of the Invention

[0004] In order to solve the above technical problems, the present disclosure provides a multi-screen voice interaction method, device, equipment and computer-readable storage medium, which make voice interaction more flexible and natural and improve the user's voice interaction experience.

[0005] In a first aspect, an embodiment of the present disclosure provides a multi-screen voice interaction method, comprising:

[0006] In response to the wake-up voice, a target screen is selected from multiple screens connected to the vehicle computer for wake-up;

[0007] Determine whether the non-target screen among the multiple screens has been awakened. If awakened, the wake-up greeting voice is played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near.

[0008] In some embodiments, in response to the wake-up voice, selecting a target screen from multiple screens of the vehicle computer for wake-up includes:

[0009] In response to a wake-up voice, determining a target voice zone where a user who issues the wake-up voice is located;

[0010] Based on the target sound zone, a target screen corresponding to the target sound zone is awakened.

[0011] In some embodiments, the method further comprises:

[0012] A virtual interactive image of the voice assistant is displayed on the target screen.

[0013] In some embodiments, displaying a virtual interactive image of the voice assistant on the target screen includes:

[0014] While the wake-up greeting voice is played from far to near relative to the user by the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen, the virtual interactive image in the non-target screen is removed and the virtual interactive image is displayed on the target screen.

[0015] In some embodiments, the multiple screens include a central control screen and at least one non-central control screen, and the method further includes:

[0016] In response to a navigation request voice issued by a user in a sound zone corresponding to a non-central control screen, the navigation response voice is played from near to far relative to the user by an audio playback device in a sound field corresponding to the non-central control screen to an audio playback device in a sound field corresponding to the central control screen.

[0017] In some embodiments, the method further includes: removing the virtual interactive image in the non-central control screen, and displaying the virtual interactive image and the navigation interface on the central control screen.

[0018] In a second aspect, an embodiment of the present disclosure provides a multi-screen voice interaction device, comprising:

[0019] A wake-up module, configured to select a target screen from multiple screens connected to the vehicle computer for wake-up in response to a wake-up voice;

[0020] The playback module is used to determine whether the non-target screen in the multiple screens has been awakened. If it has been awakened, the wake-up greeting voice is played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near.

[0021] In some embodiments, the device further includes a display module for displaying a virtual interactive image of the voice assistant on the target screen.

[0022] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

[0023] Memory;

[0024] processor; and

[0025] computer programs;

[0026] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in the first aspect.

[0027] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method described in the first aspect.

[0028] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, implements the multi-screen voice interaction method as described above.

[0029] The multi-screen voice interaction method, apparatus, device and computer-readable storage medium provided by the embodiments of the present disclosure achieve the effect of simulating the voice assistant's reply to the user's wake-up voice in the process of walking from the sound field position corresponding to the awakened non-target screen to the sound field position corresponding to the target screen by utilizing audio playback devices with different sound fields. During the user's voice interaction, the area where the voice is broadcast in the car is no longer rigid and fixed, making the voice interaction more flexible and natural, thereby improving the user's voice interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0031] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0032] Figure 1 A flowchart of the multi-screen voice interaction method provided in an embodiment of the present disclosure;

[0033] Figure 2 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0034] Figure 3 A schematic diagram of the sound field layout provided in an embodiment of the present disclosure;

[0035] Figure 4 A schematic diagram of sound field transformation provided by an embodiment of the present disclosure;

[0036] Figure 5 A flow chart of a multi-screen voice interaction method provided in an embodiment of the present disclosure;

[0037] Figure 6 A schematic diagram of a sound field transformation provided by an embodiment of the present disclosure;

[0038] Figure 7 A schematic diagram of the structure of a multi-screen voice interaction device provided in an embodiment of the present disclosure;

[0039] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0040] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features therein can be combined with each other in the absence of conflict.

[0041] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0042] The embodiments of the present disclosure provide a multi-screen voice interaction method, which is described below in conjunction with specific embodiments.

[0043] Figure 1 This is a flow chart of the multi-screen voice interaction method provided by the embodiment of the present disclosure. This method can be applied to Figure 2 The application scenario shown in the figure includes multiple seats and multiple sound fields in the vehicle, and each sound field is provided with an audio playback device such as a speaker. Among them, the multiple seats in the vehicle include the main driver's seat 201, the co-driver's seat 202, the second row of seats 203, the second row of seats 204, the third row of seats 205, and the third row of seats 206. The multiple sound fields in the vehicle include the central control sound field 210, the main driver's sound field 211, the co-driver's sound field 212, the second row left sound field 213, the second row right sound field 214, the third row left sound field 215, and the third row right sound field 216. In addition, the vehicle also includes multiple on-board terminals, each of which is connected to the vehicle computer, and its display screen is respectively set at a corresponding position in the vehicle. For example, a central control screen is provided between the main driver's seat 201 and the co-driver's seat 202, a co-driver's screen is provided in front of the co-driver's seat 202, and multiple rear screens are provided in front of the second row of seats and in front of the third row of seats. Specifically, the sound field layout corresponding to each position in the vehicle is as follows Figure 3 As shown, the center console sound field 210 is located between the main driver's seat 201 and the co-driver's seat 202, that is, near the center console screen; the main driver's sound field 211 is located around the main driver's seat 201; the co-driver's sound field 212 is located around the co-driver's seat 202; the second row left sound field 213 and the second row right sound field 214 are located near the second row seats 203 and 204 respectively; the third row left sound field 215 and the third row right sound field 216 are further back than the second row left sound field 213 and the second row right sound field 214. It is understandable that the multi-screen voice interaction method provided by the embodiments of the present disclosure can also be applied in other scenarios.

[0044] The following combination Figure 2 The application scenario shown is Figure 1 The multi-screen voice interaction method shown in FIG is introduced. The specific steps of the method are as follows:

[0045] S101 . In response to a wake-up voice, a target screen is selected from multiple screens connected to the vehicle computer for wake-up.

[0046] The vehicle computer collects the user's voice through the voice collection device in the vehicle. When the user needs to wake up the voice assistant, the vehicle computer issues a wake-up command containing the wake-up word. At this time, the vehicle computer detects that the collected voice contains the wake-up word and determines that the user needs to wake up the voice assistant. It then selects the target screen that the user needs to wake up from multiple screens in the vehicle connected to the vehicle computer for wake-up. For example, when the passenger in the front passenger seat 202 issues a wake-up command containing the wake-up word, the screen in front of the front passenger seat is determined as the target screen and wakes up the screen. Among them, waking up the target screen can be adjusting the target screen from the off state to the on state, or adjusting the display interface of the target screen from the standby interface to the wake-up interface, of course, it is not limited to this.

[0047] S102. Determine whether a non-target screen among the multiple screens has been awakened. If awakened, play the awakening greeting voice from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near.

[0048] The sound field is the location of the sound when the voice assistant in the vehicle is broadcasting. Figure 2 In the illustrated application scenario, each location in the vehicle is equipped with a corresponding audio playback device. Each audio playback device can be used to play the voice assistant's response to the user's voice control commands when the user interacts with the voice assistant. For example, when the user in the passenger seat 212 issues any voice control command, the audio playback device in the passenger sound field 212 can play the voice assistant's response to the voice control command.

[0049] When the vehicle computer detects non-target screens other than the target screen in the vehicle to determine whether these non-target screens are in the awake state, if it is determined that any other non-target screen is in the awake state, it controls the audio playback device of the sound field corresponding to the non-target screen and the audio playback device of the sound field corresponding to the target screen to play the voice assistant's wake-up greeting from far to near relative to the user, so as to imitate the voice assistant walking from the sound field position corresponding to the awakened non-target screen to the sound field position corresponding to the target screen to reply to the user's wake-up voice.

[0050] Figure 4 Schematic diagram of sound field transformation provided by the embodiment of the present disclosure. Figure 4As shown, under normal circumstances, the central control screen of the vehicle is in the awake state. At this time, the car computer controls the wake-up greeting to be played from the audio playback device of the central control sound field 210 to the corresponding sound field position of the user from far to near relative to the user according to the wake-up instructions of users at different positions in the car. For example, when the central control screen of the vehicle is in the awake state, the passenger on the co-pilot seat 202 issues a wake-up voice, and the car computer determines that the co-pilot screen in front of the co-pilot seat 202 is the target screen. Since the car computer detects that the central control screen, which is a non-target screen, has been awakened at this time, the wake-up greeting voice is controlled from the audio playback device of the central control sound field 210 to the corresponding sound field of the target screen, that is, the co-pilot sound field 212, and is played from far to near relative to the passenger on the co-pilot seat 202, so as to achieve the effect of simulating the voice assistant replying to the user's wake-up voice in the process of moving from the central control sound field 210 to the co-pilot sound field 212. In response to the wake-up voice issued by passengers in other positions, the principle and implementation process of the car computer controlling the corresponding sound field transformation are consistent with the above content and will not be repeated here. It can be understood that Figure 4 The sound field displacement diagram shown is only an example provided by an embodiment of the present disclosure. In actual situations, the wake-up greeting voice can be controlled according to the user's wake-up voice to be played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen from far to near relative to the user.

[0051] The disclosed embodiment selects a target screen from multiple screens connected to the vehicle computer in response to a wake-up voice, and determines whether a non-target screen among the multiple screens has been awakened. If awakened, the wake-up greeting voice is played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near. The audio playback devices with different sound fields are used to achieve the effect of simulating the voice assistant replying to the user's wake-up voice in the process of walking from the sound field position corresponding to the awakened non-target screen to the sound field position corresponding to the target screen. During the user's voice interaction, the area of ​​the voice broadcast in the car is no longer rigid and fixed, making the voice interaction more flexible and natural, thereby improving the user's voice interaction experience.

[0052] Figure 5 A flow chart of a multi-screen voice interaction method provided by an embodiment of the present disclosure is shown as follows: Figure 5 As shown, the method includes the following steps:

[0053] S501: In response to a wake-up speech, determine a target sound zone where a user who issues the wake-up speech is located.

[0054] There are multiple locations inside the vehicle, each corresponding to a different sound zone, and each sound zone is equipped with a voice collection device for collecting the voice of the user at the corresponding location. Figure 2In the application scenario shown, the main driver's seat 201, the front passenger seat 202, the second row of seats 203, the second row of seats 204, the third row of seats 205, and the third row of seats 206 in the car correspond to the main driver's sound zone, the front passenger sound zone, the second row left sound zone, the second row right sound zone, the third row left sound zone, and the third row right sound zone, respectively. When the voice collection device in a certain sound zone collects the user's wake-up voice, the sound zone is determined to be the target sound zone. Alternatively, the visual perception system in the car, the gravity sensing system on the vehicle seat, etc. can be used to assist in the comprehensive determination of the current location of the user who issued the wake-up voice, and further determine the target sound zone where the user is located.

[0055] S502: Based on the target sound zone, wake up a target screen corresponding to the target sound zone.

[0056] S503. Determine whether the non-target screen in the multiple screens has been awakened. If awakened, play the awakening greeting voice from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near, and at the same time remove the virtual interactive image in the non-target screen and display the virtual interactive image on the target screen.

[0057] The vehicle computer detects non-target screens other than the target screen in the vehicle to determine whether these non-target screens are awake. If any other non-target screen is determined to be awake, the voice assistant's virtual interactive image on the non-target screen is removed and displayed on the target screen awakened by the user, further interacting with the user through voice. At the same time, as the virtual interactive image on the non-target screen is transferred to the target screen, the wake-up greeting voice is played from the audio playback device in the sound field corresponding to the non-target screen to the audio playback device in the sound field corresponding to the target screen, relative to the user, from far to near, creating the effect that the voice assistant's voice is transferred from the non-target screen to the target screen along with its virtual interactive image.

[0058] like Figure 4In the sound field transformation diagram shown, for example, when the vehicle's central control screen is in the wake-up state, the voice collection device in the passenger audio zone corresponding to passenger seat 202 picks up a wake-up call uttered by a passenger in passenger seat 202. The vehicle computer determines that the passenger screen corresponding to the passenger audio zone is the target screen. Since the vehicle computer detects that the central control screen, which is not the target screen, has been awakened, it removes the virtual interactive avatar of the voice assistant on the non-target central control screen and displays it on the passenger screen. Simultaneously, the wake-up greeting voice is played from the audio playback device in central control sound field 210 to the target screen's corresponding sound field, passenger sound field 212, from a distance closer to the passenger in passenger seat 202. This simulates the voice assistant responding to the user's wake-up call as it moves from central control sound field 210 to passenger sound field 212. The principles and implementation of the vehicle computer controlling the flow of the voice assistant's virtual interactive avatar between multiple screens and the corresponding sound field transformation in response to wake-up calls uttered by passengers in other locations are consistent with those described above and will not be further described here.

[0059] Alternatively, when the vehicle's central control screen is in the wake-up state, the voice collection device in the main driving sound zone corresponding to the main driving seat 201 collects the wake-up voice issued by the driver in the main driving seat 201. Since the display screen corresponding to the main driving sound zone is the central control screen, and the central control screen has been awakened, the virtual interactive image of the voice assistant is controlled to continue to be displayed on the central control screen. At the same time, the wake-up greeting voice is controlled from the audio playback device of the central control sound field 210 to the main driving sound field 211, and is played from far to near from the passenger in the main driving seat 201, so as to achieve the effect of simulating the voice assistant replying to the driver's wake-up voice in the process of moving from the central control sound field 210 to the main driving sound field 211.

[0060] The embodiment of the present disclosure determines the target sound zone where the user who issues the wake-up voice is located in response to the wake-up voice; wakes up the target screen corresponding to the target sound zone based on the target sound zone; determines whether the non-target screen among the multiple screens has been awakened, and if so, plays the wake-up greeting voice from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near, and at the same time removes the virtual interactive image in the non-target screen, and displays the virtual interactive image on the target screen. When the user wakes up the voice assistant, the visual and auditory dimensions jointly create an effect for the user that the voice assistant is walking and replying to the user's wake-up command, thereby providing the user with a better voice interaction experience.

[0061] Based on the above embodiment, the multi-screen voice interaction method also includes: in response to a navigation request voice issued by a user in the sound zone corresponding to the non-central control screen, the navigation response voice is played from the audio playback device of the sound field corresponding to the non-central control screen to the audio playback device of the sound field corresponding to the central control screen relative to the user from near to far, and the virtual interactive image in the non-central control screen is removed, and the virtual interactive image and the navigation interface are displayed on the central control screen.

[0062] While the vehicle is in motion, the driver in the main driving seat 210 is most in need of current navigation information. Therefore, the navigation interface can be displayed on the central control screen for easy reference. When the driver issues a navigation request, if only the central control screen is activated, the voice assistant's virtual interactive image and the corresponding navigation interface are displayed directly on the central control screen, and the navigation response voice is played by the central control sound field 210.

[0063] At the same time, passengers in other seats except the main driver's seat 201 can assist the driver in initiating navigation requests through voice interaction. When the vehicle computer collects the user's navigation request voice through the voice collection device in the sound zone corresponding to any screen other than the central control screen, that is, when the vehicle computer collects the navigation request voice through the voice collection device in the sound zone corresponding to any non-central control screen, the vehicle computer initiates cross-screen interaction between multiple screens in the vehicle, controls the virtual interactive image to jump from the non-central control screen corresponding to the sound zone of the user initiating the navigation request voice to the central control screen for display, and displays the corresponding navigation interface on the central control screen. At the same time, the corresponding navigation response voice is controlled by the audio playback device in the sound field corresponding to the non-central control screen to the audio playback device in the sound field corresponding to the central control screen, and is played from near to far relative to the user. It can be understood that the above-mentioned method of cross-screen interaction between multiple screens is not limited to the navigation scenario, nor is it limited to the cross-screen interaction scenario from the non-central control screen to the central control screen, and can also be applied to other scenarios.

[0064] Figure 6 A schematic diagram of a sound field transformation provided by an embodiment of the present disclosure. Figure 6For example, when a passenger in third-row seat 205 requests navigation, if the central control screen has already been activated but the screens corresponding to third-row seat 205 have not, the passenger can first activate the screens corresponding to third-row seat 205. The vehicle computer detects the wake-up word in the collected user voice, identifies the user voice as the wake-up word, and determines that the user's voice is in the target audio zone. The computer then removes the voice assistant's virtual interactive avatar from the central control screen and displays it on the screens corresponding to third-row seat 205. Simultaneously, the wake-up greeting voice is controlled to play from the audio playback device in central control sound field 210 to the audio playback device in third-row left sound field 215, moving from farthest to nearer to the passenger in third-row seat 205, as the position of the voice assistant's virtual interactive avatar changes. After activating the voice assistant, the passenger further issues a navigation request. After the vehicle computer captures the voice and, through semantic analysis, determines that the passenger's intent is navigation, the computer removes the voice assistant's virtual interactive avatar from the screens corresponding to third-row seat 205 and displays it on the central control screen. The corresponding navigation interface is then displayed on the central control screen. Simultaneously, the navigation response audio is controlled to play from the audio playback device in the third-row left sound field 215 to the audio playback device in the center console sound field 210, moving from near to near, relative to the passengers in the third-row seat 205, as the position of the voice assistant's virtual interactive avatar changes. The principles and implementation process for controlling the flow of the voice assistant's virtual interactive avatar across multiple screens and the corresponding sound field changes in response to navigation requests from passengers in other positions are consistent with those described above and will not be further elaborated here.

[0065] The disclosed embodiment responds to the navigation request voice issued by the user in the sound zone corresponding to the non-central control screen, and plays the navigation response voice from the audio playback device of the sound field corresponding to the non-central control screen to the audio playback device of the sound field corresponding to the central control screen from near to far relative to the user, removes the virtual interactive image in the non-central control screen, and displays the virtual interactive image and the navigation interface on the central control screen, and controls the broadcast of the response voice to flow and move with the virtual interactive image of the voice assistant on multiple screens, so that during the user's voice interaction, the voice of the voice assistant and the position of the virtual interactive image are consistent, and at the same time can simulate the effect of the voice assistant replying to the user's voice while walking, thereby making the user's voice interaction more natural and three-dimensional, and improving the user's voice interaction experience.

[0066] Figure 7 This is a schematic diagram of the structure of the multi-screen voice interaction device provided by the embodiment of the present disclosure. The multi-screen voice interaction device can be the vehicle computer as described in the above embodiment, or the multi-screen voice interaction device can be a component or assembly in the vehicle computer. The multi-screen voice interaction device provided by the embodiment of the present disclosure can execute the processing flow provided by the embodiment of the multi-screen voice interaction method, such as Figure 7As shown, the multi-screen voice interaction device 70 includes: a wake-up module 71 and a playback module 72; wherein, the wake-up module 71 is used to respond to the wake-up voice and select a target screen from the multiple screens connected to the vehicle computer for wake-up; the playback module 72 is used to determine whether the non-target screen in the multiple screens has been awakened. If awakened, the wake-up greeting voice is played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near.

[0067] Optionally, the wake-up module 71 is further configured to determine, in response to the wake-up voice, a target sound zone where the user who issues the wake-up voice is located; and wake up a target screen corresponding to the target sound zone based on the target sound zone.

[0068] Optionally, the multi-screen voice interaction device further includes a display module 73 for displaying a virtual interactive image of the voice assistant on the target screen.

[0069] Optionally, the display module 73 is also used to remove the virtual interactive image in the non-target screen and display the virtual interactive image on the target screen while playing the wake-up greeting voice from far to near relative to the user from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen.

[0070] Optionally, the playback module 72 is also used to respond to the navigation request voice issued by the user in the sound zone corresponding to the non-central control screen, and play the navigation response voice from the audio playback device of the sound field corresponding to the non-central control screen to the audio playback device of the sound field corresponding to the central control screen from near to far relative to the user.

[0071] Optionally, the display module 73 is further configured to remove the virtual interactive image from the non-central control screen and display the virtual interactive image and the navigation interface on the central control screen.

[0072] Figure 7 The multi-screen voice interaction device of the illustrated embodiment can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0073] Figure 8 This is a schematic diagram of the structure of the electronic device provided in the embodiment of the present disclosure. The electronic device can be the vehicle computer as described in the above embodiment. The electronic device provided in the embodiment of the present disclosure can execute the processing flow provided in the embodiment of the multi-screen voice interaction method, such as Figure 8 As shown, the electronic device 80 includes: a memory 81, a processor 82, a computer program and a communication interface 83; wherein the computer program is stored in the memory 81 and is configured so that the processor 82 executes the multi-screen voice interaction method as described above.

[0074] Memory 81, as a non-transitory computer-readable storage medium, can be used to store software programs, computer executable programs, and modules, such as the program instructions / modules corresponding to the application interface display method in the embodiments of the present disclosure. Processor 82 executes the software programs, instructions, and modules stored in memory 81 to execute various server functional applications and data processing, thereby implementing the multi-screen voice interaction method of the above-mentioned method embodiment.

[0075] The memory 81 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and applications required for at least one function; the data storage area may store data created based on the use of the vehicle, etc. In addition, the memory 81 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 81 may optionally include a memory remotely located relative to the processor 82, and these remote memories may be connected to the terminal device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0076] In addition, an embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which is executed by a processor to implement the multi-screen voice interaction method described in the above embodiment. It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0077] In addition, an embodiment of the present disclosure also provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the multi-screen voice interaction method as described above is implemented.

[0078] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0079] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. A multi-screen voice interaction method, characterized in that: Applied to a vehicle computer, the method includes: In response to the wake-up voice, a target screen is selected from multiple screens connected to the vehicle computer for wake-up; Determine whether the non-target screen among the multiple screens has been awakened. If awakened, the wake-up greeting voice is played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near.

2. The method according to claim 1, characterized in that In response to the wake-up voice, selecting a target screen from multiple screens connected to the vehicle computer for wake-up includes: In response to a wake-up voice, determining a target voice zone where a user who issues the wake-up voice is located; Based on the target sound zone, a target screen corresponding to the target sound zone is awakened.

3. The method according to claim 1, characterized in that The method further comprises: A virtual interactive image of the voice assistant is displayed on the target screen.

4. The method according to claim 3, characterized in that Displaying a virtual interactive image of the voice assistant on the target screen includes: While the wake-up greeting voice is played from far to near relative to the user by the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen, the virtual interactive image in the non-target screen is removed and the virtual interactive image is displayed on the target screen.

5. The method according to claim 1, characterized in that The multiple screens include a central control screen and at least one non-central control screen, and the method further includes: In response to a navigation request voice issued by a user in a sound zone corresponding to a non-central control screen, the navigation response voice is played from near to far relative to the user by an audio playback device in a sound field corresponding to the non-central control screen to an audio playback device in a sound field corresponding to the central control screen.

6. The method according to claim 5, characterized in that The method further comprises: The virtual interactive image in the non-central control screen is removed, and the virtual interactive image and the navigation interface are displayed on the central control screen.

7. A multi-screen voice interaction device, characterized in that: The device comprises: A wake-up module, configured to respond to a wake-up voice and select a target screen from multiple screens connected to the vehicle computer for wake-up; The playback module is used to determine whether the non-target screen in the multiple screens has been awakened. If it has been awakened, the wake-up greeting voice is played from the audio playback device of the sound field corresponding to the non-target screen to the audio playback device of the sound field corresponding to the target screen relative to the user from far to near.

8. The device according to claim 7, characterized in that The device further comprises: A display module is used to display the virtual interactive image of the voice assistant on the target screen.

9. An electronic device, characterized in that: include: Memory; processor; as well as computer programs; The computer program is stored in the memory and configured to be executed by the processor to implement the method according to any one of claims 1 to 6.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images