Vehicle-machine interaction method and system, mobile terminal and computer readable storage medium

Abstract

The invention provides a vehicle-machine interaction method and system, a mobile terminal and a computer readable storage medium, and relates to the technical field of terminals. In order to solve the technical problem that a vehicle-mounted audio module cannot play mobile phone navigation audio and media audio of a vehicle at the same time, a mobile terminal starts to play terminal navigation audio when detecting a navigation application, and connection between a terminal audio module and a navigation audio channel of a vehicle-mounted audio module of a vehicle instead of connection with the media audio channel is opened. And the terminal audio module transmits the terminal navigation audio to the vehicle-mounted audio module for playing through the navigation audio channel. Therefore, the media audio module of the vehicle-mounted audio module is not occupied by the navigation audio of the terminal, and the vehicle can play the navigation audio of the terminal and the media audio of the vehicle-mounted audio module at the same time. The situation that one audio is paused due to the fact that the vehicle machine media audio and the terminal navigation audio preempt the media audio channel is avoided, and the requirement of a user for playing the terminal and the vehicle machine audio at the same time is met.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular, to a vehicle-machine interaction method and system, a mobile terminal, and a computer-readable storage medium. Background Art

[0002] When using mobile navigation applications, users usually transmit the navigation audio on the mobile phone to the vehicle's onboard audio module for playback to achieve better navigation audio playback effects. Based on the existing audio channel management strategy of the vehicle's onboard audio module for the vehicle's onboard audio module in the car-machine interconnection application, the mobile phone navigation audio cannot be played at the same time as the vehicle's media audio, which cannot meet the user's needs for playing mobile phone navigation audio and vehicle media audio at the same time, resulting in a poor user experience. Summary of the invention

[0003] The embodiments of the present application provide a vehicle-machine interaction method and system, a mobile terminal and a computer-readable storage medium, which are used to solve the technical problem that the mobile phone navigation audio cannot be played simultaneously with the vehicle-machine media audio, so that the vehicle can play the mobile phone navigation audio and the vehicle-machine media audio at the same time, thereby improving the user experience.

[0004] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0005] In a first aspect, a vehicle-machine interaction method is provided, which is applied to a mobile terminal, which may be an electronic device such as a mobile phone or a tablet, and the mobile terminal may establish a communication connection with the vehicle, such as a Bluetooth connection or a wireless network connection. A terminal audio module is provided in the mobile terminal, and the terminal audio module connects to the vehicle's onboard audio module on the basis that the mobile terminal has established a communication connection with the vehicle, and transmits audio to the onboard audio module for playback.

[0006] The vehicle audio module includes a media audio channel and a navigation audio channel. The media audio channel can be used to play the terminal media audio transmitted by the mobile terminal, and can also be used to play the vehicle media audio transmitted by the vehicle audio module. The media audio channel has the characteristics of long-term exclusivity and can be preempted. The navigation audio channel can be used to play the terminal navigation audio output by the navigation application of the mobile terminal, and the navigation audio channel has the characteristic of being mixable. Under the existing control logic, the terminal audio module of the mobile terminal is connected to the media audio channel of the vehicle audio module by default. Based on the characteristic that the media audio channel can be preempted, the vehicle audio module cannot play the terminal navigation audio and the vehicle media audio at the same time.

[0007] When the mobile terminal detects that the navigation application starts playing the terminal navigation audio, it opens the connection between the terminal audio module and the navigation audio channel of the vehicle's on-board audio module, that is, the terminal audio module is connected to the vehicle's navigation audio channel instead of the media audio channel. The terminal audio module transmits the terminal navigation audio to the on-board audio module through the navigation audio channel, so that the on-board audio module plays the terminal navigation audio. In this way, the media audio module of the on-board audio module is not occupied by the terminal navigation audio, and can receive the vehicle media audio. The vehicle can play the terminal navigation audio and the vehicle media audio at the same time, and the vehicle media audio that is played first will not be paused by the terminal navigation audio that is played later, nor will the terminal navigation audio that is played first be paused by the vehicle media audio that is played later, thus meeting the user's needs to play the terminal and vehicle audio at the same time.

[0008] In a possible implementation of the first aspect, a scheme for closing the connection between the terminal audio module and the navigation audio channel is added. When the mobile terminal detects that the navigation application has finished playing the terminal navigation audio, the connection between the terminal audio module and the navigation audio channel is closed. This can avoid continuously occupying the navigation audio channel when there is no terminal navigation audio output, thereby affecting the audio effect output by the vehicle audio module.

[0009] This situation is mainly applied to the scenario where the in-vehicle audio module plays the terminal navigation audio and the car-machine media audio at the same time. The solution for the in-vehicle audio module to mix the media audio output by the media audio channel and the navigation audio output by the navigation audio channel is to superimpose the media audio and the navigation audio in the frequency domain according to the output period of the audio, and at the same time lower the volume of the media audio or increase the volume of the navigation audio to obtain the mixed audio. When there is no terminal navigation audio playing, the car-machine media audio is still played at a lowered volume, affecting the playback effect of the car-machine media audio. When the navigation application finishes playing the terminal navigation audio, the connection with the navigation audio channel is closed in time, and the in-vehicle audio module can play the car-machine media audio alone with better playback effect.

[0010] In a possible implementation of the first aspect, the terminal navigation audio includes multiple navigation audio segments that are not continuous in time, and there is a certain waiting period between adjacent navigation audios. During this waiting period, if the connection with the navigation audio channel is still maintained, even if there is no navigation audio playback, the vehicle media audio will be suppressed due to the mixing strategy, and the effect of the vehicle media audio is poor. Based on this, this implementation adds a method of adaptively adjusting the connection state between the terminal audio module and the navigation audio channel according to the start and end time of each navigation audio.

[0011] Specifically, the navigation application starts playing a navigation audio segment, and opens the connection between the terminal audio module and the navigation audio channel. The navigation application ends playing a navigation audio segment, and ends the connection between the terminal audio module and the navigation audio channel.

[0012] When multiple navigation audio segments are played intermittently in a navigation task, the connection with the navigation audio channel is opened when each navigation audio segment starts playing. The vehicle audio module mixes the terminal audio navigation and the vehicle media audio and plays them. This can not only meet the user's needs for playing the terminal navigation audio and the vehicle media audio at the same time, but also make the volume of the terminal navigation audio higher to assist safe driving. In addition, the connection with the navigation audio channel is closed in time at the end of each navigation audio segment, so that the vehicle audio module can play the vehicle media audio with better playback effect.

[0013] In a possible implementation of the first aspect, the specific implementation scheme for the mobile terminal to determine the start and end times of each segment of navigation audio played by the navigation application is further limited. The navigation application generates navigation text each time a new road condition appears, applies for audio focus to play the navigation audio corresponding to the generated navigation text, and releases the audio focus at the end of each segment of navigation audio. Specifically, the mobile terminal can pre-register a monitoring event to monitor the audio focus change event of the navigation application, and the audio focus change event includes an audio focus application event and an audio focus release event.

[0014] The terminal audio module can determine that the navigation application starts playing a navigation audio segment when the audio focus application event of the navigation application is monitored. Also, the terminal audio module can determine that the navigation application ends playing a navigation audio segment when the audio focus release event of the navigation application is monitored.

[0015] In a possible implementation of the first aspect, an audio transmission scheme is added for the mobile terminal to simultaneously play the terminal navigation audio and the terminal media audio. Specifically, the mobile terminal also includes media applications, such as music playback applications, e-book playback applications, video playback applications, etc. The terminal media video played by the media application needs to be transmitted to the vehicle audio module through the media audio channel. Therefore, when the mobile terminal detects that the media application starts to play the terminal media audio, it opens the connection between the terminal audio module and the media audio channel.

[0016] The mobile terminal first mixes the terminal navigation audio with the terminal media audio to obtain the terminal mixed audio, and then transmits it to the vehicle audio module through the media audio channel, so that the vehicle audio module plays the terminal mixed audio. At this time, the mobile terminal no longer transmits the terminal navigation audio separately through the navigation audio channel. In this way, the mobile terminal can either play only the terminal navigation audio, or choose to play the terminal navigation audio and terminal media audio at the same time to improve driving comfort.

[0017] In a possible implementation of the first aspect, a scheme of playing the terminal navigation audio first and then playing the terminal media audio is defined. Specifically, during the process of the navigation application playing the terminal navigation audio, the mobile terminal receives a first operation for triggering the media application to start playing the terminal media audio. At this time, the mobile terminal responds to the first operation, the media application starts playing the terminal media audio, and closes the connection between the terminal audio module and the navigation audio channel.

[0018] In this way, the vehicle audio module can simultaneously play the terminal mixed audio obtained from the terminal media audio and the terminal navigation audio, and can also avoid the technical problem that the terminal mixed audio is suppressed and the audio playback is poor when the navigation audio channel is occupied.

[0019] In a possible implementation of the first aspect, a scheme is defined in which the terminal navigation audio and the terminal media audio are played simultaneously and then the terminal media audio playback is stopped. Specifically, when the mobile terminal is playing the terminal navigation audio and the terminal media audio simultaneously, it receives a second operation for triggering the media application to stop playing the terminal media audio. At this time, the mobile terminal responds to the second operation, the media application stops playing the terminal media audio, and closes the connection between the terminal audio module and the media audio channel to avoid the media audio channel being occupied. At the same time, the mobile terminal will also open the connection between the terminal audio module and the navigation audio channel, and transmit the terminal navigation audio to the vehicle audio module through the navigation audio channel, so that the vehicle audio module plays the terminal navigation audio.

[0020] In this way, the vehicle audio module can flexibly respond to the situation where the terminal media audio stops playing, free up the media audio channel to avoid occupancy, and ensure the normal playback of the terminal navigation audio by connecting the navigation audio channel.

[0021] In a possible implementation of the first aspect, it is defined that a solution can be provided in which the terminal navigation audio and the terminal media audio are played simultaneously, and then the vehicle-mounted media audio is played. Based on the control logic that both the vehicle-mounted media audio channel and the terminal media audio channel need to be played through the media audio channel, and the media audio channel can be preempted, when the vehicle-mounted media audio is played later, the terminal media audio played earlier will be paused. Then, since the media audio channel is preempted by the vehicle-mounted audio module, the connection between the terminal audio module that was previously turned on and the media audio channel will also be disconnected.

[0022] When the mobile terminal mixes the terminal navigation audio with the terminal media audio and transmits the terminal mixed audio to the vehicle audio module through the media audio channel so that the vehicle audio module plays the terminal mixed audio, if it detects that the connection between the terminal audio module and the media audio channel is disconnected, it is considered that the user has turned on the vehicle media audio again, so the terminal media audio needs to be paused. The mobile terminal controls the media application to stop playing the terminal media audio. In addition, since the terminal navigation audio still needs to continue to play, the terminal audio module will transmit the terminal navigation audio to the vehicle audio module through the navigation audio channel so that the vehicle audio module plays the terminal navigation audio.

[0023] At this time, the audio received by the vehicle audio module includes: the vehicle media audio received by the media audio channel and the terminal media audio received by the navigation audio channel. The vehicle audio channel will mix the vehicle media audio and the terminal media audio to obtain the vehicle mixed audio and then play it.

[0024] Furthermore, the terminal audio module can also monitor the start and end times of the terminal navigation audio played by the navigation application, open the connection with the navigation audio channel at the start time of the terminal navigation audio played by the navigation application, and close the connection with the navigation audio channel at the end time of the terminal navigation audio played by the navigation application to improve the audio playback effect.

[0025] In a second aspect, a vehicle-machine interaction method is provided, which is applied to a vehicle-machine interaction system. The vehicle-machine interaction system includes a mobile terminal and a vehicle, and the mobile terminal can execute any vehicle-machine interaction method in the first aspect.

[0026] In the vehicle-machine interaction system, a mobile terminal establishes a communication connection with the vehicle. The mobile terminal includes a terminal audio module and a navigation application, and the vehicle includes an in-vehicle audio module. When the navigation application starts playing the terminal navigation audio, the terminal audio module opens the connection between the terminal audio module and the navigation audio channel. The terminal audio module transmits the terminal navigation audio to the in-vehicle audio module through the navigation audio channel, and the in-vehicle audio module plays the terminal navigation audio.

[0027] In a possible implementation of the second aspect, the terminal navigation audio does not occupy a media audio channel of the vehicle audio module.

[0028] In a possible implementation of the second aspect, the terminal audio module promptly closes the connection between the terminal audio module and the navigation audio channel when the navigation application finishes playing the terminal navigation audio.

[0029] In a possible implementation of the second aspect, the terminal navigation audio includes multiple navigation audio segments that are discontinuous in time. The terminal audio module responds to the navigation application starting to play the terminal navigation audio, the navigation application starts playing a navigation audio segment, and the terminal audio module opens a connection between the terminal audio module and the navigation audio channel. The navigation application ends playing a navigation audio segment and ends the connection between the terminal audio module and the navigation audio channel.

[0030] In a possible implementation of the second aspect, the terminal audio module monitors the audio focus change event of the navigation application; wherein the audio focus change event includes an audio focus application event and an audio focus release event. When the terminal audio module monitors the audio focus application event of the navigation application, it determines that the navigation application starts playing a navigation audio. When the terminal audio module monitors the audio focus release event of the navigation application, it determines that the navigation application ends playing a navigation audio.

[0031] In a possible implementation of the second aspect, the vehicle further includes a vehicle audio module, such as a module for outputting audio of a vehicle radio, a television, etc. The vehicle audio module can output vehicle media audio to the vehicle audio module. If the vehicle audio module first plays a separate terminal navigation audio, then after the vehicle audio module starts transmitting the vehicle media audio, the vehicle audio module plays the vehicle mixed audio that is a mixture of the terminal navigation audio and the vehicle media audio.

[0032] In a possible implementation of the second aspect, a vehicle-machine interaction scheme is defined in which the terminal audio module starts transmitting the terminal media audio in a scenario after the vehicle audio module plays the vehicle-machine mixed audio after the terminal navigation audio and the vehicle-machine media audio are mixed. Specifically, the terminal audio module starts playing the terminal media audio in response to the media application, and opens the connection between the terminal audio module and the media audio channel. At this time, the pre-existing connection between the vehicle-machine audio module and the media audio channel is preempted, and the vehicle-machine audio module pauses playing the vehicle-machine media audio.

[0033] The terminal audio module mixes the terminal navigation audio and the terminal media audio to obtain the terminal mixed audio, and transmits the mixed audio to the vehicle audio module through the media audio channel, so that the vehicle audio module plays the mixed audio.

[0034] In a possible implementation of the second aspect, a scheme for the terminal audio module to transmit the terminal media audio is defined. During the process of the navigation application playing the terminal navigation audio, the mobile terminal receives a signal for triggering the media application to start playing the terminal media audio. The terminal audio module responds to the first operation, the media application starts playing the terminal media audio, and the terminal audio module mixes the terminal navigation audio with the terminal media audio and transmits the terminal mixed audio to the vehicle audio module through the media audio channel. The vehicle audio module plays the terminal mixed audio.

[0035] In a possible implementation of the second aspect, a vehicle-machine interaction scheme is defined in which the vehicle-mounted audio module plays the terminal mixed audio of the terminal media audio and the terminal navigation audio, and the user opens the vehicle-machine media to play the vehicle-machine media audio. Specifically, during the process of the vehicle-mounted audio module playing the terminal mixed audio, the vehicle-machine media audio outputs the vehicle-machine media audio to the vehicle-machine audio module. At this time, the vehicle-machine audio module will seize the media audio channel, causing the terminal audio module to close the connection with the media audio channel, and the media application will pause playing the terminal media audio.

[0036] Since the terminal navigation audio is still playing, the terminal audio module also needs to open the connection with the navigation audio channel and transmit the terminal navigation audio to the vehicle audio module through the navigation audio channel. The audio received by the vehicle audio module includes the vehicle media audio received by the media audio channel and the terminal navigation audio received by the navigation audio channel. The vehicle audio module plays the vehicle mixed audio after the terminal navigation audio and the vehicle media audio are mixed.

[0037] In this case, the terminal audio module can monitor the start and end time of each navigation audio segment played by the navigation application, open the connection with the navigation audio channel at the start time of each navigation audio segment, and the vehicle audio module mixes the terminal navigation audio with the vehicle media audio and plays it. At the end time of each navigation audio segment, the connection with the navigation audio channel is closed, and the vehicle audio module plays the vehicle media audio alone to ensure the playback effect of the vehicle media audio.

[0038] In a third aspect, an embodiment of the present application further provides a mobile terminal, the mobile terminal comprising a terminal audio module, a memory and a processor, wherein the memory and the terminal audio module are coupled to the processor;

[0039] Memory stores computer-executable instructions;

[0040] The processor executes the computer-executable instructions stored in the memory, so that the mobile terminal executes the vehicle-machine interaction method as described in any one of the first aspects.

[0041] In the fourth aspect, an embodiment of the present application also provides a vehicle-machine interaction system, which includes a mobile terminal and a vehicle, wherein the mobile terminal establishes a communication connection with the vehicle, the mobile terminal includes a terminal audio module and a navigation application, and the vehicle includes an on-board audio module. The vehicle-machine interaction system can execute any vehicle-machine interaction method as described in the second aspect.

[0042] In a fifth aspect, a first device is provided, comprising: a processor; the processor is used to couple with a memory, and after reading instructions in the memory, execute a vehicle-computer interaction method as described in any one of the first aspects above according to the instructions.

[0043] In a sixth aspect, a computer-readable storage medium is provided, which stores instructions. When the computer-readable storage medium is run on a computer, the computer can execute the vehicle-computer interaction method of any one of the first aspects, or the vehicle-computer interaction method of any one of the second aspects.

[0044] In a seventh aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute any vehicle-computer interaction method of the first aspect.

[0045] In an eighth aspect, a control device (for example, the control device may be a chip system) is provided, the device including a processor for supporting the control device to implement the functions involved in the first aspect. In one possible design, the device also includes a memory for storing program instructions and data necessary for the control device. When the device is a chip system, it may be composed of a chip, or may include a chip and other discrete devices.

[0046] Among them, the technical effects brought about by any design method in the second to eighth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 One of the connection diagrams involved in the vehicle-machine interaction method provided in an embodiment of the present application;

[0048] Figure 2 The second connection diagram involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0049] Figure 3 The third connection diagram involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0050] Figure 4 A fourth connection diagram of the vehicle-machine interaction method provided in an embodiment of the present application;

[0051] Figure 5 One of the flow charts involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0052] Figure 6 One of the interface schematic diagrams involved in the vehicle-machine interaction method provided in an embodiment of the present application;

[0053] Figure 7 The second interface diagram involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0054] Figure 8 The third interface diagram involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0055] Fig. 9 A schematic diagram of navigation audio involved in the vehicle-machine interaction method provided in an embodiment of the present application;

[0056] Fig.10 The second flowchart of the vehicle-machine interaction method provided in the embodiment of the present application;

[0057] Fig.11 The fifth connection diagram involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0058] Fig.12 The third flowchart of the vehicle-machine interaction method provided in the embodiment of the present application;

[0059] Fig.13 A fourth flowchart diagram of the vehicle-machine interaction method provided in an embodiment of the present application;

[0060] Fig.14 A fifth flowchart of the vehicle-machine interaction method provided in an embodiment of the present application;

[0061] Fig.15 The sixth connection diagram involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0062] Fig.16 The seventh flowchart of the vehicle-machine interaction method provided in the embodiment of the present application;

[0063] Fig.17 One of the scenario schematic diagrams involved in the vehicle-machine interaction method provided in an embodiment of the present application;

[0064] Fig.18 The second schematic diagram of the scenario involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0065] Fig.19 The third schematic diagram of the scenario involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0066] Fig. 20 A fourth schematic diagram of a scenario involved in the vehicle-machine interaction method provided in an embodiment of the present application;

[0067] Fig.21 A fifth schematic diagram of a scenario involved in the vehicle-machine interaction method provided in an embodiment of the present application;

[0068] Fig. 22 The sixth schematic diagram of the scenario involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0069] Fig.23The seventh schematic diagram of the scenario involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0070] Fig.24 The eighth schematic diagram of the scenario involved in the vehicle-machine interaction method provided in the embodiment of the present application;

[0071] Fig.25 A schematic diagram of the structure of a mobile terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0072] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0073] To facilitate understanding, some technical common sense involved in the embodiments of the present application is first introduced.

[0074] In addition to the main components that realize basic driving functions, vehicles are usually equipped with in-vehicle audio modules, car computers (or in-vehicle interactive control devices) and in-vehicle communication modules. When using the vehicle, users can play various types of audio through the in-vehicle audio module, such as navigation audio, or media audio such as music and radio. The in-vehicle audio module plays navigation audio, which can provide navigation guidance to improve driving safety while the user is driving the vehicle. The in-vehicle audio module plays media audio, which can provide a music environment to improve driving comfort while the user is driving the vehicle. The in-vehicle communication module is used to realize communication between the vehicle and other mobile terminals. For example, the vehicle can communicate with satellites, base stations, mobile phones and other devices through the in-vehicle communication module to obtain broadcasts issued by satellites or base stations, audio data transmitted by mobile phones, positioning and navigation data transmitted by satellites, etc.

[0075] The car computer is an interactive control device for the vehicle, which can realize the interaction between the vehicle and the user, receive the user's input operation, and intelligently control the vehicle according to the user's input operation. The car computer usually includes a screen, an input and output unit, a controller and a car audio module. Specifically, the car computer may include components such as a touch screen, a knob, a button, a speaker, etc. The touch screen can receive the user's touch operation and display the corresponding text, audio and video pictures and other information. The car audio module can load radio, audio and video playback applications, etc. The car audio module can collect the car audio output by the radio and audio and video playback applications, and transmit the car audio to the car audio module for playback. Specifically, the car audio can include car navigation audio, car media audio, car system audio, etc.

[0076] The audio received and played by the vehicle audio module may be the vehicle audio transmitted by the vehicle audio module of the vehicle, or the audio from a mobile phone connected to the vehicle audio module.

[0077] like Figure 1 As shown, it is a schematic diagram of the scene of the interconnection between the mobile phone 100 and the vehicle 200. The mobile phone 100 can be directly connected to the vehicle through a near-field communication module such as Bluetooth, wireless network, and physical data cable to transmit the mobile phone audio to the vehicle audio module. Usually, the user can install the vehicle-machine interconnection application 110 on the mobile phone, and similarly, the vehicle-machine interconnection application 210 is also installed on the vehicle 200, and the mobile phone 100 can be connected to the vehicle 200 through a communication module such as Bluetooth, wireless network, and physical data cable.

[0078] Users can set operable items on the car-machine interconnection application on their mobile phones in advance, such as linking the mobile phone's email, music, settings, calls, chats, navigation and other applications, and can also store music playlists, navigation frequently used destinations and other information. In this way, after the user connects the mobile phone to the car-machine interconnection application, the user can remotely operate these pre-associated applications and related data directly on the vehicle's car-machine screen, for example, directly operate to play music, open navigation, etc. on the car screen. In this way, users no longer need to open music, navigation and other applications on their mobile phones before driving, which is convenient for users to operate and improves driving safety.

[0079] Audio transmission may be involved in the process of remote interaction between the mobile phone and the car through the car-machine interconnection application. For example, when the user opens the music application to play music audio or opens the navigation application to play navigation audio in the car-machine interconnection application on the mobile phone or car, these audio data are actually transmitted from the mobile phone to the mobile phone audio on the car audio module.

[0080] like Figure 2 As shown, it is another schematic diagram of the interaction between the mobile phone 100 and the vehicle 200, which mainly involves the connection between the mobile phone audio module 110, the vehicle audio module 210 and the vehicle audio module 220. The vehicle audio module 220 includes three audio transmission channels: media audio channel (Media), navigation audio channel (Navi) and system audio channel (or VR). The operation rules of these three types of audio channels are as follows:

[0081] The media audio channel can be occupied for a long time without being released actively, but can be preempted. When the focus is preempted, the channel will be paused and will continue to play when the focus is restored.

[0082] Navigation audio channel, mixing type, can be mixed with audio transmitted by other audio channels, automatically released after playing, and stops playing when preempted;

[0083] System audio channel, short-term exclusive, automatically released after playback is completed, and stops playing when it is preempted.

[0084] Based on the operating rules of the above-mentioned audio channels, the working principles of the various audio channels are as follows:

[0085] First, the system audio channel is mainly used to transmit system notification audio, including prompt sound, warning audio, alarm audio, etc. The system audio channel can be connected to the mobile phone system audio output channel (such as Figure 2 A in the figure) and the audio output channel of the vehicle system (as shown in Figure 2 As shown in a), the mobile phone system audio or the car system audio is played. Due to the characteristics of system audio that can be short-term exclusive and cannot be mixed, the system audio channel will not be played at the same time as other types of audio channels, and the playback priority is higher. This solution does not involve the situation where the system audio channel plays system audio, and the subsequent solutions will not repeat the playback solution of the system audio channel.

[0086] Second, the media audio channel is mainly used to transmit media audio, including the car audio module output car audio (such as Figure 2 b in the figure) or the mobile phone media audio output by the mobile phone audio module (as shown in Figure 2 The media audio types may include FM, Media, TV, CD, Phone, etc. When the media audio channel is connected to the mobile audio module, the mobile media audio transmitted by the mobile audio module will be played. Conversely, when the media audio channel is connected to the car audio module, the car media audio transmitted by the car audio module will be played.

[0087] Due to the characteristics of media audio channels that can be monopolized for a long time and can be preempted, media audio channels cannot be connected to the mobile phone audio module and the car audio module at the same time. If the media audio channel is first connected to the mobile phone audio module to play the mobile phone media audio, if the user then turns on the play switch of the car media audio, the car audio module will preempt the media audio channel, that is, the media audio channel is changed from being connected to the mobile phone audio module to being connected to the car audio module, and the content played by the car audio module is changed from mobile phone media audio to car media audio. Conversely, if the media audio channel is first connected to the car audio module to play the car media audio, and then the user turns on the play switch of the mobile phone media audio, the mobile phone audio module will also preempt the media audio channel, that is, the media audio channel is changed from being connected to the car audio module to being connected to the mobile phone audio module, and the content played by the car audio module is changed from car media audio to mobile phone media audio.

[0088] Third, the navigation audio channel is mainly used to transmit navigation audio, such as the car navigation audio output by the car audio module (such as Figure 2 c in the figure) or the mobile phone navigation audio output by the mobile phone audio module (as shown in Figure 2 (as shown in C in FIG. 1 ). The navigation audio channel can be mixed with the audio of other audio channels. For example, if at the same time, the media audio channel of the vehicle audio module has media audio output and the navigation audio channel has navigation audio output, then the vehicle audio module can mix the media audio output by the media audio channel and the navigation audio output by the navigation audio channel and then output them.

[0089] The vehicle audio module mixes the media audio output by the media audio channel and the navigation audio output by the navigation audio channel by superimposing the media audio and the navigation audio in the frequency domain according to the output period of the audio, and at the same time lowering the volume of the media audio or increasing the volume of the navigation audio to obtain the mixed audio. The vehicle audio module outputs the mixed audio, and the user can hear the media audio and the navigation audio at the same time, and the volume of the navigation audio heard is higher than the volume of the media audio, so as to give priority to safe driving while improving driving comfort.

[0090] Among the various applications loaded on the mobile phone, applications involving audio playback can be mainly divided into media applications and navigation applications, among which navigation applications can be understood as various applications that provide navigation data and voice functions. Media applications can include music applications, voice e-book applications, video playback applications, etc. Under the existing control logic of the mobile phone audio module, the navigation audio output by the navigation application is defaulted to media audio, and the mobile phone navigation audio transmitted from the mobile phone audio module to the vehicle audio module is also played through the media audio channel (such as Figure 2 ).

[0091] If the mobile audio currently transmitted by the mobile audio module only includes navigation audio, the mobile audio module will output the navigation audio output by the navigation application as mobile media audio to the media audio channel of the vehicle audio module for playback. If the mobile audio currently transmitted by the mobile audio module includes both navigation audio and media audio, the mobile audio module will mix the navigation audio and media audio, and use the obtained mixed mobile audio as mobile media audio to play through the media audio channel of the vehicle audio module.

[0092] like Figure 3 As shown, since the mobile phone audio module is connected to the car audio channel by default (such as Figure 3 As shown in D in the figure), seize the transmission path from the car media audio to the media audio channel (as shown in Figure 3b) in the above example results in the interruption of the transmission path from the vehicle media audio to the media audio channel. In other words, when the mobile phone navigation audio is played through the media audio channel of the vehicle audio module, the mobile phone audio module will occupy the media audio channel of the vehicle audio module, and the vehicle audio module cannot play the vehicle media audio and the mobile phone navigation audio at the same time, resulting in a poor user experience.

[0093] In order to achieve the effect of playing multiple types of audio simultaneously across devices that users expect, the connection diagram should be as follows Figure 4 Switch the mobile phone navigation audio to play through the navigation audio channel of the vehicle audio module (such as Figure 3 In this way, the transmission path from the vehicle media audio to the media audio channel (as shown in C) Figure 4 b) in the above will not be preempted, and the media audio channel can play the car media audio. The car audio module then mixes the car media audio output from the media audio channel and the mobile phone navigation audio output from the navigation audio channel and plays them, meeting the user's need to play multiple types of audio at the same time.

[0094] Based on this, the embodiment of the present application provides a vehicle-machine interaction method, which is applied to mobile terminals such as mobile phones. Mobile terminals may include personal computers (PCs), tablet computers, laptops, portable computers (such as mobile phones), wearable mobile terminals (such as smart watches), augmented reality (AR) and virtual reality (VR) devices, and other mobile terminals with touch screens. The following embodiments do not impose special restrictions on the specific form of the mobile terminal. The following will take a mobile phone as an example to explain the vehicle-machine interaction solution provided.

[0095] The mobile phone is communicatively connected to the vehicle's on-board audio module, and the mobile phone audio module can transmit navigation audio and media audio to the on-board audio module for playback. When the mobile phone has navigation audio output, the mobile phone audio module can be connected to the navigation audio channel of the on-board audio module, rather than directly to the media audio channel of the on-board audio module, to avoid the navigation audio continuously occupying the media audio channel of the on-board audio module and affecting the playback of the vehicle's media audio. In this way, while achieving the premise of transmitting the mobile phone's navigation audio to the vehicle's on-board audio module for normal playback, the impact of the navigation audio on the output audio of the vehicle's audio module can be avoided. This ensures that the audio playback effect of the on-board audio module can both ensure driving safety requirements and meet the user's audio playback needs.

[0096] like Figure 5 The figure is a flow chart of the vehicle-machine interaction method provided in the embodiment of the present application. The vehicle-machine interaction method provided mainly includes the following processes:

[0097] Step S501: in response to the navigation application starting to play the terminal navigation audio, opening the connection between the terminal audio module and the navigation audio channel of the vehicle's onboard audio module;

[0098] Step S502: Transmit the terminal navigation audio to the vehicle audio module through the navigation audio channel, so that the vehicle audio module plays the terminal navigation audio.

[0099] The vehicle-machine interaction method provided in this embodiment is mainly applied to mobile terminals, such as mobile phones, tablet computers and other electronic devices. The mobile phone is loaded with navigation applications, media playback applications, etc., and both the navigation application and the media playback application can output corresponding audio. The mobile phone can communicate with the vehicle, and transmit the audio output by the navigation application and the media application on the mobile phone to the vehicle, which is played by the vehicle's on-board audio module. The following will take a mobile terminal as an example of a mobile phone to illustrate the vehicle-machine interaction solution in which the mobile phone audio module (corresponding terminal audio module) of the mobile phone transmits the mobile phone navigation audio (corresponding terminal navigation audio) or the mobile phone media audio (terminal media audio) to the vehicle's on-board audio module for playback.

[0100] The vehicle-machine interaction solution provided in this embodiment can be a function loaded into the navigation application. Figure 6 As shown, the mobile phone is in the navigation application (such as Figure 6 In the interface shown in A in FIG. 1 , the first control of the vehicle-machine interaction function (such as Figure 6 After the mobile phone detects the click operation on the first control in the interface of the navigation application, the vehicle-machine interaction method provided in the embodiment of the present application can be started to transmit the mobile phone navigation audio to the vehicle-mounted audio module for playback.

[0101] The vehicle-machine interaction method provided in the embodiment of the present application can also be a vehicle-machine interconnection application loaded into a mobile phone. The icon corresponding to the vehicle-machine interconnection application is displayed on the main interface of the mobile phone, and after receiving the user's click operation on the icon of the vehicle-machine interconnection application, the operation interface of the vehicle-machine interconnection application can be entered. Figure 7 As shown, the operation interface can display the identification information of the vehicle that the mobile phone can currently connect to (such as Figure 7 ), or display the target application that has been associated or can be associated on the mobile phone (such as Figure 7 ), such as navigation applications, music applications, video applications, voice e-book applications, etc. If the mobile phone is already connected to the vehicle and the vehicle is also loaded with the vehicle-machine interconnection application, such as Figure 8 As shown, the user can also operate the vehicle-machine interconnection application on the vehicle screen of the vehicle 200, for example, open the navigation application (such as Figure 8In addition to the currently opened navigation application, the car screen can also display other applications pre-bound to the car-machine interconnection application, such as music applications (such as Figure 8 to play mobile media audio.

[0102] In one case, the user directly operates the navigation application on the mobile phone, and the mobile phone transmits the navigation audio to the vehicle's onboard audio module.

[0103] In another case, the user operates the car-machine interconnection application on the car computer and opens the navigation application. The audio output by the navigation application will also be transmitted by the mobile phone to the vehicle's on-board audio module for playback.

[0104] When the mobile phone determines that the navigation application starts to execute the navigation task, it obtains the navigation audio playback request. At this time, the mobile phone can directly connect the mobile phone audio module to the navigation audio channel of the vehicle.

[0105] In this way, when the mobile phone navigation audio is played through the navigation audio channel, the media audio channel of the car audio module is not occupied and can still receive the media audio channel transmitted by the car audio module. If the user opens a media application such as the car radio, the car media audio can be transmitted to the media audio channel through the media audio channel. In this way, the car audio module can play the mobile phone navigation audio and the car media audio at the same time to meet user needs.

[0106] In actual use, whether the user plays the car media audio before, during or after the mobile phone navigation audio is played, the mobile phone navigation audio and the car media audio can be played at the same time, thereby improving the user experience. In addition, the car-machine interaction method provided in the embodiment of the present application does not require any improvement to the car machine and the car audio module on the vehicle side, but only needs to change the audio channel type of the mobile phone audio module to connect the car audio module when the car-machine interaction method on the mobile phone side is applied, which has a wider applicability.

[0107] In actual applications, the navigation application starts to execute the navigation task corresponding to a certain route. As the time axis continues, during the navigation process of the entire route, the navigation audio is not played continuously, but only when there is a change in road conditions. The navigation application monitors the changes in road conditions in real time and generates navigation reminder text when there is a change in road conditions. The text-to-speech (TTS) technology is used to generate the voice corresponding to the navigation audio, and the navigation audio is transmitted to the vehicle audio module for playback.

[0108] like Fig. 9As shown, during the navigation process of the entire route, the navigation application plays the navigation audio "Go straight" at the very beginning, at T0. When new road conditions appear for a period of time (i.e., from T1 to T7), the navigation application intermittently plays navigation audio such as "Turn left", "Drive to the right front", "Go straight along the left front", "Drive to the left front", "Enter the straight road to the right front", "Turn right, go straight for 500 meters to reach the destination". Of course, in addition to these information about changes in road conditions, navigation audio may also include driving-related navigation audio such as "The light ahead will be red soon" (as shown at T4), "You have been driving for two hours, please take a rest and beware of fatigue driving". It can be seen that navigation audio is usually not played continuously like media audio, but is played intermittently, that is, navigation audio is played only when there are changes in road conditions. This can also achieve a better navigation prompt effect.

[0109] The solution for the vehicle audio module to mix the media audio output from the media audio channel with the navigation audio output from the navigation audio channel is to increase the volume of the navigation audio output from the navigation audio channel, or to reduce the volume of the media audio output from the media audio channel. During a navigation task, if the mobile phone audio module is continuously connected to the navigation audio channel, even if there is no voice playback of the navigation audio, the vehicle audio module will still mix the mobile phone navigation audio output from the navigation audio channel and the vehicle media audio output from the media audio channel according to the situation that the mobile phone audio module and the navigation audio channel are connected. Then, when there is no mobile phone navigation audio playing, the vehicle media audio is still played at a lowered volume, affecting the playback effect of the vehicle media audio.

[0110] Based on this, the implementation method of the present application has made further improvements to the vehicle-machine interaction method. During the execution of the navigation task, the connection status of the mobile phone navigation audio and the navigation audio channel of the vehicle audio module is controlled according to the start and end time of the navigation voice to achieve a better mixing effect. Specifically, the step of the mobile phone connecting the mobile phone audio module to the navigation audio channel of the vehicle audio module in response to the navigation audio playback request may further include:

[0111] When the mobile phone starts playing the mobile phone navigation audio in the navigation application, the mobile phone opens the connection between the mobile phone audio module and the navigation audio channel;

[0112] When the mobile phone navigation audio ends playing by the navigation application, the mobile phone closes the connection between the mobile phone audio module and the navigation audio channel.

[0113] like Fig.10 The figure shows the corresponding relationship between the start and end time of the mobile phone navigation audio playback and the channel connection status. Fig.10 The entire navigation audio corresponding to a navigation task includes a total of 3 mobile phone navigation audio segments, namely M1, M2 and M3.

[0114] At time T0, the navigation application starts playing the mobile navigation audio M1, that is, time T0 is the starting time of the mobile navigation audio M1. At time T0, the mobile phone opens the connection between the mobile phone audio module and the navigation audio channel. Fig.11 As shown, the initial connection relationship is as follows Fig.11 As shown in (a) in FIG. 1 , at time T0, it switches to Fig.11 In this case, if the media audio channel of the vehicle audio module does not receive the vehicle media audio, and only the navigation audio channel receives the mobile phone navigation audio, the vehicle audio module can directly play the mobile phone navigation audio received by the navigation audio channel.

[0115] If the media audio channel of the vehicle audio module receives the vehicle media audio, the vehicle audio module will mix the mobile phone navigation audio received by the navigation audio channel and the vehicle media audio received by the media audio channel and play them. During the mixing and playing process, the vehicle media audio is played at a lower volume.

[0116] like Fig.10 As shown, at time T1, the navigation application ends playing the mobile phone navigation audio M1, that is, time T1 is the end time of the mobile phone navigation audio M1. At time T1, the mobile phone closes the connection between the mobile phone audio module and the navigation audio channel. Fig.11 As shown, the connection relationship between the mobile phone audio module and the car audio module is Fig.11 (b) in the example is switched to Fig.11 In this case, if the vehicle audio module does not receive the vehicle media audio, the vehicle navigation audio does not play any audio.

[0117] If the media audio channel of the vehicle audio module receives the vehicle computer media audio, the vehicle audio module can directly play the vehicle computer media audio received by the media audio channel.

[0118] Similar, such as Fig.10 As shown, at time T2, the navigation application starts playing the mobile navigation audio M2, that is, time T2 is the starting time of the mobile navigation audio M2. At time T2, the mobile phone opens the connection between the mobile phone audio module and the navigation audio channel. Fig.11 As shown, the initial connection relationship is as follows Fig.11 As shown in (a) in FIG. 1 , at time T2, it switches to Fig.11 As shown in (b) in .

[0119] like Fig.10 As shown, at time T3, the navigation application ends playing the mobile phone navigation audio M2, that is, time T3 is the end time of the mobile phone navigation audio M2. At time T3, the mobile phone closes the connection between the mobile phone audio module and the navigation audio channel. Fig.11 As shown, the connection relationship between the mobile phone audio module and the car audio module is Fig.11 (b) in the example is switched to Fig.11 As shown in (a) in .

[0120] Similarly, at time T4, which is the start time of the mobile phone navigation audio M3, the mobile phone opens the connection between the mobile phone audio module and the navigation audio channel, and changes the connection relationship between the mobile phone audio module and the vehicle audio module from Fig.11 (a) in the example is switched to Fig.11 As shown in (b) in .

[0121] At time T5, which is the end time of the mobile phone navigation audio M3, the mobile phone closes the connection between the mobile phone audio module and the navigation audio channel. Fig.11 As shown, the connection relationship between the mobile phone audio module and the car audio module is Fig.11 (b) in the example is switched to Fig.11 As shown in (a) in .

[0122] Based on the above implementation, the specific implementation scheme of the mobile phone obtaining the start and end time of the navigation application playing the mobile phone navigation audio is further explained. Fig.12 The following is a framework diagram for registering the audio focus change event callback. After the mobile phone is connected to the vehicle computer, the application package in the mobile phone registers the focus change callback with the system service, and the system service performs system authentication and adds it to the whitelist. The system service starts to monitor the focus change event and feedbacks the focus change event callback registration success to the application package.

[0123] When the mobile phone starts to execute the navigation task, the system service monitors the audio focus application event and the audio focus release event of the navigation application. When the system service monitors the audio focus application event, it notifies the application package so that the application package can open the connection between the mobile phone audio module and the navigation audio channel. When the system service monitors the audio focus release event, it notifies the application package so that the application package can close the connection between the mobile phone audio module and the navigation audio channel.

[0124] like Fig.13 The figure shows the connection diagram between the mobile phone and the car computer interconnection application. In specific implementation, the mobile phone side can output media audio, navigation audio and system audio to the shared memory. The mobile phone can apply for a recorder to obtain audio data in the shared memory, such as mobile phone media audio or mobile phone navigation audio, and transmit it to the mobile phone audio module. The mobile phone audio module can perform operations such as empty packet detection, reading thread, media audio focus monitoring and navigation audio focus monitoring on the data transmitted from the radio, and choose to connect to the media audio channel or the navigation audio channel of the car audio module.

[0125] When the mobile phone audio module transmits audio to the car audio module, the focus application and release related monitoring of the application in the mobile phone are added to accurately identify the start and end of the broadcast, so that it meets the requirements of the car audio mixing. By monitoring the audio focus change event, the changes in the focus logic related processing of various applications in the mobile phone system audio framework can be perceived from the perspective of external applications, and information can be obtained from it to achieve the effect of using it to control the opening and closing of the remote physical output device of the car.

[0126] The mobile phone system service can insert stubs in the focus processing related logic to form a complete focus perception callback (AudioFocus Manager, AMF), and provide an external interface for system application authentication. When the user connects to the car computer, the car computer interconnection application needs to read the corresponding configuration parameters from the car computer, convert them into a structure that can be recognized by the mobile phone audio module, apply for focus perception monitoring callback, and apply for the release of the recorder. After the initialization is completed, it is necessary to initiate channel establishment and data transmission for the car computer protocol. According to the media playback monitoring (Audio Player Completion, APC) and focus perception callback, the channel opening and switching are controlled.

[0127] like Fig.14 As shown, it is a flowchart of the registration callback of the provided vehicle-machine interaction method, such as Fig.15 The figure shows a control flow diagram of the provided vehicle-machine interaction method. On the mobile phone side, according to the interface for applying for and releasing focus in the Media FocusControl class, add stake points and event reporting, and encapsulate the event type, focus type, and application package name into the Audio FocusInfo object. The registration monitoring interface is reserved at the F interface, and the IAudio Focus Change Callback is provided to the application, which is registered in the Audio Focus Change Callback. The Audio FocusChange Callback is used as a buffer, and another I Audio Focus Change Dispathcer is used as a file registered with the FrameWork warehouse to monitor focus changes and distribute events to the application, and the object Audio FocusInfo exposed to the outside is repackaged.

[0128] like Fig.16 As shown, it is another flow chart of the vehicle-computer interaction method provided in an embodiment of the present application.

[0129] When implementing it, first in the initialization phase:

[0130] (1) Before the mobile phone audio module is successfully connected to the vehicle, it will request two recorders from the framework according to the vehicle parameters to facilitate subsequent switching.

[0131] (2) When the connection is just made, the currently active recorder is used by default to connect to the Navi-TTS module channel of the vehicle. This ensures that the FM / USB playback before the Carlife connection is not affected.

[0132] If the user chooses to start navigation:

[0133] The mobile phone audio module sends a command to the car-machine interconnection application Carlife to start transmitting data through the navigation channel. Since the currently connected module is the Navi-TTS module, no channel switching occurs and the sound is transmitted normally. If there is FM radio playing before or after the navigation, the API callback perception complies with the car-machine audio mixing logic, so the mixing and playback can be normal.

[0134] If the user chooses to start playing music:

[0135] The channel connection module of the mobile phone audio module is the Navi-TTS module at this time, so channel switching is required. Use another recorder on standby to connect directly to the Media module, turn off the output switch of the navigation channel, and turn on the output switch of the media channel. If the user uses FM before playing music, FM will stop at this time because the Media channel is occupied (which is in line with user expectations).

[0136] If the user still needs to use navigation at this time, the channel switching will not occur, because the mobile phone navigation audio and the mobile phone media audio from the mobile phone will be mixed on the mobile phone side and transmitted to the Media module of the vehicle audio module through the media audio channel. Similarly, if the user wants to play FM radio, the channel switching will occur, switching back to the navigation channel to connect to the Navi-TTS module, pausing the music from the mobile phone and continuing the navigation.

[0137] The vehicle-machine interaction solution provided in the above-mentioned embodiment determines the start and end times of the navigation application playing the mobile phone navigation audio by monitoring the navigation application's audio focus application and audio focus release events, so as to connect the mobile phone audio module to the navigation audio channel of the vehicle audio module at the start time and close the connection between the mobile phone audio module and the navigation audio channel of the vehicle audio module at the end time to ensure the playback effect of the vehicle audio module.

[0138] In the specific implementation, considering that different types of audio playback have different sequences, the corresponding audio channel connection schemes are also different. The following will specifically explain the vehicle-machine interaction method provided by the embodiment of the present application in combination with several major vehicle-machine interaction scenarios.

[0139] In the first scenario, the mobile phone only plays the mobile navigation audio, and the car computer does not play the car computer media audio.

[0140] like Fig.17 As shown, the current audio transmission situation includes the mobile phone transmitting the mobile phone navigation audio to the vehicle for playback.

[0141] The navigation audio channel of the mobile phone audio module is connected to the car audio module (such as Fig.17 ), and according to the start and end time of each segment of mobile phone navigation audio, control the connection between the mobile phone audio module and the navigation audio channel to open and close.

[0142] Since there is currently no transmission of mobile phone media audio and vehicle computer media audio, the connection between the mobile phone audio module and the media audio channel is closed, and the connection between the vehicle computer audio module and the media audio channel is closed.

[0143] In the second scenario, the car computer plays the car computer media audio first, and the mobile phone plays the mobile phone navigation audio later.

[0144] like Fig.18 As shown, the existing audio transmission situations include: first, the car audio module transmits the car media audio to the car audio module, and then the mobile phone audio module transmits the mobile phone navigation audio to the car audio module.

[0145] When the car audio module transmits the car media audio to the car audio module, the car audio module is connected to the media audio channel of the car audio module (such as Fig.18 As shown in b), the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0146] When the mobile phone audio module transmits the mobile phone navigation audio to the car audio module, a new navigation audio channel connection is added between the mobile phone audio module and the car audio module (such as Fig.18 As shown in C in FIG), and because the mobile phone audio module does not seize the media audio channel, the vehicle audio module is still connected to the media audio channel of the vehicle audio module. The vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them.

[0147] Furthermore, the mobile phone can also control the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end time of each segment of the mobile phone navigation audio. On the one hand, when the mobile phone has mobile phone navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is opened, and the vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them. On the other hand, when the mobile phone has no mobile phone navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is closed, and the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0148] During the whole process, the media audio channel between the car audio module and the vehicle audio module is continuously connected and not interrupted, and the car media audio is also continuously played and not interrupted. It is only when new mobile phone navigation audio is played due to new road conditions that the car media audio is mixed and played at a lower volume. When there is no mobile phone navigation audio playing, the car media audio plays normally.

[0149] In the third scenario, the car computer plays the car computer media audio first, and the mobile phone plays the mobile phone navigation audio and mobile phone media audio at the same time.

[0150] like Fig.19 As shown, the existing audio transmission situations include: first, the car audio module transmits the car media audio to the car audio module, and then the mobile phone audio module transmits the mobile phone navigation audio and mobile phone media audio to the car audio module.

[0151] When the car audio module transmits the car media audio to the car audio module, the car audio module is connected to the media audio channel of the car audio module (such as Fig.19 As shown in b), the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0152] When the mobile phone audio module needs to transmit the mobile phone navigation audio and mobile phone media audio to the vehicle audio module, it will first mix the mobile phone navigation audio and mobile phone media audio to obtain the mobile phone mixed audio, and then play the mobile phone mixed audio. For the mobile phone media audio and the vehicle media audio, since they are of the same type and cannot be played at the same time, the audio played later is usually retained. In other words, if the vehicle media audio is played first and the mobile phone media audio is played later, the vehicle media audio will be paused and the mobile phone media audio will be played.

[0153] The mobile phone audio module seizes the media audio channel, so that the connection between the car audio module and the media audio channel is closed, and the connection between the mobile phone audio module and the media audio channel is opened (such as Fig.19 At this time, the vehicle audio module receives the mobile phone mixed audio transmitted by the mobile phone audio module through the media audio channel and plays the mobile phone mixed audio.

[0154] The solution for the mobile phone audio module to mix the mobile phone navigation audio output by the navigation application and the mobile phone media audio output by the media application is to superimpose the media audio and the navigation audio in the frequency domain according to the output period of the audio, and at the same time lower the volume of the media audio or increase the volume of the navigation audio to obtain the mixed audio. The mixed audio output by the mobile phone can include media audio and navigation audio at the same time, and the volume of the navigation audio is higher than the volume of the media audio. The mobile phone can accurately monitor the start and end times of the mobile phone navigation audio, and will adjust the mixing effect according to the start and end times. In this way, when the mobile phone navigation audio is playing, the mobile phone media audio is played at a low volume. When there is no mobile phone navigation audio playing, the mobile phone media audio is played at a normal volume.

[0155] In this case, since the mobile phone audio module is connected to the media audio channel of the vehicle audio module instead of the navigation audio channel, there is no need to execute the solution of controlling the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end times of each segment of the mobile phone navigation audio.

[0156] In the fourth scenario, the car computer plays the car computer media audio first, the mobile phone plays the mobile phone navigation audio later, and the mobile phone plays the mobile phone media audio later.

[0157] like Fig. 20 As shown, the existing audio transmission situations include: first the car audio module transmits the car media audio to the car audio module, then the mobile phone audio module transmits the mobile phone navigation audio to the car audio module, and then the mobile phone audio module transmits the mobile phone media audio to the car audio module.

[0158] When the car audio module transmits the car media audio to the car audio module, the car audio module is connected to the media audio channel of the car audio module (such as Fig. 20 As shown in b), the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0159] When the mobile phone audio module transmits the mobile phone navigation audio to the vehicle audio module, the newly added mobile phone audio module is connected to the navigation audio channel of the vehicle audio module, and because the mobile phone audio module does not occupy the media audio channel, the vehicle audio module is still connected to the media audio channel of the vehicle audio module. The vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them. In this process, the mobile phone can also control the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end time of each segment of the mobile phone navigation audio, so as to ensure that the vehicle audio module has a better audio output effect.

[0160] Later, when the mobile audio module needs to transmit the mobile media audio to the vehicle audio module, the mobile phone will first mix the mobile navigation audio and the mobile media audio to obtain the mobile mixed audio. Since the mobile media audio and the vehicle media audio are of the same type and cannot be played at the same time, the audio played later is usually retained. In other words, if the vehicle media audio is played first and the mobile media audio is played later, the vehicle media audio will be paused and the mobile media audio will be played.

[0161] The mobile phone audio module seizes the media audio channel, so that the connection between the car audio module and the media audio channel is closed, and the connection between the mobile phone audio module and the media audio channel is opened (such as Fig. 20 At this time, the vehicle audio module receives the mobile phone mixed audio transmitted by the mobile phone audio module through the media audio channel and plays the mobile phone mixed audio.

[0162] The solution for the mobile phone audio module to mix the mobile phone navigation audio output by the navigation application and the mobile phone media audio output by the media application is to superimpose the media audio and the navigation audio in the frequency domain according to the output period of the audio, and at the same time lower the volume of the media audio or increase the volume of the navigation audio to obtain the mixed audio. The mixed audio output by the mobile phone can include media audio and navigation audio at the same time, and the volume of the navigation audio is higher than the volume of the media audio. The mobile phone can accurately monitor the start and end times of the mobile phone navigation audio, and will adjust the mixing effect according to the start and end times. In this way, when the mobile phone navigation audio is playing, the mobile phone media audio is played at a low volume. When there is no mobile phone navigation audio playing, the mobile phone media audio is played at a normal volume.

[0163] In this case, since the mobile phone audio module is connected to the media audio channel of the vehicle audio module instead of the navigation audio channel, there is no need to execute the solution of controlling the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end times of each segment of the mobile phone navigation audio.

[0164] In the fifth scenario, the car computer plays the car computer media audio first, the mobile phone plays the mobile phone media audio later, and then the mobile phone plays the mobile phone navigation audio.

[0165] like Fig.21 As shown, the existing audio transmission situations include: first the car audio module transmits the car media audio to the car audio module, then the mobile phone audio module transmits the mobile phone media audio to the car audio module, and then the mobile phone audio module transmits the mobile phone navigation audio to the car audio module.

[0166] When the car audio module transmits the car media audio to the car audio module, the car audio module is connected to the media audio channel of the car audio module (such as Fig.21 As shown in b), the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0167] When the mobile audio module transmits the mobile media audio to the vehicle audio module, since the mobile media audio and the vehicle media audio are of the same type, the subsequent mobile media audio occupies the media audio channel (such as Fig.21 As shown in B in the figure), the connection between the previous vehicle media audio and the media audio channel is closed, and the vehicle media audio is suspended.

[0168] When the mobile phone audio module transmits the mobile phone navigation audio to the vehicle audio module, the mobile phone will first mix the mobile phone navigation audio and the mobile phone media audio to obtain the mobile phone mixed audio. The connection between the mobile phone audio module and the media audio channel is still open (such as Fig.21 At this time, the vehicle audio module receives the mobile phone mixed audio transmitted by the mobile phone audio module through the media audio channel and plays the mobile phone mixed audio.

[0169] The solution for the mobile phone audio module to mix the mobile phone navigation audio output by the navigation application and the mobile phone media audio output by the media application is to superimpose the media audio and the navigation audio in the frequency domain according to the output period of the audio, and at the same time lower the volume of the media audio or increase the volume of the navigation audio to obtain the mixed audio. The mixed audio output by the mobile phone can include media audio and navigation audio at the same time, and the volume of the navigation audio is higher than the volume of the media audio. The mobile phone can accurately monitor the start and end times of the mobile phone navigation audio, and will adjust the mixing effect according to the start and end times. In this way, when the mobile phone navigation audio is playing, the mobile phone media audio is played at a low volume. When there is no mobile phone navigation audio playing, the mobile phone media audio is played at a normal volume.

[0170] In this case, since the mobile phone audio module is connected to the media audio channel of the vehicle audio module instead of the navigation audio channel, there is no need to execute the solution of controlling the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end times of each segment of the mobile phone navigation audio.

[0171] In the sixth scenario, the mobile phone plays the mobile navigation audio first, and the car computer plays the car computer media audio later.

[0172] like Fig. 22 As shown, the existing audio transmission situations include: first, the mobile phone audio module transmits the mobile phone navigation audio to the car audio module, and then the car audio module transmits the car media audio to the car audio module.

[0173] When the mobile phone audio module transmits the mobile phone navigation audio to the vehicle audio module, the mobile phone audio module is connected to the navigation audio channel of the vehicle audio module (such as Fig. 22 As shown in B in FIG. 1 , the vehicle audio module directly plays the mobile phone navigation audio received by the navigation audio channel.

[0174] When the car audio module transmits the car media audio to the car audio module, since the mobile audio module does not occupy the media audio channel first, the car audio module can directly connect to the media audio channel of the car audio module (such as Fig. 22 As shown in b in FIG. 1 ). Since there is also a navigation audio channel connection between the navigation audio module and the vehicle audio module, the vehicle audio module needs to mix the vehicle media audio received by the media audio channel and the mobile phone navigation audio received by the navigation audio channel and then play them.

[0175] In the above two playback stages, especially when there is both mobile navigation audio playback and vehicle media audio playback, the mobile phone can also control the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end time of each segment of mobile navigation audio. On the one hand, when the mobile phone has mobile navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is opened, and the vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them. On the other hand, when the mobile phone has no mobile navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is closed, and the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0176] During the whole process, the media audio channel between the car audio module and the vehicle audio module is continuously connected and not interrupted, and the car media audio is also continuously played and not interrupted. It is only when new mobile phone navigation audio is played due to new road conditions that the car media audio is mixed and played at a lower volume. When there is no mobile phone navigation audio playing, the car media audio plays normally.

[0177] In the seventh scenario, the mobile phone plays the mobile navigation audio first, the car computer plays the car computer media audio later, and the mobile phone plays the mobile phone media audio later.

[0178] like Fig.23 As shown, the existing audio transmission situations include: first the mobile phone audio module transmits the mobile phone navigation audio to the car audio module, then the car audio module transmits the car media audio to the car audio module, and then the mobile phone transmits the mobile phone media audio to the car audio module.

[0179] When the mobile phone audio module transmits the mobile phone navigation audio to the vehicle audio module, the mobile phone audio module is connected to the navigation audio channel of the vehicle audio module (such as Fig.23 As shown in C in FIG. 1 , the vehicle audio module directly plays the mobile phone navigation audio received by the navigation audio channel.

[0180] When the car audio module transmits the car media audio to the car audio module, since the mobile audio module does not occupy the media audio channel first, the car audio module can directly connect to the media audio channel of the car audio module (such as Fig.23As shown in b in FIG. 1 ). Since there is also a navigation audio channel connection between the navigation audio module and the vehicle audio module, the vehicle audio module needs to mix the vehicle media audio received by the media audio channel and the mobile phone navigation audio received by the navigation audio channel and then play them.

[0181] In the above two playback stages, especially when there is both mobile navigation audio playback and vehicle media audio playback, the mobile phone can also control the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end time of each segment of mobile navigation audio. On the one hand, when the mobile phone has mobile navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is opened, and the vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them. On the other hand, when the mobile phone has no mobile navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is closed, and the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0182] Later, when the mobile audio module needs to transmit the mobile media audio to the vehicle audio module, the mobile phone will first mix the mobile navigation audio and the mobile media audio to obtain the mobile mixed audio. Since the mobile media audio and the vehicle media audio are of the same type and cannot be played at the same time, the audio played later is usually retained. In other words, if the vehicle media audio is played first and the mobile media audio is played later, the vehicle media audio will be paused and the mobile media audio will be played.

[0183] The mobile phone audio module seizes the media audio channel, so that the connection between the car audio module and the media audio channel is closed, and the connection between the mobile phone audio module and the media audio channel is opened (such as Fig.23 At this time, the vehicle audio module receives the mobile phone mixed audio transmitted by the mobile phone audio module through the media audio channel and plays the mobile phone mixed audio.

[0184] The mobile phone audio module mixes the mobile phone navigation audio output by the navigation application and the mobile phone media audio output by the media application. The mixed audio output by the mobile phone can include both media audio and navigation audio, and the volume of the navigation audio is higher than the volume of the media audio. The mobile phone can accurately monitor the start and end times of the mobile phone navigation audio and adjust the mixing effect according to the start and end times. In this way, when the mobile phone navigation audio is playing, the mobile phone media audio is played at a lower volume. When there is no mobile phone navigation audio playing, the mobile phone media audio is played at a normal volume.

[0185] In this case, since the mobile phone audio module is connected to the media audio channel of the vehicle audio module instead of the navigation audio channel, there is no need to execute the solution of controlling the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end times of each segment of the mobile phone navigation audio.

[0186] In the eighth scenario, the mobile phone plays the mobile navigation audio and mobile media audio first, and the car computer plays the car computer media audio later.

[0187] like Fig.24 As shown, the existing audio transmission situations include: first, the mobile phone audio module transmits the mobile phone navigation audio and the mobile phone media audio to the vehicle audio module, and then the vehicle audio module transmits the vehicle media audio to the vehicle audio module.

[0188] When the mobile audio module transmits the mobile media audio and mobile navigation audio to the vehicle audio module, the mobile phone will first mix the mobile navigation audio and mobile media audio to obtain the mobile mixed audio. The connection between the mobile audio module and the media audio channel is opened (such as Fig.24 At this time, the vehicle audio module receives the mobile phone mixed audio transmitted by the mobile phone audio module through the media audio channel and plays the mobile phone mixed audio.

[0189] The mobile phone audio module mixes the mobile phone navigation audio output by the navigation application and the mobile phone media audio output by the media application, including both media audio and navigation audio, and the volume of the navigation audio is higher than the volume of the media audio. The mobile phone can accurately monitor the start and end times of the mobile phone navigation audio, and will adjust the mixing effect according to the start and end times. In this way, when the mobile phone navigation audio is playing, the mobile phone media audio is played at a lower volume. When there is no mobile phone navigation audio playing, the mobile phone media audio is played at a normal volume.

[0190] In this case, since the mobile phone audio module is connected to the media audio channel of the vehicle audio module instead of the navigation audio channel, there is no need to execute the solution of controlling the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end times of each segment of the mobile phone navigation audio.

[0191] Afterwards, when the car audio module transmits the car media audio to the car audio module, because the mobile media audio and the car media audio belong to the same type of audio and cannot be played at the same time, the media audio channel will be preempted, and the audio played later will usually be retained. In other words, the mobile media audio is played first and the car media audio is played later, then the mobile phone will pause the playback of the mobile media audio. The mobile phone can directly send a pause playback command to the media application in the mobile phone to pause the output of the mobile media audio.

[0192] The car audio module seizes the media audio channel, so that the connection between the mobile audio module and the media audio channel is closed, and the connection between the car audio module and the media audio channel is opened (such as Fig.24As shown in b in the figure). Since the mobile phone audio module also needs to output the mobile phone navigation audio to the vehicle audio module, the mobile phone audio module can switch to the navigation audio channel connection of the vehicle audio module. At this time, the vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them.

[0193] Furthermore, the mobile phone can also control the opening and closing of the connection between the mobile phone audio module and the navigation audio channel according to the start and end time of each segment of the mobile phone navigation audio. On the one hand, when the mobile phone has mobile phone navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is opened, and the vehicle audio module mixes the vehicle media audio received by the media audio channel with the mobile phone navigation audio received by the navigation audio channel and plays them. On the other hand, when the mobile phone has no mobile phone navigation audio output, the connection between the mobile phone audio module and the navigation audio channel is closed, and the vehicle audio module directly plays the vehicle media audio received by the media audio channel.

[0194] In other cases, the car audio module may output the car navigation audio to the onboard audio module. Due to the non-preemptible nature of the navigation audio channel of the onboard audio module, there are few solutions that can be automatically operated in the scenario of car navigation output.

[0195] For example, if the mobile phone audio module outputs the mobile phone navigation audio to the navigation audio channel, and the car audio module also outputs the car navigation audio to the navigation audio channel, the channel preemption scheme will not be automatically triggered. The mobile phone can choose to close the connection between the mobile phone audio module and the navigation audio channel so that the car audio module can connect to the navigation audio channel to play the car navigation audio.

[0196] In summary, the vehicle-machine interaction method provided in the embodiment of the present application can avoid the use of traditional audio virtualization solutions, and create multiple configuration files in the underlying HAL, which will have a great impact on the device selection and playback event processing logic of the framework. And through the dual recorder standby switching mode, it is possible to use a lightweight solution to achieve a framework-friendly and vehicle-machine-friendly effect while satisfying most user scenarios. Focus perception has always been a server-client communication mode in the native framework. For the client and third parties that are not added to this tree structure, it is impossible to obtain the focus information. The focus perception framework solves this problem. Focus perception can easily obtain changes in any event in the audio system.

[0197] like Fig.25As shown, it is a structural schematic diagram of a mobile terminal 2500 provided in an embodiment of the present application. Among them, the mobile terminal 2500 may include a processor 2510, an external memory interface 2520, a memory 2521, a Universal Serial Bus (USB) interface 2530, a charging management module 2540, a power management module 2541, a battery chip 2542, a display 2550, a communication module 2560, an audio module 2570, a speaker 2570A, a receiver 2570B, a microphone 2570C, an earphone interface 2570D, a sensor module 2580, and a SIM card module 2590, etc. Among them, the sensor module 2580 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0198] The structure illustrated in the embodiment of the present invention does not constitute a limitation on the mobile terminal 2500. It may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0199] The processor 2510 may include one or more processing units. For example, the processor 2510 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0200] The controller can be the decision maker that directs the various components of the mobile terminal 2500 to work in coordination according to the instructions, and is the nerve center and command center of the mobile terminal 2500. The controller generates an operation control signal according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0201] The processor 2510 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 2510 is a cache memory, which can store instructions or data that the processor 2510 has just used or cyclically used. If the processor 2510 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 2510, and thus improves the efficiency of the system.

[0202] In some embodiments, the processor 2510 may include an interface. The interface may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI) interface, a General-Purpose Input / Output (GPIO) interface, a SIM interface, and / or a USB interface, etc.

[0203] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (Serial Data Line, SDL) and a serial clock line (Derail Clock Line, SCL). The I2S interface can be used for audio communication. The processor 2510 can be coupled to the audio module 2570 through the I2S bus to achieve communication between the processor 2510 and the audio module 2570. In some embodiments, the audio module 2570 can transmit audio signals to the communication module 2560 through the I2S interface to achieve the function of answering the phone through a Bluetooth headset. The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 2570 and the communication module 2560 can be coupled through the PCM bus interface. In some embodiments, the audio module 2570 can also transmit audio signals to the communication module 2560 through the PCM interface to achieve the function of answering the phone through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication, and the sampling rates of the two interfaces are different.

[0204] The UART interface is a universal serial data bus used for asynchronous communication. The UART interface is usually used to connect the processor 2510 and the communication module 2560. For example, the processor 2510 communicates with the Bluetooth module through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 2570 can transmit audio signals to the communication module 2560 through the UART interface to implement the function of playing music through the Bluetooth headset.

[0205] The MIPI interface can be used to connect the processor 2510 with peripheral devices such as the display 2550 and the camera. The GPIO interface can be configured by software, and the GPIO interface can be used to connect the processor 2510 with the camera, the display 2550, the communication module 2560, the audio module 2570, the sensor module 2580, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0206] The USB interface 2530 may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 2530 may be used to connect a charger to charge the mobile terminal 2500, or may be used to transmit data between the mobile terminal 2500 and peripheral devices. The USB interface 2530 may also be used to connect headphones to play audio through the headphones. The USB interface 2530 may also be used to connect other mobile terminals, such as AR devices, etc.

[0207] The interface connection relationship between the modules shown in the embodiment of the present invention is only for illustrative purposes and does not constitute a structural limitation on the mobile terminal 2500. The mobile terminal 2500 may adopt different interface connection modes in the embodiment of the present invention, or a combination of multiple interface connection modes.

[0208] The charging management module 2540 can be a rechargeable power source or a disposable power source. When it is a rechargeable power source, it can receive charging input through a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 2540 can receive charging input from a wired charger through the USB interface 2530. In some wireless charging embodiments, the charging management module 2540 can receive wireless charging input through the wireless charging coil of the mobile terminal 2500. While the charging management module 2540 is charging the battery chip 2542, it can also power the mobile terminal 2500 through the power management module 2541.

[0209] The power management module 2541 is used to connect the battery chip 2542 , the charging management module 2540 and the processor 2510 .

[0210] The wireless communication function of the mobile terminal 2500 can be implemented through an antenna, a radio frequency module, a communication module 2560, a modem, and a baseband processor.

[0211] The communication module 2560 can provide a communication processing module for wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc., which are applied to the mobile terminal 2500. The communication module 2560 can be one or more devices integrating at least one communication processing module.

[0212] The mobile terminal 2500 implements the display function through a GPU, a display 2550, and an application processor. The GPU is a microprocessor for image processing, which connects the display 2550 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 2510 may include one or more GPUs that execute program instructions to generate or change display information.

[0213] The display 2550 is used to display images, videos, etc. The display 2550 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLED, Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile terminal 2500 may include 1 or N display screens 2550, where N is a positive integer greater than 1.

[0214] The mobile terminal 2500 can realize the shooting function through ISP, camera, video codec, GPU, display screen and application processor.

[0215] The external memory interface 2520 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 2500. The external memory card communicates with the processor 2510 through the external memory interface 2520 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0216] The internal memory 2521 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 2510 executes various functional applications and data processing of the mobile terminal 2500 by running the instructions stored in the internal memory 2521. The memory 2521 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile terminal 2500 (such as audio data, a phone book, etc.), etc. In addition, the memory 2521 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, other volatile solid-state storage devices, a universal flash memory (Universal Flash Storage, UFS), etc.

[0217] The mobile terminal 2500 can implement audio functions such as music playing and recording through the audio module 2570, the speaker 2570A, the receiver 2570B, the microphone 2570C, the earphone interface 2570D, and the application processor.

[0218] The audio module 2570 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 2570 can also be used to encode and decode audio signals. In some embodiments, the audio module 2570 can be arranged in the processor 2510, or some functional modules of the audio module 2570 can be arranged in the processor 2510.

[0219] The speaker 2570A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The mobile terminal 2500 can listen to music or listen to a hands-free call through the speaker 2570A.

[0220] The receiver 2570B, also called a "handset", is used to convert audio electrical signals into sound signals. When the mobile terminal 2500 receives a call or voice message, the voice can be received by placing the receiver 2570B close to the ear.

[0221] Microphone 2570C, also called "microphone" or "microphone", is used to convert sound signals into audio electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 2570C with his mouth to input the sound signal into the microphone 2570C. The mobile terminal 2500 can be provided with at least one microphone 2570C. In some embodiments, the mobile terminal 2500 can be provided with two microphones 2570C, which can not only collect sound signals but also realize noise reduction function. In some embodiments, the mobile terminal 2500 can also be provided with three, four or more microphones 2570C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording function, etc.

[0222] The earphone interface 2570D is used to connect a wired earphone and can be a USB interface, or a 3.5 mm Open Mobile Terminal Platform (OMTP) standard interface or a Cellular Telecommunications Industry Association of the USA (CTIA) standard interface.

[0223] The SIM card module 2590 is used to implement the communication function of the SIM card. The SIM card module 2590 may include a SIM card interface, a SIM card circuit and related auxiliary devices. The SIM card can be connected to and separated from the mobile terminal 2500 by inserting it into the SIM card interface or pulling it out from the SIM card interface. The mobile terminal 2500 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card module 2590 may support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards may be inserted into the same SIM card interface at the same time. The types of the multiple cards may be the same or different. The SIM card interface may also be compatible with different types of SIM cards. The SIM card interface may also be compatible with an external memory card. The mobile terminal 2500 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the mobile terminal 2500 uses an eSIM, i.e., an embedded SIM card. The eSIM card may be embedded in the mobile terminal 2500 and cannot be separated from the mobile terminal 2500.

[0224] The vehicle-machine interaction methods in the aforementioned embodiments can all be implemented in a mobile terminal 2500 having the aforementioned hardware structure.

[0225] On the basis of the above embodiments, an embodiment of the present application further provides a vehicle-machine interaction device, which includes a processor, and the processor is used to execute the vehicle-machine interaction method provided in the above embodiments.

[0226] An embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the vehicle-computer interaction method provided in the above embodiment.

[0227] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the vehicle-computer interaction method provided in the above embodiment.

[0228] The specific implementation methods of the mobile terminal, vehicle-machine interaction system, control device, computer-readable storage medium, and computer program product containing instructions provided in the embodiments of the present application and the technical effects brought about by them can be found in the specific implementation process of the vehicle-machine interaction method provided in the aforementioned embodiments and the technical effects brought about by them, which will not be repeated here.

[0229] In some embodiments, through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0230] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0231] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0232] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A vehicle-machine interaction method, It is characterized in that Applied to a mobile terminal, the mobile terminal includes a terminal audio module, and the mobile terminal establishes a communication connection with a vehicle; the method includes: In response to the navigation application starting to play the terminal navigation audio, opening a connection between the terminal audio module and the navigation audio channel of the vehicle's onboard audio module; The terminal navigation audio is transmitted to the vehicle audio module through the navigation audio channel, so that the vehicle audio module plays the terminal navigation audio.

2. The vehicle-machine interaction method according to claim 1, It is characterized in that The terminal navigation audio does not occupy the media audio channel of the vehicle audio module.

3. The vehicle-machine interaction method according to claim 1 or 2, It is characterized in that The method further comprises: In response to the navigation application finishing playing the terminal navigation audio, closing the connection between the terminal audio module and the navigation audio channel.

4. The vehicle-machine interaction method according to claim 1 or 2, It is characterized in that The terminal navigation audio includes multiple segments of navigation audio that are discontinuous in time; The step of opening a connection between the terminal audio module and the navigation audio channel of the vehicle-mounted audio module in response to the navigation application starting to play the terminal navigation audio comprises: The navigation application starts playing a navigation audio segment, and opens a connection between the terminal audio module and the navigation audio channel; The method further comprises: The navigation application finishes playing a section of navigation audio and ends the connection between the terminal audio module and the navigation audio channel.

5. The vehicle-machine interaction method according to claim 4, It is characterized in that The method further comprises: Monitoring the audio focus change event of the navigation application; wherein the audio focus change event includes an audio focus application event and an audio focus release event; When an audio focus request event of the navigation application is monitored, determining that the navigation application starts playing a navigation audio segment; When an audio focus release event of the navigation application is monitored, it is determined that the navigation application ends playing a section of navigation audio.

6. The vehicle-machine interaction method according to claim 1 or 2, It is characterized in that The mobile terminal further includes a media application, and the vehicle audio module further includes a media audio channel; the method further includes: In response to the media application starting to play the terminal media audio, opening a connection between the terminal audio module and the media audio channel; The terminal mixed audio obtained by mixing the terminal navigation audio and the terminal media audio is transmitted to the vehicle audio module through the media audio channel, so that the vehicle audio module plays the terminal mixed audio.

7. The vehicle-machine interaction method according to claim 6, It is characterized in that The method further comprises: In the process of the navigation application playing the terminal navigation audio, receiving a first operation, where the first operation is used to trigger the media application to start playing the terminal media audio; In response to the first operation, the media application starts playing the terminal media audio and closes the connection between the terminal audio module and the navigation audio channel.

8. The vehicle-machine interaction method according to claim 7, It is characterized in that The method further comprises: receiving a second operation, where the second operation is used to trigger the media application to stop playing the terminal media audio; In response to the second operation, the media application stops playing the terminal media audio, closes the connection between the terminal audio module and the media audio channel, opens the connection between the terminal audio module and the navigation audio channel, and transmits the terminal navigation audio to the vehicle audio module through the navigation audio channel, so that the vehicle audio module plays the terminal navigation audio.

9. The vehicle-machine interaction method according to any one of claims 6 to 8, It is characterized in that After the step of transmitting the terminal mixed audio after mixing the terminal navigation audio with the terminal media audio to the vehicle audio module through the media audio channel so that the vehicle audio module plays the terminal mixed audio, the method further includes: If the connection between the terminal audio module and the media audio channel is disconnected, the media application is controlled to stop playing the terminal media audio, and the terminal navigation audio is transmitted to the vehicle audio module through the navigation audio channel, so that the vehicle audio module plays the terminal navigation audio.

10. A vehicle-machine interaction method, It is characterized in that Applied to a vehicle-machine interaction system, the vehicle-machine interaction system includes a mobile terminal and a vehicle, the mobile terminal establishes a communication connection with the vehicle, the mobile terminal includes a terminal audio module and a navigation application, and the vehicle includes a vehicle audio module; the system includes: The terminal audio module starts playing the terminal navigation audio in response to the navigation application, and opens a connection between the terminal audio module and the navigation audio channel; The terminal audio module transmits the terminal navigation audio to the vehicle audio module through the navigation audio channel; The vehicle audio module plays the terminal navigation audio.

11. The vehicle-machine interaction method according to claim 10, It is characterized in that The terminal navigation audio does not occupy the media audio channel of the vehicle audio module.

12. The vehicle-machine interaction method according to claim 10 or 11, It is characterized in that The method further comprises: In response to the navigation application finishing playing the terminal navigation audio, the terminal audio module closes the connection between the terminal audio module and the navigation audio channel.

13. The vehicle-machine interaction method according to claim 10 or 11, It is characterized in that The terminal navigation audio includes multiple segments of navigation audio that are discontinuous in time; The step of starting the connection between the terminal audio module and the navigation audio channel of the vehicle-mounted audio module in response to the navigation application starting to play the terminal navigation audio by the terminal audio module comprises: The navigation application starts playing a navigation audio segment, and the terminal audio module opens a connection between the terminal audio module and the navigation audio channel; The method further comprises: The navigation application finishes playing a section of navigation audio, and the terminal audio module ends the connection between the terminal audio module and the navigation audio channel.

14. The vehicle-machine interaction method according to claim 13, It is characterized in that The method further comprises: The terminal audio module monitors the audio focus change event of the navigation application; wherein the audio focus change event includes an audio focus application event and an audio focus release event; When the terminal audio module monitors the audio focus request event of the navigation application, the terminal audio module determines that the navigation application starts to play a navigation audio segment; When the terminal audio module monitors the audio focus release event of the navigation application, it determines that the navigation application ends playing a section of navigation audio.

15. The vehicle-machine interaction method according to any one of claims 10 to 14, It is characterized in that The vehicle also includes a vehicle audio module; The vehicle audio module outputs vehicle media audio to the vehicle audio module; The vehicle audio module plays the terminal navigation audio, including: The vehicle audio module plays the vehicle mixed audio that is a mixture of the terminal navigation audio and the vehicle media audio.

16. The vehicle-machine interaction method according to claim 15, It is characterized in that After the vehicle audio module plays the vehicle mixed audio that is a mixture of the terminal navigation audio and the vehicle media audio, the method further includes: The terminal audio module starts the connection between the terminal audio module and the media audio channel in response to the media application starting to play the terminal media audio; the vehicle audio module pauses playing the vehicle media audio; The terminal audio module transmits the terminal mixed audio obtained by mixing the terminal navigation audio and the terminal media audio to the vehicle audio module through the media audio channel, so that the vehicle audio module plays the terminal mixed audio.

17. The vehicle-machine interaction method according to claim 16, It is characterized in that The method further comprises: During the process of the navigation application playing the terminal navigation audio, the terminal audio module receives a first operation, where the first operation is used to trigger the media application to start playing the terminal media audio; In response to the first operation, the media application starts playing the terminal media audio, and the terminal audio module transmits the terminal mixed audio obtained by mixing the terminal navigation audio with the terminal media audio to the vehicle audio module through the media audio channel; The vehicle audio module plays the terminal mixed audio.

18. The vehicle-machine interaction method according to claim 17, It is characterized in that The method further comprises: During the process of the vehicle audio module playing the terminal mixed audio, the vehicle media audio module outputs the vehicle media audio to the vehicle audio module; The media application pauses playing the terminal media audio, the terminal audio module closes the connection with the media audio channel and opens the connection with the navigation audio channel, and the vehicle audio module opens the connection with the media audio channel; The vehicle audio module plays the vehicle mixed audio that is a mixture of the terminal navigation audio and the vehicle media audio.

19. A mobile terminal, It is characterized in that The mobile terminal comprises a terminal audio module, a memory and a processor, wherein the memory and the terminal audio module are coupled to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the mobile terminal executes the vehicle-machine interaction method according to any one of claims 1 to 9.

20. A vehicle-machine interaction system, It is characterized in that The vehicle-machine interaction system includes a mobile terminal and a vehicle, the mobile terminal establishes a communication connection with the vehicle, the mobile terminal includes a terminal audio module and a navigation application, the vehicle includes an on-board audio module, and the vehicle-machine interaction system can execute the vehicle-machine interaction method as described in any one of claims 10 to 18.

21. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the vehicle-computer interaction method as claimed in any one of claims 1 to 9, or the vehicle-computer interaction method as claimed in any one of claims 10 to 18.

Images