Vehicle-mounted audio picture presentation method, controller and computer readable storage medium

Abstract

The embodiment of the invention relates to the technical field of vehicle-mounted display, and discloses a vehicle-mounted audio picture presentation method, a controller and a computer readable storage medium. The method comprises the steps of determining picture switching information in response to a picture switching operation received when a first screen presents a target picture, searching a second audio channel corresponding to device information of a second screen in a preset audio path library according to the picture switching information, determining a target screen and a target audio channel according to mirror image mode information, and displaying the target screen and the target audio channel. And controlling the target screen to present the target picture and the target audio channel to output the target audio data. According to the embodiment of the invention, the target audio channel can be flexibly selected to present the audio data in the multi-screen switching scene, and the mirror image mode information can be utilized to perform multi-screen simultaneous display or single-screen different display on the target picture and the target audio data of the target picture.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of vehicle-mounted display technology, and specifically to a method for presenting a vehicle-mounted audio image, a controller, and a computer-readable storage medium. Background Art

[0002] With the development of Internet of Things technology, car cockpits are becoming more and more intelligent. The cockpit provided by the relevant technology is equipped with a main screen on the main driver's seat, a sub-screen on the co-pilot seat or the back seat, and multiple speakers are arranged around the cockpit. The main screen and the sub-screen can share the picture to each other's screen for presentation, but the relevant technology cannot bring the audio of the picture to the other party's position for presentation. For example, the speaker corresponding to the main screen is speaker A, and the speaker corresponding to the co-pilot seat is speaker B. The main screen presents the video picture, and the audio of the video picture is currently presented by speaker A. The user switches the video picture of the main screen to the sub-screen for presentation, but the audio of the video picture is still presented by speaker A, which can easily affect the user experience of the driver or passenger. Summary of the invention

[0003] One purpose of the embodiments of the present application is to provide a method, a controller and a computer-readable storage medium for presenting an in-vehicle audio picture, so as to solve the technical problem that the related technology cannot flexibly select the audio channel to present the audio data in a multi-screen switching scenario.

[0004] In a first aspect, an embodiment of the present application provides a method for presenting an in-vehicle audio screen, comprising: responding to a screen switching operation received when a first screen presents a target screen, determining screen switching information, the screen switching information including device information and mirror mode information of a second screen, target audio data of the target screen being output through a first audio channel of the first screen before switching, the mirror mode information being used to indicate a mirroring manner of the target screen and the target audio data of the target screen between the first screen and the second screen, searching a preset audio path library for a second audio channel corresponding to the device information of the second screen according to the screen switching information, determining a target screen and a target audio channel according to the mirror mode information, the target screen being one or both of the first screen and the second screen, the target audio channel being one or both of the first audio channel and the second audio channel, and controlling the target screen to present the target screen and the target audio channel to output the target audio data.

[0005] The embodiment of the present application can not only flexibly select the target audio channel to present audio data in a multi-screen switching scenario, but also use the mirror mode information to display the target picture and the target audio data of the target picture on multiple screens at the same time or on different screens.

[0006] Optionally, the mirroring mode information includes the same display mode information and the different display mode information, and determining the target screen according to the mirroring mode information includes: in response to the mirroring mode information being the same display mode information, determining that the first screen and the second screen are both target screens. The embodiment of the present application can not only mirror the target screen to the second screen for presentation through the first screen, but also simultaneously retain the target screen for presentation on the first screen, which is conducive to improving the user experience.

[0007] Optionally, determining the target screen according to the mirroring mode information includes: in response to the mirroring mode information being the different display mode information, determining the second screen as the target screen. The embodiment of the present application can mirror the target screen of the first screen to the second screen for presentation, thereby facilitating the user facing the second screen to view the target screen.

[0008] Optionally, the method further includes: determining a target privacy level of the target picture. Correspondingly, determining the target audio channel according to the mirror mode information includes: determining the target audio channel according to the target privacy level and the mirror mode information. The embodiment of the present application can fuse the target privacy level and the mirror mode information to determine the target audio channel, fully consider the privacy of the target audio data, and avoid inappropriate sharing of the target audio data with others, thereby causing privacy leakage.

[0009] Optionally, determining the target audio channel according to the target privacy level and the mirror mode information includes: in response to the target privacy level being greater than a preset level threshold, determining the first audio channel as the target audio channel. When the target privacy level is greater than the preset level threshold, the privacy level of the target screen is relatively high. In the same display mode, if the target audio data is transmitted to the second audio channel for presentation, it is easy to disclose the personal privacy of the user of the first screen to the user of the second screen. Therefore, in the process of switching between multiple screens, the embodiment of the present application still outputs the target audio data through the first audio channel, so as to avoid disclosing the personal privacy of the user of the first screen.

[0010] Optionally, determining the target audio channel according to the target privacy level and the mirror mode information includes: in response to the target privacy level being less than or equal to a preset level threshold, determining the target service type of the target audio data, and determining the target audio channel according to the target service type and the mirror mode information. The embodiment of the present application presents the target audio data in a personalized manner according to the service type of the target audio data, so that the target audio data can adapt to various service scenarios, which is conducive to improving the user experience.

[0011] Optionally, the target service type includes a first service type and a second service type, the first service type is used to indicate that the target audio data needs to be presented on one side of the first screen, and the second service type is used to indicate that the target audio data can be presented on any screen between the first screen and the second screen, and determining the target audio channel according to the target service type and the mirror mode information includes: in response to the target service type being the first service type, determining the first audio channel as the target audio channel. The service type of the target audio data requires that the target audio data needs to be presented on one side of the first screen to ensure that the user of the first screen can clearly hear the target audio channel, thereby ensuring that the user of the first screen can reliably complete related operations in the vehicle.

[0012] Optionally, determining the target audio channel according to the target service type and the mirror mode information includes: in response to the target service type being the second service type, determining the target audio channel according to the mirror mode information. The service type of the target audio data does not limit the output position of the target audio data, and the target audio data can be output according to the mirror mode selected by the user, which is conducive to improving the user experience.

[0013] Optionally, the mirror mode information includes same-display mode information and different-display mode information, and determining the target audio channel according to the mirror mode information includes: in response to the mirror mode information being same-display mode information, determining that the first audio channel and the second audio channel are both target audio channels. In this way, the embodiment of the present application can adapt to the same-display mode selected by the user, and when the target picture is retained on the local first screen for presentation and the target picture is mirrored to the second screen for presentation, the target audio data of the target picture can be transmitted to the first audio channel and the second audio channel respectively for presentation, thereby facilitating the user of the first screen and the user of the second screen to watch the target picture and listen to the target audio data at the same time.

[0014] Optionally, determining the target audio channel according to the mirror mode information includes: in response to the mirror mode information being the different display mode information, determining the second audio channel as the target audio channel. In this way, the embodiment of the present application can adaptively adapt to the different display mode selected by the user, and mirror the target picture of the first screen to the second screen for presentation. At the same time, the target audio data of the target picture can be transferred to the second audio channel for presentation along with the transfer of the target picture. In this way, the inconsistency between the picture and the sound source can be avoided, which is conducive to improving the user experience.

[0015] Optionally, controlling the target audio channel to output target audio data includes: if the target audio channel is a wireless audio channel, determining the communication status of the target audio channel, and controlling the output of the target audio data according to the communication status of the target audio channel. In this way, the embodiment of the present application can avoid the situation where the target audio data is easily lost due to not paying attention to the communication status of the target audio channel, thereby being able to reliably output the target audio data.

[0016] Optionally, controlling the target audio channel to output the target audio data includes: if the target audio channel is a wired audio channel, outputting the target audio data based on the target audio channel. Since the target audio channel is a wired audio channel, the target audio channel is not prone to losing the target audio data. Therefore, the embodiment of the present application can directly transmit the target audio data to the target audio channel.

[0017] Optionally, the communication status includes a normal communication status and an abnormal communication status, and controlling the output of the target audio data according to the communication status of the target audio channel includes: in response to the communication status of the target audio channel being a normal communication status, controlling the target audio channel to output the target audio data.

[0018] Optionally, controlling the output of the target audio data according to the communication state of the target audio channel includes: in response to the communication state of the target audio channel being a communication abnormal state, controlling the target audio data to be temporarily stored on a preset virtual audio channel, in response to the communication state of the target audio channel being updated from the communication abnormal state to the communication normal state, controlling the target audio data of the virtual audio channel to be transmitted to the target audio channel, and controlling the target audio channel to output the target audio data. The embodiment of the present application can temporarily store the target audio data in the virtual audio channel, so as to avoid the target audio data being lost by directly transmitting the target audio data to the target audio channel, thereby improving the reliability of transmitting the target audio data.

[0019] In a second aspect, an embodiment of the present application provides a controller comprising a memory and a processor, wherein the memory is connected to the processor, and the processor is used to execute one or more computer programs stored in the memory. When the processor executes the one or more computer programs, the controller implements the above-mentioned method for presenting in-vehicle audio images.

[0020] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program includes program instructions, and when the program instructions are executed by a processor, the processor executes the above-mentioned method for presenting an in-vehicle audio screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0022] Figure 1 A schematic diagram of the system architecture of a multi-screen interactive system provided in an embodiment of the present application;

[0023] Figure 2 An application provided in the embodiment of the present application Figure 1 A schematic diagram of a scene of a vehicle cockpit of a multi-screen interactive system shown;

[0024] Figure 3a A schematic diagram of a scenario in which a video application is opened on a first screen to present a target picture, provided in an embodiment of the present application;

[0025] Figure 3b For operation Figure 3a A schematic diagram of a scene in which the sidebar of the first screen switches pages with a pop-up screen;

[0026] Figure 3c For click Figure 3b The “confirm button” of the screen switching page is shown to present a scene schematic diagram of the mirror mode selection page;

[0027] Figure 3d For click Figure 3b The schematic diagram of the scene behind the same display mode button on the mirror mode selection page shown;

[0028] Figure 3e For click Figure 3b The schematic diagram of the scene behind the special display mode button on the mirror mode selection page shown;

[0029] Figure 4 A schematic diagram of a flow chart of a method for presenting an in-vehicle audio picture provided in an embodiment of the present application;

[0030] Figure 5 A schematic diagram of the structure of a vehicle audio picture presentation device provided in an embodiment of the present application;

[0031] Figure 6 A schematic diagram of the structure of a controller provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0033] It should be noted that, if there is no conflict, the various features in the embodiments of the present application can be combined with each other, all within the scope of protection of the present application. In addition, although the functional module division is performed in the device schematic diagram and the logical order is shown in the flow chart, in some cases, the steps shown or described can be performed in a sequence different from the module division in the device or the flow chart. Furthermore, the words "first", "second", "third", etc. used in this application do not limit the data and execution order, but only distinguish the same items or similar items with basically the same functions and effects.

[0034] In the process of implementing the embodiments of the present application, the inventors also found that the following related technologies have related technical problems, as follows:

[0035] 1. The related technology can match different audio devices for different screens. The main screen corresponds to the main audio device, and the sub-screen corresponds to the sub-audio device. When the picture of the main screen is switched to the sub-screen for display, the audio data of the picture is switched to be presented by the sub-audio device. Similarly, when the picture of the sub-screen is switched to the main screen for display, the audio data of the picture is switched to be presented by the main audio device. It can be seen that the related technology can only select an audio device that can match the switched screen from the main audio device and the sub-audio device to present the audio data of the picture. However, in some application scenarios, users hope that both the main screen and the sub-screen can display the picture and present the audio data of the picture at the same time.

[0036] 2. When a user opens a high-privacy application on the main screen, such as a social application, or when the main screen starts a call answering application and displays the incoming call answering screen, the main screen not only shares the incoming call answering screen to the sub-screen for display, but also presents the telephone conversation audio through the audio device corresponding to the sub-screen, which can easily leak the user's privacy.

[0037] 3. When driving a vehicle, the driver is accustomed to opening the navigation application (application, app) on the main screen. The navigation application can provide the driver with navigation voice information to assist the driver in driving reliably and effectively according to the navigation voice information. In some application scenarios, passengers hope that the driver can share the navigation screen of the navigation application so that the passengers can also understand the itinerary. According to the audio control strategy of the relevant technology, the relevant technology not only shares the navigation screen to the secondary screen, but also presents the navigation voice information of the navigation screen through the audio device corresponding to the secondary screen, which causes the driver to be unable to hear clear navigation voice information, thereby affecting driving safety.

[0038] The embodiments of the present application can not only flexibly select audio channels to present audio data in a multi-screen switching scenario, but also utilize mirror mode information to display the target screen and the target audio data of the target screen on multiple screens at the same time or on different screens, and can also perform personalized presentation according to the business type of the target audio data, as well as perform privacy protection processing on the target audio data in combination with the privacy level of the target screen.

[0039] The following embodiments of the present application provide a multi-screen interactive system. Figure 1 and Figure 2 The multi-screen interactive system 100 includes a first screen 11, a second screen 12, a speaker 13, a wireless communication module 14 and a controller 15.

[0040] The first screen 11 and the second screen 12 are both mounted on the vehicle cockpit. In some embodiments, the first screen 11 is mounted at the center control position of the vehicle cockpit, and the second screen 12 is mounted at the rear position of the vehicle cockpit. In some embodiments, the second screen 12 is mounted at the center control position of the vehicle cockpit, and the first screen 11 is mounted at the rear position of the vehicle cockpit.

[0041] The first screen 11 and / or the second screen 12 supports the installation of various desktop applications, including phone dialing applications, video applications, music applications, navigation applications, social applications, etc. The user can start various desktop applications on the first screen 11 or the second screen 12, so that the first screen 11 or the second screen 12 presents the interface of the corresponding desktop application. It is understandable that the number of the first screen 11 or the second screen 12 can be one or more than two.

[0042] There are multiple speakers 13, which are arranged around the vehicle cabin. The speakers 13 are used to present audio data.

[0043] The wireless communication module 14 is used to establish a wireless connection with an external terminal, and the first screen 11 or the second screen can transmit audio data to the external terminal through the wireless communication module 14. The wireless communication module 14 includes a Bluetooth module or a WIFI module.

[0044] It is understandable that the embodiment of the present application can match the corresponding audio channel for each screen in advance, so that an audio path library can be established. The audio channel can be a speaker or a wireless communication module. For example, the number of speakers 13 is 2, and the first screen 11 is bound to the speaker L1 and the speaker L2 respectively, and the binding relationship is {PID1, L1, L2}, where PID1 is the device information of the first screen 11. The second screen 12 is bound to the wireless communication module, and the binding relationship is {PID2, BT}, where PID2 is the device information of the second screen 12, and BT is the device information of the wireless communication module. The audio path library is {{PID1, L1, L2}, {PID2, BT}}.

[0045] The controller 15 is electrically connected to the first screen 11, the second screen 12, the speaker 13 and the wireless communication module 14. The controller 15 is used as the control core of the multi-screen interactive system 100 to control the image interaction and audio interaction between the first screen 11 and the second screen 12.

[0046] The working principle of the multi-screen interactive system 100 is as follows:

[0047] See also Figure 3a The driver opens a video application on the first screen 11, the video application presents the target picture 31, and the speaker L1 and the speaker L2 present the target audio data of the target picture 31. The passenger establishes a wireless connection with the wireless communication module of the multi-screen interactive system through the Bluetooth of the headset.

[0048] See also Figure 3b The driver operates the sidebar 32 of the first screen 11, and a screen switching page 33 pops up in the sidebar 32. The screen switching page 33 includes a "confirm button 34", a "cancel button 35" and a content display area 36. The content display area 36 presents the following prompt information: Do you want to switch the current screen to the second screen for presentation?

[0049] See also Figure 3c When the driver clicks the “confirm button 34 ” of the screen switching page 33 , the first screen 11 presents a mirror mode selection page 37 , which includes a same display mode button 38 and a different display mode button 39 .

[0050] See also Figure 3d When the driver clicks the "same display mode button 38", the controller 15 mirrors the target picture 31 of the first screen 11 to the second screen 12 for presentation. At the same time, the first screen 11 still presents the target picture 31, and the speaker L1 and the speaker L2 both present the target audio data of the target picture 31. At the same time, the controller 15 transmits the target audio data of the target picture 31 to the passenger's headphones based on the wireless communication module 14, and the passenger listens to the target audio data through the headphones.

[0051] See also Figure 3e When the driver clicks the "abnormal display mode button 39", the controller 15 switches the target picture 31 of the first screen 11 to the second screen 12 for presentation, the first screen 11 stops presenting the target picture 31, the speakers L1 and L2 stop presenting the target audio data of the target picture 31, and the controller 15 transmits the target audio data of the target picture 31 to the passenger's headphones based on the wireless communication module 14, and the passenger listens to the target audio data through the headphones.

[0052] Therefore, in a multi-screen switching scenario, the embodiment of the present application can not only flexibly select the audio channel to present the audio data, but also utilize the mirror mode information to display the target screen and the target audio data of the target screen on multiple screens at the same time or on different screens.

[0053] Hereinafter, the present application embodiment provides a method for presenting an in-vehicle audio picture. Figure 4 The method for presenting the in-vehicle audio picture includes steps S41 to S44.

[0054] The embodiment of the present application executes step S41, responding to the screen switching operation received when the first screen presents the target screen, and determining the screen switching information. The screen switching information includes the device information and the mirror mode information of the second screen, the target audio data of the target screen is output through the first audio channel of the first screen before switching, and the mirror mode information is used to indicate the mirroring mode of the target screen and the target audio data of the target screen between the first screen and the second screen.

[0055] There are many ways to determine screen switching information. In some embodiments, the embodiment of the present application responds to the operation received by the sidebar when the first screen presents the target screen, and presents a screen switching page. Next, the embodiment of the present application responds to the user's single-click operation on the confirmation button input of the screen switching page, and presents a mirror mode selection page. Next, the embodiment of the present application responds to the user's selection operation input on the mirror mode selection page to determine the mirror mode information. The embodiment of the present application obtains the device information of the second screen, and combines the device information of the second screen with the mirror mode information to form the screen switching information.

[0056] The mirror mode information includes the same display mode information and the different display mode information. In response to the selection operation input by the user on the mirror mode selection page, determining the mirror mode information includes the following steps: responding to the selection operation input by the user on the same display mode button of the mirror mode selection page, determining the same display mode information, or responding to the selection operation input by the user on the different display mode button of the mirror mode selection page, determining the different display mode information.

[0057] In some embodiments, the embodiments of the present application obtain voice information collected by the first screen, determine mirror mode information based on the voice information, obtain device information of the second screen, and combine the device information of the second screen and the mirror mode information to form screen switching information.

[0058] Acquiring the device information of the second screen includes the following steps: acquiring the device information of the second screen from the ActivityThread class. The ActivityThread class is responsible for starting the application, creating and managing the process of the application, and the life cycle management of all components of the application.

[0059] It is understandable that in some embodiments, the first screen is the central control screen (ie, the main screen), and the second screen is the secondary screen. In some embodiments, the first screen is the secondary screen, and the second screen is the central control screen.

[0060] The embodiment of the present application executes step S42 to search for a second audio channel corresponding to the device information of the second screen in a preset audio path library according to the screen switching information.

[0061] The audio path library is configured in advance by the designer. The audio path library records the audio channels corresponding to each screen. Please refer to Table 1:

[0062] Table 1

[0063] Device information of the screen Bound audio channels PID1 L1, L2 PID2 BT

[0064] As can be seen from Table 1, the audio path library records that the audio channels bound to the first screen are speakers L1 and speakers L2, and the audio channels bound to the second screen are wireless communication module BT. The embodiment of the present application uses the device information of the second screen as an index to traverse the audio path library to obtain the second audio channel corresponding to the device information of the second screen, that is, the second audio channel is speakers L1 and speakers L2. Specifically, after obtaining the screen switching information, the embodiment of the present application passes the screen switching information into the audioservice service through the setparameter method in the AudioManager service. After receiving the screen switching information, the audiopolicy service of the audioservice service calls the audio path library and traverses the second audio channel matching the device information of the second screen in the audio path library.

[0065] In this embodiment of the present application, step S43 is executed to determine a target screen and a target audio channel according to the mirroring mode information, where the target screen is one or both of the first screen and the second screen, and the target audio channel is one or both of the first audio channel and the second audio channel.

[0066] The embodiment of the present application executes step S44 to control the target screen to present the target picture and the target audio channel to output the target audio data. Therefore, the embodiment of the present application can not only flexibly select the target audio channel to present the audio data in the multi-screen switching scenario, but also use the mirror mode information to display the target picture and the target audio data of the target picture on multiple screens at the same time or on different screens.

[0067] In some embodiments, determining the target screen according to the mirroring mode information includes the following steps: in response to the mirroring mode information being the same display mode information, determining that the first screen and the second screen are both target screens. In this way, the embodiment of the present application can not only mirror the target screen to the second screen for presentation through the first screen, but also can simultaneously retain the target screen for presentation on the first screen, which is conducive to improving the user experience.

[0068] In some embodiments, determining the target screen according to the mirror mode information includes the following steps: in response to the mirror mode information being the different display mode information, determining the second screen as the target screen. In this way, the embodiment of the present application can mirror the target screen of the first screen to the second screen for presentation, thereby facilitating the user facing the second screen to watch the target screen.

[0069] There are many strategies for determining the target audio channel based on the mirror mode information.

[0070] In some embodiments, determining the target audio channel according to the mirror mode information includes the following steps: in response to the mirror mode information being the same-display mode information, determining that the first audio channel and the second audio channel are both target audio channels. In this way, the embodiment of the present application can adapt to the same-display mode selected by the user, and when the target picture is retained on the local first screen for presentation and the target picture is mirrored to the second screen for presentation, the target audio data of the target picture can be transmitted to the first audio channel and the second audio channel respectively for presentation, thereby facilitating the user of the first screen and the user of the second screen to watch the target picture and listen to the target audio data at the same time.

[0071] In some embodiments, determining the target audio channel according to the mirror mode information includes the following steps: in response to the mirror mode information being the different display mode information, determining the second audio channel as the target audio channel. In this way, the embodiment of the present application can adaptively adapt to the different display mode selected by the user, and mirror the target picture of the first screen to the second screen for presentation. At the same time, the target audio data of the target picture can be transferred to the second audio channel for presentation along with the transfer of the target picture. In this way, the inconsistency between the picture and the sound source can be avoided, which is beneficial to improving the user experience.

[0072] The embodiment of the present application can perform privacy protection processing on the target audio data in combination with the privacy level of the target screen. In some embodiments, the method for presenting the in-vehicle audio screen also includes step S45, step S45: determining the target privacy level of the target screen. Correspondingly, determining the target audio channel according to the mirror mode information includes: determining the target audio channel according to the target privacy level and the mirror mode information.

[0073] The target privacy level is the privacy level that matches the target screen. Determining the target privacy level of the target screen includes the following steps: determining a target application that presents the target screen, and traversing a preset privacy level library to find a privacy level corresponding to the target application as the target privacy level.

[0074] Determining the target application for presenting the target screen includes the following steps: in response to the determination of the mirror mode information, obtaining application information for presenting the target screen, and determining the target application according to the application information. The application information is a software label of the target application.

[0075] See Table 2:

[0076] Table 2

[0077] app Privacy Level Phone dialing application 2 Video Application 1 Music Apps 1 Navigation Apps 1 Social Apps 2

[0078] As can be seen from Table 2, the privacy level library records the privacy levels of 5 types of applications, where the larger the value of the privacy level, the higher the privacy level. The smaller the value of the privacy level, the lower the privacy level. The privacy level of the phone dialing application and the social application is level 2, and the privacy level of the video application, music application and navigation application is level 1. If the target screen is presented by a video application, the video application is the target application, and the target privacy level is level 1. If the target screen is presented by a social application, the social application is the target application, and the target privacy level is level 2. The embodiment of the present application can integrate the target privacy level and the mirror mode information to determine the target audio channel, fully consider the privacy of the target audio data, and avoid inappropriate sharing of the target audio data with others, thereby causing privacy leakage.

[0079] In some embodiments, determining the target audio channel according to the target privacy level and the mirror mode information includes the following steps: in response to the target privacy level being greater than a preset level threshold, determining the first audio channel as the target audio channel.

[0080] The preset level threshold is customized by the designer based on engineering experience, for example, the preset level threshold is 1. When the target privacy level is greater than the preset level threshold, the privacy level of the target screen is relatively high. In the same display mode, if the target audio data is transmitted to the second audio channel for presentation, it is easy to leak the personal privacy of the user of the first screen to the user of the second screen. Therefore, in the process of multi-screen switching, the embodiment of the present application still outputs the target audio data through the first audio channel, so as to avoid leaking the personal privacy of the user of the first screen.

[0081] In some embodiments, when the target privacy level is greater than a preset level threshold, the embodiment of the present application controls the first screen to present a privacy protection page, and the privacy protection page is used to prompt the user whether to share the current screen with a high privacy level, wherein the privacy protection page includes a confirmation button and a cancel button. Then, the embodiment of the present application responds to the user's single-click operation on the confirmation button input of the privacy protection page, and determines the target audio channel according to the target business type and the mirror mode information. Alternatively, the embodiment of the present application responds to the user's single-click operation on the cancel button input of the privacy protection page, and determines that the first audio channel is the target audio channel.

[0082] For example, due to an erroneous operation, the user of the first screen shares the target screen of the phone dialing application with the user of the second screen. However, during the sharing process, the embodiment of the present application detects that the privacy level of the target screen is high, and presents a privacy protection page to the user of the first screen. When the user of the first screen knows that this operation is an erroneous operation, the user of the first screen clicks the cancel button of the privacy protection page, and the embodiment of the present application determines that the first audio channel is the target audio channel, that is, the embodiment of the present application does not output the target audio data of the phone dialing application through the second audio channel, but still outputs it through the first audio channel, thereby protecting the telephone communication content of the user of the first screen from being leaked.

[0083] In general, the embodiment of the present application presents a privacy protection page when the target privacy level is greater than a preset level threshold to remind the user whether to share the current screen with a high privacy level, thereby reliably preventing the user from leaking personal privacy due to misoperation.

[0084] In some embodiments, determining the target audio channel according to the target privacy level and the mirror mode information includes the following steps: in response to the target privacy level being less than or equal to a preset level threshold, determining the target service type of the target audio data, and determining the target audio channel according to the target service type and the mirror mode information. The embodiment of the present application presents the target audio data in a personalized manner according to the service type of the target audio data, so that the target audio data can adapt to various service scenarios, which is conducive to improving the user experience.

[0085] The target service type includes a first service type and a second service type. The first service type is used to indicate that the target audio data needs to be presented on one side of the first screen, and the second service type is used to indicate that the target audio data can be presented on any screen between the first screen and the second screen. For example, the service type of the audio data output by the navigation application is the first service type, and the driver can drive reliably according to the audio data about navigation output by the navigation application. The service type of the audio data output by the video application, the music application, or the social application is the second service type.

[0086] In some embodiments, determining the target audio channel according to the target service type and the mirror mode information includes the following steps: in response to the target service type being the first service type, determining the first audio channel as the target audio channel. At this time, the service type of the target audio data requires that the target audio data be presented on one side of the first screen to ensure that the user of the first screen can clearly hear the target audio channel, thereby ensuring that the user of the first screen can reliably complete related operations in the vehicle.

[0087] In some embodiments, determining the target audio channel according to the target service type and the mirror mode information includes the following steps: in response to the target service type being the second service type, determining the target audio channel according to the mirror mode information. In this case, the service type of the target audio data does not restrict the output position of the target audio data, and the target audio data can be output according to the mirror mode selected by the user, which is conducive to improving the user experience.

[0088] On the premise that the target service type is the second service type, determining the target audio channel according to the mirror mode information includes the following steps: in response to the mirror mode information being the same display mode information, determining that the first audio channel and the second audio channel are both target audio channels, or, in response to the mirror mode information being the different display mode information, determining that the second audio channel is the target audio channel.

[0089] After the target audio channel is determined in the embodiment of the present application, the target audio channel can be controlled to output the target audio data. In some embodiments, controlling the target audio channel to output the target audio data includes the following steps: if the target audio channel is a wireless audio channel, the communication state of the target audio channel is determined, and the output of the target audio data is controlled according to the communication state of the target audio channel. In this way, the embodiment of the present application can avoid the situation where the target audio data is easily lost due to not paying attention to the communication state of the target audio channel, so that the target audio data can be reliably output.

[0090] In some embodiments, controlling the target audio channel to output the target audio data includes the following steps: if the target audio channel is a wired audio channel, outputting the target audio data based on the target audio channel. Since the target audio channel is a wired audio channel, the target audio channel is not prone to losing the target audio data. Therefore, the embodiment of the present application can directly transmit the target audio data to the target audio channel.

[0091] The communication status includes a normal communication status and an abnormal communication status. The normal communication status is used to indicate that the wireless communication module can communicate with the external terminal, and the abnormal communication status is used to indicate that the wireless communication module cannot communicate with the external terminal.

[0092] In some embodiments, controlling the output of target audio data according to the communication state of the target audio channel includes the following steps: in response to the communication state of the target audio channel being a normal communication state, controlling the target audio channel to output the target audio data.

[0093] In some embodiments, controlling the output of target audio data according to the communication status of the target audio channel includes the following steps: in response to the communication status of the target audio channel being a communication abnormality state, controlling the target audio data to be temporarily stored on a preset virtual audio channel, in response to the communication status of the target audio channel being updated from the communication abnormality state to the communication normal state, controlling the target audio data of the virtual audio channel to be transmitted to the target audio channel, and controlling the target audio channel to output the target audio data.

[0094] For example, the audio channel bound to the second screen is a Bluetooth communication module. During use, the Bluetooth communication module of the second screen has two states, one state is that the Bluetooth communication module has established a connection with the external terminal, and the other state is that the Bluetooth communication module has not established a connection with the external terminal.

[0095] When the Bluetooth communication module has established a connection with an external terminal (such as a Bluetooth headset), the embodiment of the present application transmits the target audio data to the Bluetooth communication module, and the Bluetooth communication module transmits the target audio data to the Bluetooth headset. The user of the second screen can listen to the target audio data through the Bluetooth headset.

[0096] When the Bluetooth communication module has not established a connection with the Bluetooth headset, the embodiment of the present application temporarily stores the target audio data on the virtual audio channel. When the Bluetooth communication module has established a connection with the Bluetooth headset, the embodiment of the present application transmits the target audio data of the virtual audio channel to the Bluetooth communication module, and the Bluetooth communication module transmits the target audio data to the Bluetooth headset. The user of the second screen can listen to the target audio data through the Bluetooth headset. Therefore, the embodiment of the present application can temporarily store the target audio data in the virtual audio channel, so as to avoid the target audio data being lost by directly transmitting the target audio data to the target audio channel, thereby improving the reliability of transmitting the target audio data.

[0097] It should be noted that, in each of the above-mentioned embodiments, there is not necessarily a certain order between the above-mentioned steps. A person skilled in the art can understand, based on the description of the embodiments of the present application, that in different embodiments, the above-mentioned steps may have different execution orders, that is, they may be executed in parallel, may be executed interchangeably, and so on.

[0098] As another aspect of the embodiment of the present application, the embodiment of the present application provides a vehicle audio picture presentation device. The vehicle audio picture presentation device can be a software module, and the software module includes a number of instructions, which are stored in a memory, and the processor can access the memory and call the instructions for execution to complete the vehicle audio picture presentation method described in the above embodiments.

[0099] In some embodiments, the in-vehicle audio screen presentation device can also be constructed by hardware devices. For example, the in-vehicle audio screen presentation device can be constructed by one or more chips, and each chip can work in coordination with each other to complete the in-vehicle audio screen presentation method described in each of the above embodiments. For another example, the in-vehicle audio screen presentation device can also be constructed by various logic devices, such as a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a single-chip microcomputer, an ARM (Acorn RISC Machine) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these components.

[0100] See also Figure 5 The vehicle audio and video presentation device 500 includes a video switching module 51 , a route query module 52 , a screen channel determination module 53 and an audio and video output module 54 .

[0101] The screen switching module 51 is used to respond to the screen switching operation received when the first screen presents the target screen, and determine the screen switching information. The screen switching information includes the device information and mirror mode information of the second screen. The target audio data of the target screen is output through the first audio channel of the first screen before switching. The mirror mode information is used to indicate the mirroring mode of the target screen and the target audio data of the target screen between the first screen and the second screen. The route query module 52 is used to search the second audio channel corresponding to the device information of the second screen in the preset audio path library according to the screen switching information. The screen channel determination module 53 is used to determine the target screen and the target audio channel according to the mirror mode information. The target screen is one or both of the first screen and the second screen, and the target audio channel is one or both of the first audio channel and the second audio channel. The audio screen output module 54 is used to control the target screen to present the target screen and the target audio channel to output the target audio data.

[0102] The embodiment of the present application can not only flexibly select the target audio channel to present audio data in a multi-screen switching scenario, but also use the mirror mode information to display the target picture and the target audio data of the target picture on multiple screens or on a single screen.

[0103] In some embodiments, the mirror mode information includes same-display mode information and different-display mode information, and determining the target screen according to the mirror mode information includes: responding to the mirror mode information as same-display mode information, determining that the first screen and the second screen are both target screens; or responding to the mirror mode information as different-display mode information, determining that the second screen is the target screen.

[0104] In some embodiments, the method further includes: determining a target privacy level of the target picture. Correspondingly, determining the target audio channel according to the mirror mode information includes: determining the target audio channel according to the target privacy level and the mirror mode information.

[0105] In some embodiments, determining the target audio channel based on the target privacy level and the mirror mode information includes: in response to the target privacy level being greater than a preset level threshold, determining the first audio channel as the target audio channel; or, in response to the target privacy level being less than or equal to the preset level threshold, determining the target business type of the target audio data, and determining the target audio channel based on the target business type and the mirror mode information.

[0106] In some embodiments, the target business type includes a first business type and a second business type, the first business type is used to indicate that the target audio data needs to be presented on one side of the first screen, and the second business type is used to indicate that the target audio data can be presented on any screen between the first screen and the second screen, and determining the target audio channel according to the target business type and the mirror mode information includes: in response to the target business type being the first business type, determining the first audio channel as the target audio channel; or, in response to the target business type being the second business type, determining the target audio channel according to the mirror mode information.

[0107] In some embodiments, the mirror mode information includes same-display mode information and different-display mode information, and determining the target audio channel according to the mirror mode information includes: in response to the mirror mode information being the same-display mode information, determining that the first audio channel and the second audio channel are both target audio channels; or, in response to the mirror mode information being the different-display mode information, determining that the second audio channel is the target audio channel.

[0108] In some embodiments, controlling the target audio channel to output target audio data includes: if the target audio channel is a wireless audio channel, determining the communication status of the target audio channel, and controlling the output of the target audio data according to the communication status of the target audio channel; if the target audio channel is a wired audio channel, outputting the target audio data based on the target audio channel.

[0109] In some embodiments, the communication status includes a normal communication status and an abnormal communication status. Controlling the output of the target audio data according to the communication status of the target audio channel includes: in response to the communication status of the target audio channel being a normal communication status, controlling the target audio channel to output the target audio data; or, in response to the communication status of the target audio channel being an abnormal communication status, controlling the target audio data to be temporarily stored on a preset virtual audio channel, in response to the communication status of the target audio channel being updated from the abnormal communication status to the normal communication status, controlling the target audio data of the virtual audio channel to be transmitted to the target audio channel, and controlling the target audio channel to output the target audio data.

[0110] It should be noted that the above-mentioned in-vehicle audio picture presentation device can execute the in-vehicle audio picture presentation method provided in the embodiment of the present application, and has the corresponding functional modules and beneficial effects of the execution method. For technical details not fully described in the embodiment of the in-vehicle audio picture presentation device, please refer to the in-vehicle audio picture presentation method provided in the embodiment of the present application.

[0111] See also Figure 6 , Figure 6A schematic diagram of the structure of a controller provided in an embodiment of the present application. The controller 600 includes one or more processors 61 and a memory 62. The memory 62 is connected to the one or more processors 61, for example, connected to the processor 61 via a bus.

[0112] The processor 61 is configured to support the controller to perform the corresponding functions in the method in the above method embodiment. The processor can be a central processing unit (CPU), a network processor (NP), a hardware chip or any combination thereof. The above hardware chip can be an application specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above PLD can be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.

[0113] The memory 62 is used to store program codes, etc. The memory may include a volatile memory (VM), such as a random access memory (RAM); the memory may also include a non-volatile memory (NVM), such as a read-only memory (ROM), a flash memory, a hard disk drive (HDD) or a solid-state drive (SSD); the memory may also include a combination of the above types of memory.

[0114] The memory 62 can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions / modules corresponding to the method for presenting the in-vehicle audio screen in the embodiment of the present application. The processor executes the various functional applications and data processing of the method for presenting the in-vehicle audio screen and the device for presenting the in-vehicle audio screen by running the non-volatile software programs, instructions and modules stored in the memory, that is, to realize the functions of the various modules or units of the method for presenting the in-vehicle audio screen and the device for presenting the in-vehicle audio screen provided in the above method embodiment.

[0115] The memory 62 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function. The data storage area may store data created according to the use of the in-vehicle audio picture presentation device, etc. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the in-vehicle audio picture presentation device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0116] The one or more modules are stored in the memory, and when executed by the one or more processors, they execute the method for presenting the in-vehicle audio screen in any of the above-mentioned method embodiments, for example, execute the method steps described in the above-mentioned method embodiments to realize the functions of the modules described in the above-mentioned device embodiments.

[0117] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a controller, the controller executes the method described in the above embodiment.

[0118] A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. The storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0119] The above disclosure is only the preferred embodiment of the present application, which certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A method for presenting an in-vehicle audio picture, characterized in that: include: In response to a screen switching operation received when the first screen presents a target screen, determining screen switching information, the screen switching information including device information and mirror mode information of the second screen, target audio data of the target screen being output through a first audio channel of the first screen before switching, and the mirror mode information being used to indicate a mirroring mode of the target screen and the target audio data of the target screen between the first screen and the second screen; According to the screen switching information, searching a preset audio path library for a second audio channel corresponding to the device information of the second screen; Determine a target screen and a target audio channel according to the mirroring mode information, wherein the target screen is one or both of the first screen and the second screen, and the target audio channel is one or both of the first audio channel and the second audio channel; The target screen is controlled to present the target picture and the target audio channel is controlled to output the target audio data.

2. The presentation method according to claim 1, characterized in that: The mirror mode information includes same display mode information and different display mode information, and determining the target screen according to the mirror mode information includes: In response to the mirror mode information being the same display mode information, determining that both the first screen and the second screen are target screens; or, In response to the mirror mode information being the different display mode information, determining the second screen as the target screen.

3. The presentation method according to claim 1, characterized in that: The method further includes: determining a target privacy level of the target picture; Correspondingly, determining the target audio channel according to the mirror mode information includes: determining the target audio channel according to the target privacy level and the mirror mode information.

4. The presentation method according to claim 3, characterized in that: The determining the target audio channel according to the target privacy level and the mirror mode information comprises: In response to the target privacy level being greater than a preset level threshold, determining the first audio channel as a target audio channel; or, In response to the target privacy level being less than or equal to a preset level threshold, a target service type of the target audio data is determined, and a target audio channel is determined according to the target service type and the mirror mode information.

5. The presentation method according to claim 4, characterized in that: The target service type includes a first service type and a second service type, the first service type is used to indicate that the target audio data needs to be presented on one side of the first screen, and the second service type is used to indicate that the target audio data can be presented on any screen between the first screen and the second screen, and determining the target audio channel according to the target service type and the mirror mode information includes: In response to the target service type being the first service type, determining the first audio channel as the target audio channel; or, In response to the target service type being the second service type, a target audio channel is determined according to the mirroring mode information.

6. The presentation method according to claim 5, characterized in that: The mirror mode information includes same display mode information and different display mode information, and determining the target audio channel according to the mirror mode information includes: In response to the mirror mode information being the same display mode information, determining that the first audio channel and the second audio channel are both target audio channels; or, In response to the mirror mode information being the different display mode information, determining the second audio channel as the target audio channel.

7. The presentation method according to any one of claims 1 to 6, characterized in that: The controlling the target audio channel to output the target audio data comprises: If the target audio channel is a wireless audio channel, determining a communication state of the target audio channel, and controlling the output of the target audio data according to the communication state of the target audio channel; If the target audio channel is a wired audio channel, the target audio data is output based on the target audio channel.

8. The presentation method according to claim 7, characterized in that: The communication state includes a normal communication state and an abnormal communication state, and the controlling the output of the target audio data according to the communication state of the target audio channel includes: In response to the communication state of the target audio channel being a normal communication state, controlling the target audio channel to output the target audio data; or, In response to the communication state of the target audio channel being an abnormal communication state, controlling the target audio data to be temporarily stored on a preset virtual audio channel; In response to the communication state of the target audio channel being updated from the abnormal communication state to the normal communication state, the target audio data of the virtual audio channel is controlled to be transmitted to the target audio channel, and the target audio channel is controlled to output the target audio data.

9. A controller, characterized in that: It includes a memory and a processor, the memory is connected to the processor, the processor is used to execute one or more computer programs stored in the memory, and when the processor executes the one or more computer programs, the controller implements the method for presenting the in-vehicle audio screen as described in any one of claims 1-8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which includes program instructions. When the program instructions are executed by a processor, the processor executes the method for presenting an in-vehicle audio picture as described in any one of claims 1 to 8.

Images