Control method of vehicle-mounted multimedia system, electronic device, and storage medium

Abstract

Embodiments of the present application provide a control method of an in-vehicle multimedia system, an electronic device and a storage medium. In some embodiments, the in-vehicle multimedia system includes a plurality of multimedia units and a media controller corresponding to each multimedia unit, and the control method includes: determining a media controller information database according to a listening result of a running session of a car machine system, the media controller information database including media controller information and a session token of the multimedia unit corresponding to the running session; and in response to receiving a control instruction, determining the session token of a first multimedia unit corresponding to a unified media controller according to the media controller information database, to call the first multimedia unit to respond to the control instruction through the session token, wherein the unified media controller is the media controller corresponding to the first multimedia unit, and the first multimedia unit is a multimedia unit that is running or a multimedia unit corresponding to received media tag information.

Description

Technical Field

[0001] The embodiments of this application relate to the field of vehicle control, and more specifically, to a control method, electronic device and storage medium for an in-vehicle multimedia system. Background Technology

[0002] As people's living standards improve, the popularity of automobiles is also increasing, and cars have become an indispensable part of daily life. The rapid development of intelligent vehicles has accelerated the upgrading and promotion of intelligent cockpits, which have become a key interface for intelligent driving, in-vehicle entertainment, and artificial intelligence. Among related technologies, the multimedia functions of intelligent cockpits are also very popular. Therefore, the in-vehicle multimedia system of an intelligent cockpit generally includes one or more multimedia units, such as Bluetooth music, USB music, FM radio, and online music.

[0003] However, each multimedia unit corresponds to a media controller, and each media controller can only control its corresponding multimedia unit. Therefore, when switching between different multimedia units, users need to reopen the in-vehicle multimedia system's media interface and perform corresponding clicks to use the appropriate media controller to control the corresponding multimedia unit, which is very cumbersome and results in a poor user experience. Summary of the Invention

[0004] The embodiments of this application provide a control method, electronic device, and storage medium for an in-vehicle multimedia system that can at least partially solve the above-mentioned or other problems existing in the prior art.

[0005] This application provides a control method for an in-vehicle multimedia system. The in-vehicle multimedia system includes multiple multimedia units and media controllers corresponding to each multimedia unit. The control method includes: determining a media controller information database based on the monitoring results of the operating session of the vehicle system. The media controller information database includes media controller information and session tokens of the multimedia units corresponding to the operating session; and in response to receiving a control command, determining the session token of a first multimedia unit corresponding to a unified media controller based on the media controller information database, so as to invoke the first multimedia unit to respond to the control command through the session token. The unified media controller is the media controller corresponding to the first multimedia unit, and the first multimedia unit is a running multimedia unit or a multimedia unit corresponding to the received media tag information.

[0006] Embodiments of this application also provide an electronic device, including at least one processor and a memory. The memory is communicatively connected to the at least one processor and stores instructions executable by the at least one processor. These instructions are executed by the at least one processor to enable the at least one processor to perform the control method of the in-vehicle multimedia system mentioned in the above embodiments.

[0007] The embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the control method of the in-vehicle multimedia system mentioned in the above embodiments.

[0008] According to some embodiments of this application, the in-vehicle multimedia system maintains a media controller information database that stores the correspondence between media controllers and session tokens of multimedia units corresponding to running sessions. This allows the in-vehicle multimedia system to determine the session token of the currently running multimedia unit or the multimedia unit corresponding to received media tag information based on the media controller information database. The system can then invoke that multimedia unit to respond to user-triggered control commands, eliminating the need for the user to open the media interface of the multimedia unit and perform corresponding click operations. This achieves integrated control of multiple multimedia units, significantly reducing operational complexity and improving user-friendliness. Furthermore, the in-vehicle multimedia system can monitor the running sessions of the vehicle system and, based on the monitoring results, determine the media controller information database storing the correspondence between media controllers and session tokens of multimedia units corresponding to running sessions. This eliminates the need for individual session token registration for each multimedia unit, enabling integrated control without registration. Attached Figure Description

[0009] Other features, objects, and advantages of this application will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings. Wherein:

[0010] Figure 1 These are schematic block diagrams of in-vehicle multimedia systems according to some embodiments of this application;

[0011] Figure 2 This is a flowchart illustrating a control method for an in-vehicle multimedia system according to some embodiments of this application;

[0012] Figure 3 This is a framework diagram of an in-vehicle multimedia system according to some other embodiments of this application;

[0013] Figure 4 These are interactive schematic diagrams of an in-vehicle multimedia system according to some embodiments of this application; and

[0014] Figure 5 These are schematic block diagrams of electronic devices according to some embodiments of this application. Detailed Implementation

[0015] To better understand this application, various aspects of this application will be described in more detail with reference to the accompanying drawings. It should be understood that these detailed descriptions are merely illustrative of exemplary embodiments of this application and are not intended to limit the scope of this application in any way. Throughout the specification, the same reference numerals refer to the same elements. The expression "and / or" includes any and all combinations of one or more of the associated listed items.

[0016] It should also be understood that expressions such as "comprising," "including," "having," "containing," and / or "comprising" are open-ended rather than closed-ended expressions in this specification, indicating the presence of the stated features, elements, and / or components, but not excluding the presence of one or more other features, elements, components, and / or combinations thereof. Furthermore, when expressions such as "at least one of..." appear after a list of listed features, they modify the entire list of features, not just individual elements in the list. Additionally, when describing embodiments of this application, the word "may" is used to mean "one or more embodiments of this application." And the term "exemplary" is intended to refer to examples or illustrations.

[0017] Unless otherwise specified, all terms used herein (including engineering and technical terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. It should also be understood that, unless expressly stated herein, terms defined in common dictionaries shall be interpreted as having the meaning consistent with their meaning in the context of the relevant art, and not as having an idealized or overly formalized meaning.

[0018] It should be noted that, unless otherwise specified, the embodiments and features described in this application can be combined with each other. Furthermore, unless explicitly limited or contradicted by the context, the specific steps included in the methods described in this application are not limited to the order in which they are described, but can be performed in any order or in parallel. This application will now be described in detail with reference to the accompanying drawings and embodiments.

[0019] With the rapid development of smart cockpits, their multimedia functions have become increasingly popular. Therefore, some smart cockpits integrate one or more media units into their central control systems, such as a local multimedia unit, and the essential FM radio, USB music, and Bluetooth music playback to meet customer multimedia needs. Users can also download music from third-party multimedia units to suit their preferences. However, currently, there is no unified management system for these multimedia units; users typically need to access and control each individual unit.

[0020] Based on this, in order to solve some of the above-mentioned problems or other issues, in the embodiments of this application, the in-vehicle multimedia system 100 can be as follows: Figure 1As shown, the system includes a fusion control module 110, multiple multimedia units 120 (which may include, for example, a first multimedia unit 121, a second multimedia unit 122, etc.), media controllers 130 corresponding to each multimedia unit (e.g., a first media controller 131, a second media controller 132, etc.), and a vehicle infotainment system. The fusion control module 110 can store the correspondence between the media controller and session token of the multimedia unit corresponding to the monitored running session. Therefore, it can determine the session token of the corresponding multimedia unit based on the media controller of the multimedia unit, and then invoke the multimedia unit to respond to the received control commands, thereby achieving unified control (or fusion control) of the multimedia units. The following is an exemplary description of the scheme for implementing fusion control.

[0021] Figure 2 This is a flowchart illustrating a control method for an in-vehicle multimedia system according to some embodiments of this application. For example... Figure 2 As shown, the control method 200 of the in-vehicle multimedia system 100 can be executed in cooperation with the fusion control module 110 and other modules, and includes the following steps:

[0022] S21, determine the media controller information database based on the monitoring results of the vehicle system's operating session. The media controller information database includes the media controller information and session token of the multimedia unit corresponding to the operating session; and

[0023] S22, in response to receiving a control command, determine the session token of the first multimedia unit corresponding to the unified media controller according to the media controller information database, so as to invoke the first multimedia unit to respond to the control command through the session token, wherein the unified media controller is the media controller corresponding to the first multimedia unit, and the first multimedia unit is the multimedia unit that is running or the multimedia unit corresponding to the received media tag information.

[0024] According to some embodiments of this application, the in-vehicle multimedia system maintains a media controller information database that stores the correspondence between media controllers and session tokens of multimedia units corresponding to running sessions. This allows the in-vehicle multimedia system to determine the session token of the currently running multimedia unit or the multimedia unit corresponding to received media tag information based on the media controller information database. The system can then invoke that multimedia unit to respond to user-triggered control commands, eliminating the need for the user to open the media interface of the multimedia unit and perform corresponding click operations. This achieves integrated control of multiple multimedia units, significantly reducing operational complexity and improving user-friendliness. Furthermore, the in-vehicle multimedia system can monitor the running sessions of the vehicle system and, based on the monitoring results, determine the media controller information database storing the correspondence between media controllers and session tokens of multimedia units corresponding to running sessions. This eliminates the need for individual session token registration for each multimedia unit, enabling integrated control without registration.

[0025] For ease of understanding, the following is... Figure 2 The implementation of the control method 200 of the example vehicle multimedia system 100 is illustrated by way of example.

[0026] Figure 3 This is a framework diagram of an in-vehicle multimedia system according to some other embodiments of this application. In some embodiments of this application, such as… Figure 3 As shown, the in-vehicle multimedia system 100 may include a fusion control module 110, a multimedia unit information display interface 150, a media controller display interface 160, basic components 170, common components 180, multiple multimedia units (not shown), and media controllers (not shown) corresponding to each multimedia unit. The basic component 170 primarily provides basic capabilities for the smart cockpit. The common component 180 is mainly a shared component for the applications comprised of the fusion control module 110, the multimedia unit information display interface 150, and the media controller display interface 160. In this example, the fusion control module 110 interacts with the multimedia units through the vehicle system; the two are independent and uncoupled.

[0027] In some examples, the multimedia unit information display interface 150 can be used to display icon buttons for multiple multimedia units, such as music player, FM radio, USB music, Bluetooth music, and corresponding icon buttons. It can also display other third-party music media units connected to the convergence control module 110. For example, when the multimedia unit 120 is connected to the server or the page is visible, a session token is registered with the vehicle system to determine the session token for accessing the multimedia unit and the media tag information of the multimedia unit. It is understood that the multimedia unit can be registered repeatedly, and the vehicle system can perform algorithmic filtering based on the Media Tag. Relevant data from the media controller of the multimedia unit 120 can be accessed and displayed on the multimedia unit information display interface 150.

[0028] In some examples, the media controller display interface 160 can use information returned by the converged control module 110 to display and control the operation buttons of the media controller interface for different multimedia units in a unified manner. These operation buttons may include default buttons of the media controller of the multimedia unit 120, such as pause, play, previous track, and next track buttons, as well as user-customized operation buttons, such as playlist display buttons and lyrics display buttons; there are no restrictions here. For example, the media controller display interface 160 can register a currently running media controller callback function (Active Controller Callback) with the converged media control unit 110. The Active Controller Callback can call back the media data and control instructions of the currently running multimedia unit or the multimedia unit with a specified Media Tag. This includes, for example, data related to the change of the session token (Active Media SessionToken) of the running multimedia unit, data related to the lyrics information of the running multimedia unit (Active Media), data related to the playback status information of the Active Media, data related to the session events (Active MediaSession Event) of the running multimedia unit, and data related to the destruction of the active media session. The relevant data can be media data or control commands.

[0029] In some examples, the media controller display interface 160 can display the media controller of the multimedia unit itself, i.e., the media controller set up for a single multimedia unit, according to the instructions of the convergence control module 110.

[0030] In some examples, the media controller display interface 160 can present the media controller to the user as a top-level music card. For instance, a global media music display (integrated local multimedia units and / or third-party multimedia units) can be provided, including album, song title, artist, previous / next track, play / pause, and other dynamic functions. In the above example, through the top-level music card, the integrated control module can display media information via the music card and expose an interface to control the multimedia units.

[0031] In some examples, the multimedia unit information display interface 150 can be used to display the media data of the audio source corresponding to the multimedia unit and inject fusion into the fusion control module when it is first played or displayed.

[0032] In some examples, the flow logic in the convergence control module 110 allows it to obtain the session token of the multimedia unit based on the media tag information of the multimedia unit for processing, relaying, and distributing the data and media sessions of the multimedia unit. Optionally, the convergence control module 110 can pass instructions or data information to the media controller presentation layer by maintaining an external unified media controller interface. The flow logic of the convergence control module 110 is illustrated below.

[0033] In some embodiments of this application, the in-vehicle multimedia system can first initialize and configure the fusion control module 110. For example, during the initialization process of the fusion control module 110, an `addOnActiveSessionsChangedListener` can be added to the fusion control module 110 to monitor changes in the running session (ActiveSession) within the vehicle system (the OS system of the smart cockpit). The fusion control module 110 maintains a media controller information set with a session token as the key and the media controller of the multimedia unit as the value. Here, the running session can refer to the running session of the multimedia unit. Since the multimedia unit sends media data (e.g., media tag information of the multimedia unit, session token of the running session of the multimedia unit, etc.) to the vehicle system after a user playback action is triggered, in some embodiments of this application, the fusion control module 110 can obtain the media data of the multimedia unit from the vehicle system by monitoring the vehicle system, without requiring the multimedia unit to register separately with the fusion control module 110.

[0034] In some implementations, the fusion control module 110 can register media controller callback functions for multimedia units based on key-value pairs in the media controller information set. For example, the fusion control module 110 can register media controller callback functions for each media controller in the media controller information set. By registering media controller callback functions, the fusion control module 110 can determine the current state of the corresponding multimedia unit based on the callback information of the media controller callback functions. The current state of the multimedia unit may include a running state and a stopped state, or it may be divided into different states based on other principles; this is not limited here.

[0035] As an example, if the fusion control module 110 receives any of the following callback information from the Media Controller Callback, it determines that the multimedia unit is in an active state: STATE_FAST_FORWARDING, STATE_REWINDING, STATE_SKIPPING_TO_PREVIOUS, STATE_SKIPPING_TO_NEXT, STATE_SKIPPING_TO_QUEUE_ITEM, STATE_BUFFERING, STATE_CONNECTING, or STATE_PLAYING.

[0036] It should be understood that, without departing from the teachings of this application, the operating state of different multimedia units may include a variety of specific states, and their callback information may also include a variety of types, which this application does not limit.

[0037] In some embodiments of this application, the fusion control module 110 can maintain a media controller information database based on the monitoring results of the vehicle system's operating session during operation. For example, after the monitoring results indicate a change in the operating session, the fusion control module 110 can update the media controller information database according to the changed operating session, so that the media controller information database includes the media controller information of the multimedia unit corresponding to the changed operating session and the session token of the changed operating session.

[0038] In some embodiments of this application, the media controller information database may include a media controller information set and session token information. The media controller information set stores key-value pairs of the media controller and session token of the multimedia unit, and the session token information includes the session token of the multimedia unit. The process by which the fusion control module 110 updates the media controller information database according to the changed operating session may include: obtaining the session token data corresponding to the changed operating session; updating the media controller information set according to the session token data and session token information; and updating the session token information according to the updated media controller information set. The updating process of the media controller information set may include: deleting session tokens in the session token information that match the session token data to obtain screening data; deleting key-value pairs in the media controller information set that match the screening data; and determining key-value pairs to be added based on session tokens in the session token data that do not match the session token information, and adding the key-value pairs to be added to the media controller information set. Through the above method, the media controller information database can include the media controller information of the multimedia unit corresponding to the changed operating session and the session token of the changed operating session.

[0039] It should be understood that, without departing from the teachings of this application, the storage format of the media controller information and session token of the multimedia unit corresponding to the running session in the media controller information database can be set as needed, and this application does not impose any restrictions on this.

[0040] Alternatively, during the operation of the in-vehicle multimedia system, the MediaController Callback can be registered and deregistered for each change in the running session.

[0041] As an example, the media controller information database may include a set of media controller information and session token information. The method by which the fusion control module 110 maintains the media controller information database can be found in the relevant description above. In this example, the fusion control module 110 can deregister based on the screening data mentioned above. For example, the fusion control module 110 can register a media controller callback function for a media controller corresponding to a session token that did not match successfully. The fusion control module can also deregister the media controller callback functions of the multimedia units corresponding to the session tokens in the screening data.

[0042] To facilitate understanding, the following example illustrates the maintenance process of the media controller information database and the registration and deregistration process of the media controller callback, using the storage of session token information in list form as an example.

[0043] For example, the fusion control module 110 can establish a media controller information set (referred to as set A) with tonken as the key and Media Controller as the value based on the monitoring results of the vehicle system's running sessions, and establish a unique list B with the keys in set A as values, so as to unregister set A based on list B. If the monitoring results of the running sessions indicate that the running sessions have changed, that is, when the vehicle system's Active Sessions Changed list is updated, the fusion control module 110 can perform a deletion operation on list B according to the session tokens of the running sessions in the updated Active Sessions Changed list. This deletion operation includes deleting session tokens in list B that are consistent with the session tokens in the updated Active Sessions Changed list. The list B after the deletion operation (hereinafter referred to as list C for ease of description) is the screening data mentioned above. The session tokens in list C are the session tokens of the running sessions that have been closed during this monitoring. The fusion control module 110 can perform key judgment on the key-value pairs in set A according to list C. If the key of the key-value pair in set A is the same as the key in list C, that is, the two match, the key-value pair is deleted. For session tokens in the Active Sessions Changed list that are inconsistent with list B, the fusion control module 110 can determine the key-value pair corresponding to the inconsistent session token, add the key-value pair to set A, and register the media controller callback function of the media controller in the key-value pair. The fusion control module 110 can unregister the media controller callback functions of the multimedia units corresponding to the session tokens in list C. After unregistration, the fusion control module 110 deletes the data in list C and re-fills list C based on the updated session tokens in set A to obtain a new list B. Through the above process, the fusion control module 110 can complete the update of set A and list B after running the session update.

[0044] It should be understood that, without departing from the teachings of this application, the session token information in the media controller information database may also be stored in other forms than a list, and this application does not limit this.

[0045] After providing an exemplary description of the initial configuration of the fusion control module 110, the following is an exemplary description of the process of implementing fusion control based on the media controller information database in the fusion control module 110.

[0046] In some embodiments of this application, the fusion control module 110 can extract the unified media controller from the registered media controller and obtain the media data of the actually active first multimedia unit. The media data of the first multimedia unit may include media tag information, session tokens, etc., and is not limited here.

[0047] As an example, the fusion control module 110 can determine the current state of each multimedia unit during the process of writing key-value pairs into the media controller information set, or it can determine the current state of the corresponding multimedia unit based on the callback information of the media controller callback function, and determine the first multimedia unit based on the current state of the multimedia unit. For example, the fusion control module can determine the state of a multimedia unit when the callback information of the media controller callback function of the multimedia unit includes state change information (onPlaybackStateChanged). For instance, if the playback state in the media controller callback function is any of STATE_FAST_FORWARDING, STATE_REWINDING, STATE_SKIPPING_TO_PREVIOUS, STATE_SKIPPING_TO_NEXT, STATE_SKIPPING_TO_QUEUE_ITEM, STATE_BUFFERING, STATE_CONNECTING, and STATE_PLAYING, it can be determined that the multimedia unit is running, and the media controller of that multimedia unit is determined as the unified controller.

[0048] As another example, the fusion control module 110 can define the multimedia unit corresponding to the received media tag information as the first multimedia unit and determine the media controller of the first multimedia unit as the unified media controller. For example, the fusion control module 110 can use the media controller of the multimedia unit corresponding to the media tag information specified by the user as the unified media controller. For instance, if a user wants to switch to a different multimedia unit, they can directly control the playback of that multimedia unit via voice command, such as "Please play XXX (multimedia unit name)". The fusion control module 120 receives this voice command, which is also the media tag information of the multimedia unit, and can define the media controller of that multimedia unit as the unified media controller based on this command. In the above method, since the first multimedia unit can also be a multimedia unit with a specified Media Tag, the user can switch to other multimedia units without reopening the media page.

[0049] In the above manner, the unified media controller exposed by the fusion control module 110 is usually a single unit. Through this exposed unified media controller, the currently running multimedia unit or the multimedia unit that the user wants to control can be controlled without having to open the control interface of the multimedia unit separately, thus realizing the fusion control of multiple multimedia units.

[0050] In some embodiments of this application, the fusion control module 110 can establish a currently running media controller callback function upon receiving a first registration request from the media controller display interface. After determining that the multimedia unit is controlled by the unified media controller, the fusion control module 110 can feed back the media data of the first multimedia unit to the media controller display interface through the currently running media controller callback function.

[0051] As an example, after determining that any multimedia unit is running, the fusion control module 110 can define that multimedia unit as the first multimedia unit and send callback information of the currently running controller callback function to the media controller display interface 160. The media controller display interface 160 can send a session event request to the fusion control module 110 based on detected user operations; this request may carry user-triggered control commands. Upon receiving the session event request, the fusion control module 110 can forward it to the vehicle system, which then forwards it to the multimedia unit information display interface 150. The multimedia unit information display interface 150 sends back the media data after the first multimedia unit responds to the session event request. Upon receiving the media data, the vehicle system can forward it to the fusion control module 110, which then forwards it to the media controller display interface 160.

[0052] In some embodiments of this application, the in-vehicle multimedia system may also be configured with a private interface to meet the user's personalized needs. For example, the fusion control module 110 may register private interface information after receiving a second registration request for the private interface; in response to receiving a personalized instruction corresponding to the private interface, obtain personalized feedback information based on the personalized instruction; and send the personalized feedback information back to the multimedia unit information display interface or the media controller display interface based on the private interface information. For example, if there is a personalized requirement, the multimedia information display interface 150 and / or the media controller display interface 160 may establish a private interface and register `registerPlayerInfo` with the fusion control module 110 to enable bidirectional data interaction between the multimedia unit information display interface 150 and / or the media controller display interface 160 and the fusion control module 110.

[0053] In some embodiments of this application, a multimedia unit can be connected to achieve more personalized needs through a private interface. The following provides an exemplary description of how the multimedia unit can be connected.

[0054] As an example, a page routing configuration method can be used to connect a multimedia unit to a private interface to obtain personalized feedback information. For instance, page routing configuration can be performed in the fusion control module 110. The routing configuration format can be, for example, scheme (underlying protocol) + host (multimedia unit identifier) ​​+ path (resource access path), or other formats. For example, if the private interface is a private interface of the same multimedia unit, its format can be path; there are no restrictions here. For example, after connecting the multimedia unit, the multimedia information display interface 150 can respond to personalized commands according to the routing configuration. If no routing configuration is performed on the private interface, i.e., the multimedia unit is not connected, the in-vehicle multimedia system can display the default multimedia information display page and not provide personalized feedback information. As another example, after connecting the multimedia unit, the media controller display interface 160 can load the media controller interface of the multimedia unit according to the routing configuration, i.e., the media controller interface designed specifically for that multimedia unit. If no routing configuration is performed on the private interface, i.e., the multimedia unit is not connected, the media controller display interface 160 can display the default media controller interface. This method allows the media controller of a specific multimedia unit to be displayed.

[0055] As an example, multimedia unit access can be configured through the media controller display interface 160. For instance, when the media data of a running multimedia unit changes, a `CustomAction action_init_info` can be sent to the running multimedia unit. Upon receiving the signal, the multimedia unit can return multimedia data to update the media controller display interface 160. If no return is received, basic information about the multimedia unit can be displayed, such as album, song title, artist, previous / next track, play / pause, etc. This method can meet the user's need for personalized control button displays for individual multimedia units.

[0056] For example, the relevant code for configuring the media controller display interface 160 can be as follows:

[0057] data class MediaInfoBean(

[0058] / / mediaTag

[0059] val mediaTag:String="mediaTag",

[0060] / / null indicates the button is not displayed, -1 indicates it is not clickable, 0 indicates it is not favorited, 1 indicates it is favorited. val isCollect:Int? = null,

[0061] / / null hides this button, -1 indicates it's not clickable, 0 plays sequentially, 1 loops through playlists, 2 plays in random mode, 3 loops through single tracks

[0062] val isMode:Int? = null,

[0063] / / null indicates the button is not displayed, -1 indicates it is not clickable, and all other values ​​except 0 indicate speed multiplication.

[0064] val isSpeed:Float? = null

[0065] / / null indicates the button is not displayed, -1 indicates it is not clickable, lyrics information

[0066] val isLyrics:String? =null,

[0067] / / null indicates the button is not displayed, -1 indicates it is not clickable, playlist information

[0068] val isSongList:String? =null,

[0069] / / null indicates this button is not displayed, -1 indicates it is not clickable, FM station search

[0070] val isSearch:Int? = null,

[0071] / / Whether to display the style of the media controller inside the module; pass the media controller route if necessary, otherwise null.

[0072] val showModulePlayer:String? =null,

[0073] / / Metadata, retrieved during the init state to ensure data consistency; updated from metadataChange during non-init states.

[0074] var metadata:MediaMetadataCompat? =null,

[0075] / / Initial state, obtained during the init state to ensure data consistency; information is updated from PlaybackStateChange during non-init states.

[0076] var playbackState:PlaybackStateCompat? =null,

[0077] / / Progress bar: null hides, -1 indicates non-draggable, 0 indicates normal draggability. var seekbarStatus:Int? = 0,

[0078] / / Previous track: null is not displayed, -1 is displayed as unclickable, 0 is displayed normally.

[0079] var isLast:Int? = 0,

[0080] / / Next track: null (does not display), -1 (displays unclickable), 0 (displays normally)

[0081] var isNext:Int? = 0,

[0082] / / Listening indicator: null is not displayed, -1 indicates that the function is not clickable, 0 displays normally.

[0083] var isListenBack:Int? =null

[0084] ):Serializable

[0085] As an example, multimedia unit access can be implemented through a private interface configuration. For instance, this private interface can be configured to respond to certain events, and if no response is received within a predetermined event period, the event can be filtered.

[0086] For example, the private interface can be configured to respond to at least one of the following personalized commands: search command, default interface display command for multimedia units, playlist display command, playback mode switching command, playback speed increase command, playback speed decrease command, search hot word display command, search suggestion display command, default search word display command, favorites command, media channel search command, and media frequency switching command. The code corresponding to the above commands can be as follows:

[0087] const val ACTION_INIT_INFO = "action_init_info" / / Send the initial configuration of the media controller;

[0088] const val ACTION_MUSIC_LIST = "action_music_list" / / Media controller: Displays the playlist;

[0089] const val ACTION_MODE_CHANGE = "action_mode_change" / / Media controller: Switches playback mode;

[0090] const val ACTION_INCREASE_PLAYBACK_SPEED = "action_increase_playback_speed" / / Media controller: Increase playback speed;

[0091] const val ACTION_DECREASE_PLAYBACK_SPEED = "action_decrease_playback_speed" / / Media controller: Reduces playback speed;

[0092] const val ACTION_SEARCH = "action_search" / / Start the search;

[0093] const val ACTION_SEARCH_RESULT="action_search_result" / / Search;

[0094] const val ACTION_SEARCH_GET_HINT_KEY = "action_search_get_hint_key" / / Get the default search term;

[0095] const val ACTION_SEARCH_GET_HOT_KEY = "action_search_get_hot_key" / / Get hot search terms;

[0096] const val ACTION_SEARCH_GET_INPUT_KEY = "action_search_get_input_key" / / Get search suggestions;

[0097] const val ACTION_COLLECT = "action_collect" / / Collection;

[0098] const val ACTION_FM_CHANGE = "action_fm_change" / / FM media frequency switching;

[0099] const val ACTION_FM_SEARCH = "action_fm_search" / / FM media search station;

[0100] const val ACTION_SEND_ACTIVE_SESSION_TAG="action_send_active_session_tag" / / Customized solution, active corresponds to tag.

[0101] For example, a client might require a unified search page to be added to the media page. The media controller display interface 160 or the multimedia unit information display interface 150 can be configured with a search box. After a user triggers a search on the media page, the search page needs to be displayed to meet the requirements, and it also needs to support personalized displays. For example, when a search is triggered from a music application, a list of popular searches and daily recommendations should be displayed on the search page; when a search is triggered from an audiobook application, a list of the top 10 audiobook programs should be displayed. This requirement can be met by adding a custom private interface function to the fusion control module. For instance, when the multimedia unit is displayed, a private interface is registered and search display information is passed to the fusion control module 110. When a user triggers a search, the corresponding information will be displayed on the search page based on the media tag. After the user clicks on a search keyword, the private interface will be called back to the multimedia unit for updating the multimedia unit information display interface 150.

[0102] It should be understood that, without departing from the teachings of this application, other personalized instructions may be set according to user needs, and this application does not impose any restrictions on this.

[0103] To facilitate understanding, the following example illustrates the interaction process between the inside and outside of the in-vehicle multimedia system.

[0104] Figure 4 These are interactive schematic diagrams of an in-vehicle multimedia system according to some embodiments of this application. For example... Figure 4 As shown, the interaction process may include:

[0105] S31, enter the vehicle multimedia system and notify the fusion control module 110 to initialize relevant configurations.

[0106] S32, the fusion control module 110 is initialized. The initialization process of the fusion control module 110 can be referred to the relevant description above, and is not limited here.

[0107] S33, the fusion control module 110 loads the default media controller into the media controller display interface 160. The default media controller can be a media controller of a pre-specified multimedia unit or a pre-designed media controller.

[0108] S34, the fusion control module 110 loads the default media data into the multimedia unit information display interface 150. The default media data can be media data from a pre-specified multimedia unit, or some pre-set media data. It is understood that in some implementation methods…

[0109] S35, in response to detecting user behavior (e.g., playing multimedia unit), the multimedia unit 120 is activated. The multimedia unit can be a local multimedia unit in the smart cockpit or a third-party multimedia unit; no limitation is made here.

[0110] S36, the multimedia unit 120 registers media information with the vehicle infotainment system 140. The registered media information may include a session token and media tag information.

[0111] S37, the fusion control module 110 detects a change in the running session and obtains active media information.

[0112] S38, the vehicle infotainment system 140 returns active media information. The active media information mentioned in steps S37 and S38 can be the media information of the multimedia unit corresponding to the running session in the Active Sessions Changed list.

[0113] S39, the fusion control module 110 determines and acquires the unified media controller. The method for determining the unified media controller is described above and will not be repeated here.

[0114] S40, the fusion control module 110 transmits the interface information to the vehicle infotainment system 140. For example, the fusion control module 110 transmits the detected interface information to the vehicle infotainment system 140 so that the fusion control module 110 determines the media service data that needs to be transmitted to the multimedia unit.

[0115] S41, the vehicle system 140 can transmit media service data to the multimedia unit 120. For example, the media service data can be control commands, such as a media data acquisition command from the multimedia unit 120, or other data, which is not limited here.

[0116] S42, multimedia unit 120 returns relevant data. For example, the relevant data may be media data that the multimedia unit responds to media service data feedback.

[0117] S43, the vehicle infotainment system 140 transmits relevant data to the fusion control module 110.

[0118] S44, the fusion control module 110 loads the unified media controller into the media controller display interface 160.

[0119] S45, the fusion control module 110 loads the music card into the media controller display interface 160.

[0120] S46, the fusion control module 110 loads media data into the multimedia unit information display interface 150.

[0121] According to some embodiments of this application, the multimedia units of the entire vehicle infotainment system can be uniformly controlled through the fusion control module. There is no coupling between the multimedia units and the fusion control module. The unified media controller exposed by the fusion control module can control the currently running or the first multimedia unit corresponding to a specified media tag, performing functions such as previous / next track, progress jump, favorites, play / pause, switching playback modes, speed adjustment, and lyrics display. Customized UI displays for control buttons are also possible. Through these methods, the user's need for a fusion of multiple multimedia units on the vehicle infotainment page can be met, as well as the user's need for personalized control button displays for individual multimedia units can also be satisfied.

[0122] In addition, in some implementations, a custom private interface function can be added to the fusion control module to handle event control other than media control, and the media controller of the media controller display interface 160 or the media controller built into the multimedia unit can be switched according to user needs, without needing to pay extra attention to the status display and control of the integrated multimedia units.

[0123] It should be noted that the acquisition, storage, and application of user personal information involved in the technical solution of this application all comply with relevant laws and regulations and do not violate public order and good morals. It should also be noted that the information acquired in this embodiment is obtained only after authorization from the user (i.e., with the user's consent). Furthermore, the acquired information / data is not intended to characterize a specific type of user and therefore cannot reflect the personal information of a specific type of user.

[0124] The steps of the various methods described above are only for clarity. In practice, they can be combined into one step or some steps can be split into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but without changing the core design of the algorithm and process, are also within the scope of protection of this patent.

[0125] Embodiments of this application also provide an electronic device, such as... Figure 5As shown, the electronic device 500 may include: at least one processor and a memory, the memory being communicatively connected to the at least one processor and storing instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform the control method 200 of the aforementioned in-vehicle multimedia system. For example, the electronic device may be a vehicle infotainment system or other media control device within a smart cockpit, without limitation herein.

[0126] One embodiment of this application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements a control method 200 for an in-vehicle multimedia system.

[0127] Figure 5 This is a schematic block diagram of an electronic device 500 according to some embodiments of this application. For example... Figure 5 As shown, the electronic device 500 includes a processor 501, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 502 or a computer program loaded from a memory 508 into a random access memory (RAM) 503. The RAM 503 may also store various programs and data required for the operation of the electronic device 500. The processor 501, ROM 502, and RAM 503 are interconnected via a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504.

[0128] Multiple components in electronic device 500 are connected to I / O interface 505, including: input unit 506, such as buttons or touchscreens in a vehicle infotainment system; output unit 507, connected to various types of displays, speakers, etc., to output various forms of signals; memory 508, including any medium for storing computer-executable programs; and communication unit 509, such as a network interface card (NIC), modem, or wireless transceiver. Communication unit 509 allows electronic device 500 to exchange information / data with other devices via a local area network (LAN) or other wireless communication networks.

[0129] Processor 501 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processor 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Processor 501 performs the various methods and processes described above, such as the control method 200 of an in-vehicle multimedia system. For example, in some embodiments, the control method 200 of an in-vehicle multimedia system may be implemented as a computer software program tangibly contained in a computer-readable storage medium, such as memory 508. In some embodiments, part or all of the computer program may be loaded and / or installed on electronic device 500 via ROM 502 and / or communication unit 509. When the computer program is loaded into RAM 503 and executed by processor 501, one or more steps of the control method 200 of the in-vehicle multimedia system described above may be performed. Alternatively, in other embodiments, the processor 501 may be configured to perform the control method 200 of the in-vehicle multimedia system by any other suitable means (e.g., by means of firmware).

[0130] Various aspects of this application have been described herein with reference to flowchart illustrations and / or timing diagrams of methods, apparatus (systems), and computer program products according to exemplary embodiments of this application. It should be understood that each step of the flowchart illustrations and / or timing diagrams, as well as combinations of steps in the flowchart illustrations and / or timing diagrams, can be implemented by computer-readable program instructions.

[0131] These computer-readable program instructions can be provided to a processor, general-purpose computer, special-purpose computer, or other programmable data processing unit in an electronic device to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing device, they create means for implementing the functions / steps specified in one or more steps of a flowchart and / or timing diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing device, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / steps specified in one or more steps of a flowchart and / or timing diagram.

[0132] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / steps specified in one or more steps of a flowchart and / or timing diagram.

[0133] The flowcharts and timing diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of devices, methods, and computer program products according to various embodiments of this application. In this regard, each step in a flowchart or timing diagram may represent a module, segment, or part of an instruction that contains one or more executable instructions for implementing a specified logical function. In some alternative embodiments, the functions indicated in the steps may occur in a different order than those indicated in the drawings. For example, two consecutive steps may actually be performed substantially in parallel, and they may sometimes be performed in reverse order, depending on the functions involved. It should also be noted that each step in a timing diagram and / or flowchart, and combinations of steps in timing diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0134] The above description is merely an illustration of the embodiments of this application and the technical principles employed. Those skilled in the art should understand that the scope of protection involved in this application is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the technical concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this application.

Claims

1. A control method of an in-vehicle multimedia system, characterized by, The vehicle-mounted multimedia system comprises a plurality of multimedia units and a plurality of media controllers corresponding to the multimedia units respectively, and the control method comprises: determining a media controller information database according to a listening result of a running session of the vehicle machine system, the media controller information database comprising media controller information of the multimedia units corresponding to the running session and a session token; and in response to receiving a control instruction, determining a session token of a first multimedia unit corresponding to a unified media controller according to the media controller information database, so as to invoke the first multimedia unit to respond to the control instruction through the session token, wherein the unified media controller is a media controller corresponding to the first multimedia unit, and the first multimedia unit is a multimedia unit that is running or a multimedia unit corresponding to received media tag information; wherein the vehicle-mounted multimedia system further comprises a media controller display interface, and the method further comprises: in response to receiving a first registration request sent by the media controller display interface, establishing a current running media controller callback function; and feeding back media data of the first multimedia unit to the media controller display interface through the current running media controller callback function.

2. The method of claim 1, wherein, The determining of the media controller information database according to the listening result of the running session of the vehicle machine system comprises: in response to the listening result indicating that the running session has changed, updating the media controller information database according to the changed running session, so that the media controller information database comprises media controller information of the multimedia units corresponding to the changed running session and a session token of the changed running session.

3. The method of claim 2, wherein, The media controller information database comprises a media controller information set and session token information, the media controller information set storing key-value pairs about media controllers of the multimedia units and session tokens of the multimedia units, and the session token information comprising session tokens of the multimedia units; The updating of the media controller information database according to the changed running session comprises: obtaining session token data corresponding to the changed running session; updating the media controller information set according to the session token data and the session token information, the updating comprising: deleting session tokens in the session token information that match the session token data to obtain screening data; deleting key-value pairs in the media controller information set that match the screening data; and determining a key-value pair to be added according to a session token in the session token data that does not match successfully with the session token information, and adding the key-value pair to be added in the media controller information set; and updating the session token information according to the updated media controller information set.

4. The method of claim 3, wherein, The method further comprises: registering a media controller callback function for a media controller corresponding to a session token that does not match successfully; or deregistering a media controller callback function of a media controller of a multimedia unit corresponding to a session token in the screening data.

5. The method of claim 1, wherein, The method further comprises: register a media controller callback function of a media controller corresponding to the multimedia unit; determine a current state of the multimedia unit according to callback information of the media controller callback function; and determine the first multimedia unit according to the current state of the multimedia unit.

6. The method of claim 1, wherein, The vehicle-mounted multimedia system further comprises a multimedia unit information display interface, a media controller display interface and a private interface, and the method further comprises: in response to receiving a second registration request of the private interface, establish registration player information; in response to receiving a personalized instruction corresponding to the private interface, obtain personalized feedback information according to the personalized instruction; and call back the personalized feedback information to the multimedia unit information display interface or the media controller display interface based on the registration player information.

7. The method of claim 6, wherein, The method further comprises: access the private interface by a page routing configuration mode to obtain the personalized feedback information.

8. The method of claim 6, wherein, The personalized instruction comprises at least one of the following: a search instruction, a default interface display instruction of the multimedia unit, a display playlist instruction, a switch play mode instruction, an increase play speed instruction, a decrease play speed instruction, a search hot word display instruction, a search association word display instruction, a search default display word display instruction, a collection instruction, a media search station instruction and a media frequency switch instruction.

9. An electronic device, comprising: comprise: at least one processor; and a memory connected to the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the control method of the vehicle-mounted multimedia system as claimed in any one of claims 1 to 8.

10. A computer readable storage medium storing a computer program, characterized in that, The computer program is executed by the processor to implement the control method of the vehicle-mounted multimedia system as claimed in any one of claims 1 to 8. The computer program is executed by the processor to implement the control method of the vehicle-mounted multimedia system as claimed in any one of claims 1 to 8.

Images