A method, system, and smart cockpit for expanding multimedia information in vehicle terminals

Abstract

This application discloses a method, system, electronic device, storage medium, and smart cockpit for expanding multimedia information on an in-vehicle terminal. The method includes acquiring audio and video data currently displayed on the in-vehicle terminal; encoding the audio and video data; packaging the encoded audio and video data and adding a shared timestamp; encapsulating the packaged audio and video data into multiple data streams; and distributing the data streams to the user terminal in response to a user terminal's on-demand request. This method enables synchronized audio and video display across multiple users and devices, meeting the needs of multiple users watching the same video simultaneously in multiple scenarios.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and in particular to a method, system, electronic device, storage medium, and smart cockpit for expanding multimedia information in an in-vehicle terminal. Background Technology

[0002] With societal development, automobiles are evolving beyond basic transportation needs, focusing on entertainment, comfort, and connectivity. However, due to hardware limitations, in-vehicle screens and audio systems are largely fixed, forcing customers to use them according to the vehicle's design when watching audio and video content, failing to meet the personalized needs of a wide range of customers. Furthermore, for a better entertainment experience, multiple users in different scenarios sometimes need to watch the same in-vehicle video together, sharing the enjoyment. Existing in-vehicle audio and video solutions struggle to meet this demand.

[0003] Therefore, how to expand the multimedia information of the vehicle terminal, realize the synchronous display of audio and video for multiple users and multiple devices, and meet the needs of multiple users watching the same video together in multiple scenarios is a technical problem that needs to be solved by those skilled in the art. Summary of the Invention

[0004] To address the technical problem that existing vehicle terminals cannot meet the needs of users for synchronized audio and video display across multiple devices and simultaneous viewing of the same video by multiple users in multiple scenarios, this invention provides a method, system, electronic device, storage medium, and smart cockpit for expanding multimedia information in vehicle terminals.

[0005] To achieve the objective of this invention, a method for expanding multimedia information on a vehicle-mounted terminal is provided, comprising:

[0006] Obtain the audio and video data currently displayed on the in-vehicle terminal;

[0007] The audio and video data are encoded separately;

[0008] The encoded audio and video data are packaged and processed, and a same-origin timestamp is added;

[0009] The packaged audio and video data is encapsulated into multiple data streams;

[0010] In response to a user terminal's on-demand request, the data stream is distributed to the user terminal.

[0011] In some specific embodiments, the audio and video data currently displayed by the in-vehicle terminal are acquired, specifically including:

[0012] The video and audio data currently displayed on the vehicle terminal are copied separately, and the copied video and audio data are extracted separately.

[0013] In some specific embodiments, the audio and video data are encoded, specifically including:

[0014] The video data is sent to the video encoder for encoding;

[0015] The audio data is mixed and then sent to the audio encoder for encoding.

[0016] In some specific embodiments, in response to a user terminal's on-demand request, the data stream is distributed to the user terminal, specifically including:

[0017] Responding to whether to grant or deny the user's on-demand request;

[0018] When a user terminal's on-demand request is approved, the data stream is distributed to the user terminal.

[0019] When the user terminal's on-demand request is not approved, the data stream will not be distributed to the user terminal.

[0020] Based on the same concept, the present invention also provides a method for receiving audio and video data via a mobile terminal, the method being used for the above-mentioned method for extending multimedia information on an in-vehicle terminal, the method comprising:

[0021] Receive data stream;

[0022] Unpack the audio and video data packaged in the data stream and decode the encoded audio and video data;

[0023] Synchronous processing is performed on the unpacked and decoded audio and video data;

[0024] The synchronized audio and video data will be displayed.

[0025] In some specific embodiments, before receiving the data stream, the method further includes:

[0026] Bind to the vehicle-mounted terminal;

[0027] On-demand content is delivered to the vehicle terminal via a video-on-demand protocol.

[0028] Based on the same concept, the present invention also provides an extension system for multimedia information of an in-vehicle terminal, comprising:

[0029] The multimedia information acquisition module is used to acquire the audio and video data currently displayed on the vehicle terminal.

[0030] The audio and video data encoding module is used to encode audio and video data separately.

[0031] The audio and video data packaging module is used to package and process encoded audio and video data and add a same-origin timestamp.

[0032] The audio and video data encapsulation module is used to encapsulate the packaged audio and video data into multiple data streams;

[0033] The data stream distribution module is used to distribute the data stream to the user terminal in response to the user terminal's on-demand request.

[0034] Based on the same concept, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the above-described method for expanding multimedia information of a vehicle terminal.

[0035] Based on the same concept, the present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the above-described method for extending multimedia information in a vehicle terminal.

[0036] Based on the same concept, the present invention also provides an intelligent cockpit, wherein the intelligent cockpit is equipped with an extended system for in-vehicle terminal multimedia information as described above.

[0037] Compared with the prior art, the present invention has the following beneficial effects:

[0038] This invention discloses a method, system, electronic device, storage medium, and smart cockpit for expanding multimedia information on an in-vehicle terminal. The method includes: acquiring audio and video data currently displayed on the in-vehicle terminal; encoding the audio and video data; packaging the encoded audio and video data and adding a shared timestamp; encapsulating the packaged audio and video data into multiple data streams; and distributing the data streams to the user terminal in response to a user's on-demand request. This method enables synchronized audio and video display across multiple users and devices, meeting the needs of multiple users watching the same video simultaneously in multiple scenarios. Attached Figure Description

[0039] Figure 1 This is a structural schematic diagram of some specific embodiments of the method for extending multimedia information in a vehicle terminal according to the present invention;

[0040] Figure 2 This is a flowchart of a method for extending multimedia information in a vehicle terminal according to the present invention in some applications;

[0041] Figure 3 yes Figure 2 A schematic diagram illustrating the effect of a method for expanding multimedia information in a vehicle-mounted terminal;

[0042] Figure 4This is a flowchart of a method for receiving audio and video data via a mobile terminal in some applications of the present invention;

[0043] Figure 5 This is a schematic diagram of the structure of a vehicle-mounted terminal multimedia information extension system in some specific embodiments of the present invention;

[0044] Figure 6 This is a schematic diagram of the structure of an electronic device according to some specific embodiments of the present invention. Detailed Implementation

[0045] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0046] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “said,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.

[0047] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0048] It should be understood that although the terms first, second, third, etc., may be used in the embodiments of this application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, first may also be referred to as second without departing from the scope of the embodiments of this application, and similarly, second may also be referred to as first.

[0049] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0050] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or device. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or device that includes said element.

[0051] It should be noted that any symbols and / or numbers present in the specification that are not marked in the accompanying drawings are not reference numerals.

[0052] Reference Figure 1 , Figure 2 and Figure 3 A method for extending multimedia information on a vehicle-mounted terminal, comprising:

[0053] S101, respectively acquire the audio and video data currently displayed on the vehicle terminal;

[0054] Specifically, this step first obtains the audio and video data currently displayed on the in-vehicle terminal;

[0055] In some of these applications, the video and audio data currently displayed on the vehicle terminal are copied, and the copied video and audio data are extracted.

[0056] S102, encode the audio and video data respectively;

[0057] In some of these applications, video data is sent to a video encoder for encoding; audio data is mixed and then sent to an audio encoder for encoding.

[0058] Understandably, mixing the audio data beforehand can prevent audio data loss.

[0059] S103, Packages and processes the encoded audio and video data, and adds a same-origin timestamp;

[0060] In some applications, the encoded audio and video data are packaged using RTP and a same-origin timestamp is added to ensure audio and video synchronization.

[0061] S104 encapsulates the packaged audio and video data into multiple data streams;

[0062] In some of these applications, the processed audio and video data is encapsulated into multiple IP streams.

[0063] S105, in response to a user terminal's on-demand request, distributes the data stream to the user terminal.

[0064] In some of these applications, the data stream is distributed to the user terminal in response to whether the user terminal's on-demand request is approved; if the user terminal's on-demand request is approved, the data stream is not distributed to the user terminal.

[0065] Understandably, the above steps enable synchronized audio and video display across multiple users and devices, meeting the needs of multiple users watching the same video together in multiple scenarios.

[0066] like Figure 4 As shown, the present invention also provides a method for receiving audio and video data through a mobile terminal, the method being used in the above-mentioned method for extending multimedia information of an in-vehicle terminal, the method comprising:

[0067] Receive data stream;

[0068] Unpack the audio and video data packaged in the data stream and decode the encoded audio and video data;

[0069] Synchronous processing is performed on the unpacked and decoded audio and video data;

[0070] The synchronized audio and video data will be displayed.

[0071] In some of these applications, when a mobile device is used as an extended screen, the application is opened and requests permission from the vehicle's infotainment system to synchronize screen video and audio. Once the infotainment system agrees, it sends the encapsulated IP stream to the portable device, which then decodes and displays the video and audio, and performs other operations such as audio-visual synchronization.

[0072] In some specific embodiments of the present invention, in order to facilitate users' on-demand playback, the method further includes the following before receiving the data stream:

[0073] Bind to the vehicle-mounted terminal;

[0074] On-demand content is delivered to the vehicle terminal via a video-on-demand protocol.

[0075] In some of these applications, mobile terminals are bound to in-vehicle terminals, and on-demand content is delivered to the in-vehicle terminals via the Real-Time Streaming Protocol (RTSP).

[0076] The following describes embodiments of the method for expanding multimedia information in a vehicle terminal according to the present invention in some applications:

[0077] 1. The vehicle screen display system copies the video to be displayed on the screen. The original video is used for display on the vehicle screen, and the copied auxiliary stream video is sent to a dedicated hardware encoder for compression encoding in formats such as H.265.

[0078] 2. The vehicle audio control system copies the sound played by the amplifier, mixes the copied multi-channel audio, and compresses and encodes it in formats such as MP3.

[0079] 3. Pack the encoded audio and video data into RTP packets and add a same-origin timestamp to ensure audio and video synchronization. Finally, encapsulate the processed audio and video streams into multiple IP streams.

[0080] 4. The control protocol uses RTSP (Real Time Streaming Protocol). The dedicated application on the portable device needs to be bound to the vehicle's infotainment system. When the portable device is used as an extended screen, the application is opened and requests the vehicle's infotainment system to synchronize screen video and audio permissions. Once the vehicle's infotainment system agrees, it will send the encapsulated IP stream to the portable device. The portable device will then decode and display the video, synchronize the audio and video, and perform other operations to achieve low-latency, high-resolution audio and video playback, thus realizing car-centric audio and video sharing.

[0081] For the purpose of simplicity, the method steps disclosed in the above embodiments are described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0082] Any flowchart or other description of a process or method can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process. Furthermore, the scope of preferred embodiments of the invention includes additional implementations in which functions may be performed and implemented not in the order shown or discussed, including substantially simultaneously or in reverse order according to the functions involved, or by executing computer instructions and implementing corresponding functions according to program structures such as loops, branches, etc., as will naturally be understood by those skilled in the art when practicing embodiments of the invention.

[0083] like Figure 5 As shown, the present invention also provides an extension system for multimedia information on a vehicle-mounted terminal, comprising:

[0084] The multimedia information acquisition module 201 is used to acquire the audio and video data currently displayed on the vehicle terminal.

[0085] The audio and video data encoding module 202 is used to encode the audio and video data respectively;

[0086] The audio and video data packaging module 203 is used to package and process the encoded audio and video data and add a same-origin timestamp.

[0087] The audio and video data encapsulation module 204 is used to encapsulate the packaged audio and video data into multiple data streams.

[0088] The data stream distribution module 205 is used to distribute the data stream to the user terminal in response to the user terminal's on-demand request.

[0089] Specifically, the extended system for multimedia information of the vehicle terminal provided in this embodiment includes a multimedia information acquisition module 201, an audio and video data encoding module 202, an audio and video data packaging module 203, an audio and video data encapsulation module 204, and a data stream distribution module 205. The multimedia information acquisition module 201 is used to acquire the audio and video data currently displayed by the vehicle terminal; the audio and video data encoding module 202 is used to encode the audio and video data; the audio and video data packaging module 203 is used to package the encoded audio and video data and add a common-source timestamp; the audio and video data encapsulation module 204 is used to encapsulate the packaged audio and video data into multiple data streams; and the data stream distribution module 205 is used to distribute the data stream to the user terminal in response to the user terminal's on-demand request.

[0090] It is worth noting that although only some basic functional modules are disclosed in the embodiments of this invention, it does not mean that the composition of this system is limited to the above-mentioned basic functional modules. On the contrary, what this embodiment intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. The fact that this embodiment only discloses a few basic functional modules should not be considered as the scope of protection of the claims of this invention being limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above device is described separately according to its functions as various units and modules. Of course, in implementing this invention, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0091] The implementation methods of the system described above are merely illustrative. For example, the various functional modules, units, or subsystems within the system may or may not be physically separate, or they may or may not be physical units; that is, they may be located in the same place or distributed across multiple different systems and their subsystems or modules. Those skilled in the art can select some or all of the functional modules, units, or subsystems to achieve the objectives of the embodiments of the present invention according to actual needs. Those skilled in the art can understand and implement the above-described situations without any creative effort.

[0092] like Figure 6 As shown, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the above-described method for expanding multimedia information of a vehicle terminal.

[0093] Specifically, Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Figure 6 A block diagram is shown that is suitable for implementing embodiments of the present invention. Figure 6 The electronic device shown is merely an example and should not be construed as limiting the functionality or scope of the embodiments of the present invention. Figure 6As shown, electronic device 500 is represented in the form of a general-purpose computing device. Components of electronic device 500 may include, but are not limited to: one or more processing units or processors 516, memory 528, and a bus 518 connecting different system components (including memory 528 and processor 516). Bus 518 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus. Electronic device 500 typically includes various computer system readable media. These media can be any available media that can be accessed by electronic device 500, including volatile and non-volatile media, removable and non-removable media. Memory 528 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 530 and / or cache memory 532. Electronic device 500 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 534 may be used for reading and writing non-removable, non-volatile magnetic media (not shown, commonly referred to as a "hard disk drive"). Although not shown in the figures, storage system 534 may provide a disk drive for reading and writing to removable non-volatile disks (e.g., floppy disks, portable hard drives, hot-swappable storage media) and an optical disk drive for reading and writing to removable non-volatile optical discs (e.g., CD-ROMs, DVD-ROMs, or other optical media). In these cases, each drive may be connected to bus 518 via one or more data media interfaces. Memory 528 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention. A program / utility 540 having a set (at least one) of program modules 542 may be stored, for example, in memory 528. Such program modules 542 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 542 typically perform the functions and / or methods described in the embodiments of the present invention. Electronic device 500 may also communicate with one or more external devices 514 (e.g., keyboard, pointing device, display 524, etc.), and with one or more devices that enable a user to interact with the electronic device 500, and / or with any device that enables the electronic device 500 to communicate with one or more other computing devices (e.g., network interface card, modem, etc.).This communication can be performed via input / output (I / O) interface 522. Furthermore, electronic device 500 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 520. Figure 6 As shown, network adapter 520 communicates with other modules of electronic device 500 via bus 518. It should be understood that, although not shown in the figures, those skilled in the art can use other hardware and / or software modules in conjunction with electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems. Processor 516 executes various functional applications and data processing by running programs stored in memory 528, such as implementing the methods provided in any one or more embodiments of the present invention.

[0094] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of a method for extending multimedia information of an in-vehicle terminal.

[0095] Specifically, the computer storage medium in this embodiment of the invention can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0096] The present invention also provides an intelligent cockpit equipped with an extended system for in-vehicle terminal multimedia information as described above.

[0097] Specifically, the intelligent cockpit is equipped with an extended system for in-vehicle terminal multimedia information. Regarding the intelligent cockpit: Human-vehicle interaction is the core of user experience. The fragmented layout and information overload of traditional car cockpit functional areas create obstacles to human-vehicle interaction, leading to an underestimation of the value of the car itself as an interaction entry point. However, as electronic information technology begins to shift into the vehicle, the intelligent cockpit has emerged. The intelligent cockpit can meet the different needs of different people in the car through various intelligent means, bringing a more intelligent and safer interactive experience. It is also a key interface for technologies such as advanced driver assistance systems, autonomous driving, and artificial intelligence.

[0098] By applying the above technical solutions, a method, system, electronic device, storage medium, and smart cockpit for expanding multimedia information on an in-vehicle terminal are provided. The method includes: acquiring audio and video data currently displayed on the in-vehicle terminal; encoding the audio and video data; packaging the encoded audio and video data and adding a shared timestamp; encapsulating the packaged audio and video data into multiple data streams; and distributing the data streams to the user terminal in response to a user's on-demand request. This method enables synchronized audio and video display across multiple users and devices, meeting the needs of multiple users watching the same video simultaneously in multiple scenarios.

[0099] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0100] Furthermore, those skilled in the art will understand that although some embodiments described herein include certain features but not others included in other embodiments, combinations of features from different embodiments are intended to be within the scope of the invention and form different embodiments. For example, any of the embodiments claimed in the claims can be used in any combination of embodiments of the invention.

[0101] In the description of this specification, references to terms such as "an embodiment," "example," "specific example," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0102] Furthermore, the technical solutions of the various embodiments of the present invention can be combined with each other, but only if they are feasible for those skilled in the art. If the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such combination of technical solutions does not exist and is not within the scope of protection claimed by the present invention.

[0103] All features disclosed in this specification, or steps in all disclosed methods or processes, may be combined in any way, except for mutually exclusive features and / or steps. Any feature disclosed in this specification, unless specifically stated otherwise, may be replaced by other equivalent or similar features. That is, unless specifically stated otherwise, each feature is merely one example of a series of equivalent or similar features. Throughout this specification, the same reference numerals indicate the same elements.

[0104] Those skilled in the art will understand that modules in the device of the embodiments can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiments can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components. Except where at least some of such features and / or processes or units are mutually exclusive, any combination can be used to combine all features disclosed in this specification (including the corresponding claims, abstract, and drawings) and all processes or units of any method or device so disclosed. Unless expressly stated otherwise, each feature disclosed in this specification (including the corresponding claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0105] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for expanding multimedia information in a vehicle-mounted terminal, characterized in that, include: The audio and video data currently displayed on the vehicle terminal are obtained separately, specifically including: copying the video data and audio data currently displayed on the vehicle terminal, and extracting the copied video data and audio data respectively; The audio and video data are encoded separately, specifically including: sending the video data to the video encoder for encoding, and mixing the audio data before sending it to the audio encoder for encoding; The encoded audio and video data are packaged and processed, and a same-origin timestamp is added; The packaged audio and video data is encapsulated into multiple data streams; In response to the user terminal's request for on-demand playback, the data stream is distributed to the user terminal.

2. The method for expanding multimedia information in a vehicle terminal according to claim 1, characterized in that, In response to a user terminal's on-demand request, the data stream is distributed to the user terminal, specifically including: When the user terminal's on-demand request is not approved, the data stream will not be distributed to the user terminal.

3. A method for receiving audio and video data via a mobile terminal, characterized in that, The method is used for the method of expanding multimedia information of a vehicle terminal as described in claim 1, and the method includes: Receive data stream; Unpack the audio and video data packaged in the data stream and decode the encoded audio and video data; Synchronous processing is performed on the unpacked and decoded audio and video data; The synchronized audio and video data will be displayed.

4. The method for receiving audio and video data via a mobile terminal according to claim 3, characterized in that, Before receiving the data stream, the method further includes: Bind to the vehicle-mounted terminal; On-demand services are delivered to the vehicle terminal via a video-on-demand protocol.

5. A system for extending multimedia information in a vehicle-mounted terminal, characterized in that, include: The multimedia information acquisition module is used to acquire the audio and video data currently displayed on the vehicle terminal, specifically including: copying the video data and audio data currently displayed on the vehicle terminal, and extracting the copied video data and audio data. The audio and video data encoding module is used to encode audio and video data separately, specifically including: sending video data to the video encoder for encoding, and mixing audio data before sending it to the audio encoder for encoding; The audio and video data packaging module is used to package and process encoded audio and video data and add a same-origin timestamp. The audio and video data encapsulation module is used to encapsulate the packaged audio and video data into multiple data streams; The data stream distribution module is used to distribute the data stream to the user terminal in response to the user terminal's on-demand request.

6. An electronic device, characterized in that, include: The system includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1 to 2.

7. A computer-readable storage medium, characterized in that, It stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the method according to any one of claims 1 to 2.

8. A smart cockpit, the smart cockpit being equipped with an extension system for in-vehicle terminal multimedia information as described in claim 5.

Images