Multimedia loading method and apparatus, electronic device and storage medium

Abstract

The present application discloses a multimedia loading method and apparatus, an electronic device, and a storage medium. The method comprises: before a file is played, segmenting the file to be played to obtain a plurality of multimedia file segments; when one multimedia file segment is being played, calculating a file segment download point at which the next multimedia file segment needs to be downloaded; and when the file segment download point is reached, downloading the next multimedia file segment. In the multimedia loading method and apparatus, the electronic device, and the storage medium provided in the present application, a loading scheme is optimized by means of an intelligent algorithm, and resources are loaded in advance on the basis of the network state of an in-vehicle infotainment system and user behavior prediction, thereby reducing waiting time, and improving loading efficiency and user experience; by using a segment-based download strategy, only actually required audio segments are downloaded, thereby avoiding data waste caused by downloading the entire file; audio loading in a vehicle-mounted system is more efficient, and a user can quickly start playback of audio content, thereby reducing loading waiting time and improving user satisfaction.

Description

Multimedia loading methods, devices, electronic equipment, and storage media Technical Field

[0001] This application relates to the field of multimedia technology, and in particular to multimedia loading methods, multimedia loading devices, electronic devices, and storage media. Background Technology

[0002] Currently, it is quite common for people to use in-vehicle infotainment systems to listen to music and watch videos while riding in a vehicle.

[0003] Compared to mobile phones, data plans for in-vehicle systems are more expensive. Traditional solutions that download audio and video data in bulk also result in significant data waste.

[0004] For example, a user sees a piece of music online, finds it interesting, and chooses to play it. However, after playing only a short part, the user realizes the intro isn't what they wanted and switches to another song. In this case, after the user selects to play, the car's infotainment system downloads the entire song from the internet. What the user actually hears is only the intro of the downloaded song.

[0005] Chinese invention patent application CN102088696A discloses a method for downloading large files in segments. However, this patent application targets large files of any format and does not specifically address the technical solutions for multimedia files. Summary of the Invention

[0006] The purpose of this invention is to provide a multimedia loading method, apparatus, electronic device, and storage medium that can solve the problems of high data charges and network transmission speed limitations of in-vehicle systems, thereby improving data transmission efficiency and user experience.

[0007] This invention provides the following solution:

[0008] According to one aspect of the present invention, a method for loading multimedia is provided, the method comprising:

[0009] Before playing the file, the file to be played is segmented into multiple multimedia file segments;

[0010] When a multimedia file segment is played, calculate the file segment download point that needs to be downloaded next;

[0011] Upon reaching the file segment download point, the next multimedia file segment is downloaded.

[0012] Optionally, file segment download points include: file segment download points expressed as time points, or file segment download points expressed as file playback positions.

[0013] Optionally, upon reaching a file segment download point, the next multimedia file segment is downloaded, including:

[0014] When the currently playing multimedia file segment reaches the file segment download point, the next multimedia file segment is downloaded.

[0015] Optionally, upon reaching a file segment download point, the next multimedia file segment is downloaded, including:

[0016] When the current time reaches the file segment download point, the next multimedia file segment will be downloaded.

[0017] Optionally, the file being played can be segmented, including:

[0018] The file being played is segmented according to a fixed time length; or

[0019] The file being played is segmented based on the dynamically adjusted duration.

[0020] Optional, also includes:

[0021] The duration of the dynamic adjustment is adjusted based on network speed, audio quality, video quality, and user habits.

[0022] Optionally, the file segment download point that needs to be downloaded for the next multimedia file segment is calculated, including:

[0023] Based on network speed, audio quality, video quality, and user habits, calculate the download points of file segments expressed in terms of time.

[0024] Optionally, the file segment download point that needs to be downloaded for the next multimedia file segment is calculated, including:

[0025] Based on network speed, audio quality, video quality, and user habits, calculate the file segment download point expressed as the file playback position.

[0026] Optional, also includes:

[0027] When the user fast-forwards, the program will jump to the playback point selected by the user.

[0028] Optionally, the triggering time for calculating the file segment download point includes: when the audio multimedia file of this segment is automatically played, or when the user fast forwards.

[0029] According to two aspects of the present invention, a multimedia loading device is provided, the multimedia loading device comprising:

[0030] The segmentation module is used to segment the file to be played into multiple multimedia file segments before playback.

[0031] The download point calculation module is used to calculate the download point of the next multimedia file segment that needs to be downloaded when a multimedia file segment is played.

[0032] The download module is used to download the next multimedia file segment when the file segment download point is reached.

[0033] According to three aspects of the present invention, an electronic device is provided, comprising: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus;

[0034] The memory stores a computer program that, when executed by the processor, causes the processor to perform the steps of the multimedia loading method.

[0035] According to four aspects of the present invention, a computer-readable storage medium is provided, comprising: storing a computer program executable by an electronic device, wherein when the computer program is run on the electronic device, the electronic device performs the steps of the multimedia loading method.

[0036] The above solution achieves the following beneficial technical effects:

[0037] By optimizing the loading scheme through intelligent algorithms, resources are preloaded based on the vehicle network status and user behavior predictions, reducing waiting time and improving loading efficiency and user experience;

[0038] A segmented download strategy is adopted, downloading only the audio segments that are actually needed, thus avoiding the waste of bandwidth caused by downloading the entire file.

[0039] The audio loading in the in-vehicle system is more efficient, allowing users to quickly start playing audio content, reducing loading waiting time and improving user satisfaction;

[0040] The preloading threshold is dynamically adjusted according to the network environment and actual situation of the vehicle's infotainment system to adapt to different network speeds and operator limitations, ensuring continuous audio playback and loading efficiency.

[0041] Intelligent algorithms can learn users' usage habits and behavior patterns, predict when users may switch, and load relevant resources in advance to further improve loading efficiency and user experience. Attached Figure Description

[0042] Figure 1 is a flowchart of a multimedia loading method provided by one or more embodiments of the present invention.

[0043] Figure 2 is a flowchart of a multimedia loading method provided by one or more embodiments of the present invention.

[0044] Figure 3 is a flowchart of a multimedia loading method provided by one or more embodiments of the present invention.

[0045] Figure 4 is a flowchart of a multimedia loading method provided by one or more embodiments of the present invention.

[0046] Figure 5 is a flowchart of a multimedia loading method provided by one or more embodiments of the present invention.

[0047] Figure 6 is a structural diagram of a multimedia loading device provided in one or more embodiments of the present invention.

[0048] Figure 7 is a structural diagram of an electronic device provided by one or more embodiments of the present invention. Detailed Implementation

[0049] The technical solution of the present invention will now be clearly and completely described with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0050] Figure 1 is a schematic flowchart of a multimedia loading method provided by one or more embodiments of the present invention. Referring to Figure 1, the multimedia loading method includes the following steps:

[0051] S11: Before playing the file, the file to be played is segmented to obtain multiple multimedia file segments.

[0052] S12, when a multimedia file segment is played, calculate the file segment download point that needs to be downloaded for the next multimedia file segment.

[0053] S13, upon reaching the file segment download point, download the next multimedia file segment.

[0054] The core idea of ​​the technical solution shown in Figure 1 lies in segmented downloading and intelligent dynamic loading.

[0055] First, the multimedia file to be played is no longer downloaded as a whole, as with current technology. Instead, the multimedia file is pre-segmented before downloading. When the user selects to play this multimedia file, the segmented multimedia file is downloaded.

[0056] The advantage of choosing segmented downloads is that it avoids a lot of unnecessary download bandwidth consumption. For example, when a user selects to play a song online, at any point during playback, the car's infotainment system only downloads a segment of the playback file, not the entire song. This means that if the user pauses, switches tracks, or performs other actions during playback, downloading segments that no longer need to be downloaded due to the change in playback strategy can be omitted, thus saving bandwidth and data usage.

[0057] Taking the example described in the background section of this application, a user selects a song and begins playback. After listening to the intro, the user realizes they selected the wrong song and pauses playback. Under a full download strategy, regardless of any user actions, the entire file selected for playback must be downloaded. However, with a segmented download strategy, only the first few segments, or even just the first segment, of the file need to be downloaded. Therefore, using a segmented download strategy can significantly save data and bandwidth when listening to or watching multimedia files.

[0058] The core idea of ​​intelligent dynamic loading is that during the file segment loading process, key parameters can be dynamically adjusted based on factors such as network environment and user habits.

[0059] Let's take an example of a change in the network environment. A user selects to play a video. Initially, the user is on a low-speed network, with an average network speed of only 1MB / s. During video playback, the user connects to a high-speed network, with the average network speed increasing to 1GB / s. In the low-speed network, video files are segmented in 10-second increments. This is because if the file segments are too long, video playback will consume excessive network bandwidth, thus affecting the network usage of other applications loaded on the vehicle's infotainment system.

[0060] Once switched to a high-speed network, there's no longer any need to use the 10-second file segment length. On a high-speed network, a 10-minute file segment length can be used. Even with a 10-minute file segment length, the download of the file being played will not affect the network usage of other applications loaded on the vehicle's infotainment system.

[0061] The above example uses only the file segment length as an example. In intelligent dynamic loading strategies, many parameters can be adjusted based on network conditions and user habits. These can include: file segment download points, cache capacity, cache fragment length, etc.

[0062] Figure 2 is a schematic flowchart of a multimedia loading method provided by one or more embodiments of the present invention. Referring to Figure 2, the multimedia loading method includes the following steps:

[0063] S21, Before playing the file, the file to be played is segmented to obtain multiple multimedia file segments.

[0064] S22, When a multimedia file segment is played, calculate the file segment download point that needs to be downloaded for the next multimedia file segment.

[0065] S23: When the currently playing multimedia file segment reaches the file segment download point, download the next multimedia file segment.

[0066] It should be understood that a file segment download point can be expressed in several different ways. First, a file segment download point can be a point in time. For example, the download of the next multimedia file segment can begin at 3:33:33 PM.

[0067] In addition, a file segment download point can also be a specific playback position within a multimedia file. For example, a video file may have a total playback time of 2 hours. The next multimedia file segment might begin downloading at 1 hour, 33 minutes, and 33 seconds into the video.

[0068] In the technical solution of this application, a file segment download point represented as a specific point in time is referred to as a file segment download point expressed as a point in time. A file segment download point represented as a specific file playback position is referred to as a file segment download point expressed as a file playback position.

[0069] Figure 2 illustrates the execution process of a segmented downloading and intelligent dynamic loading technique when the file segment download point is expressed as a file playback position. In other words, the timing of downloading the next multimedia file segment is determined by the current playback position of the file segment.

[0070] If the currently playing file segment reaches the preset file segment download point, the download of the next file segment will begin; if the currently playing file segment has not yet reached the preset file segment download point, the download of the next file segment will not begin.

[0071] Without loss of generality, file segment download points can also be expressed as time points. When a file segment download point is expressed as a time point, determining when the file segment download point has been reached requires referring to whether the current time has reached the time point.

[0072] Figure 3 is a flowchart illustrating a multimedia loading method according to one or more embodiments of the present invention. Referring to Figure 3, the multimedia loading method includes the following steps:

[0073] S31, Before playing the file, the file to be played is segmented according to the dynamically adjusted time length to obtain multiple multimedia file segments.

[0074] S32, when a multimedia file segment is played, calculate the file segment download point that needs to be downloaded for the next multimedia file segment.

[0075] S33, upon reaching the file segment download point, download the next multimedia file segment.

[0076] It should be understood that in the technical solutions provided in this application, many different strategies can be adopted in the segmentation of the played file.

[0077] The most common strategy is to segment the file to be played into segments of fixed duration. For example, if the total duration of the file is 4 minutes and 30 seconds, then segmenting it into segments of fixed duration of 1 minute will result in 5 different file segments. The first 4 file segments will each play for 1 minute. The last file segment will play for 30 seconds.

[0078] The advantage of segmenting data by a fixed time length is that it is relatively simple and easy to implement. However, the drawback is that it cannot be adjusted according to the actual network environment and user habits.

[0079] Therefore, Figure 3 illustrates a technical solution where the segment length can be dynamically and intelligently adjusted. Referring to Figure 3, the segment time length used when segmenting multimedia files is dynamically adjusted. When the average network transmission speed is high, a longer segment time can be used; when the average network transmission speed is low, a shorter segment time can be used.

[0080] Furthermore, it can monitor the time length of the segmented file in real time, then filter the result time length, and use the filtered result as the segment time length used when actually segmenting.

[0081] This filtering can be either low-pass or band-pass filtering.

[0082] Figure 4 is a flowchart of a multimedia loading method provided by one or more embodiments of the present invention. Referring to Figure 4, the multimedia loading method includes the following steps:

[0083] S41, Before playing the file, the file to be played is segmented to obtain multiple multimedia file segments.

[0084] S42, when a multimedia file segment is played, calculates the file segment download point expressed in time points based on network speed, audio quality, video quality, and user habits.

[0085] S43, upon reaching the file segment download point, download the next multimedia file segment.

[0086] It should be understood that the file segment download point, as a very important parameter in the technical solution, can be dynamically adjusted according to factors such as network environment and user habits.

[0087] Specifically, if the current network speed is fast, the download point for a file segment can be adjusted to be closer to the end of the current file segment playback. If the current network speed is slow, the download point for a file segment can be adjusted to be farther away from the end of the current file segment playback.

[0088] If the audio file being played is of high quality, the download point for the current file segment can be adjusted further away from the end of the current file segment's playback. If the audio file being played is of low quality, the download point for the current file segment can be adjusted closer to the end of the current file segment's playback.

[0089] If the currently playing video file has high quality, you can adjust the download point of the file segment further away from the end of the current file segment's playback. If the currently playing video file has low quality, you can adjust the download point of the file segment closer to the end of the current file segment's playback.

[0090] Of course, the adjusted file segment download point can be expressed as a time point or as the file playback position.

[0091] The dynamically adjusted parameters include more than just file segment download points. In one specific embodiment, user fast-forwarding behavior can be monitored, potential fast-forwarding actions can be predicted, and the prediction result can indicate which file segment needs to be downloaded next. For example, the user's historical fast-forwarding actions can be recorded, and the length of playback periods skipped by these fast-forwarding actions can be counted. Assuming that the duration of the skipped periods follows a normal distribution, the expected value of the historical skipped duration can be calculated, and this expected value can be used as the predicted value for the length of the next fast-forwarding action.

[0092] In some specific implementations, the file segment download point can be given by the following formula:

[0093]

[0094] in, This represents the file segment download point at time n. This represents the file segment download point at time n-1. This represents the average network speed at time n. This represents the average network speed at time n-1. This represents the audio quality or video quality at time n. This represents the audio quality or video quality at time n-1. , , All are weighting coefficients, and B represents the threshold parameter.

[0095] In some other specific implementations, the file segment download point can be given by the following formula:

[0096]

[0097] Where represents the user's preferred audio or video quality at time n. This is obtained by statistically analyzing the user's historical audio or video quality settings. is the corresponding weighting coefficient. C represents another threshold parameter.

[0098] Figure 5 is a flowchart illustrating a multimedia loading method according to one or more embodiments of the present invention. Referring to Figure 5, the multimedia loading method includes the following steps:

[0099] S501 segments the file according to the duration of the audio multimedia.

[0100] S502, download the first segment and start playing.

[0101] S503, calculate the threshold for starting to download the next segment.

[0102] S504: Determine if the threshold has been reached. If so, execute S505.

[0103] S505, download the next segment.

[0104] S506, play the segment that was just downloaded, and repeat S503.

[0105] S507, playback ended.

[0106] S508, the user fast forwards.

[0107] S509: Determine if the target segment has been downloaded. If yes, execute S504; otherwise, execute S510.

[0108] S510, download the target paragraph. Once completed, execute S504.

[0109] In the embodiment shown in Figure 5, the file segment download point is given in the form of a threshold. That is, the threshold is calculated after the file segment begins playback. When playback reaches the threshold, the next file segment is then downloaded.

[0110] Furthermore, in the embodiment shown in Figure 5, the file segments skipped due to the user's fast-forward operation do not need to be downloaded. That is, after the user performs a fast-forward operation, the file segments between the start and end points of the fast-forward operation are not downloaded; instead, it is directly determined whether the file segment at the end point has been downloaded. If it has not been downloaded, the file segment at the end point, i.e., the target segment, is downloaded directly using the network. If the target segment has been downloaded, the target segment is played.

[0111] As shown in Figure 6, the present invention also provides a multimedia loading device, comprising:

[0112] The segmentation module 601 is used to segment the file to be played into multiple multimedia file segments before playback.

[0113] The download point calculation module 602 is used to calculate the download point of the next multimedia file segment that needs to be downloaded when a multimedia file segment is played.

[0114] Download module 603 is used to download the next multimedia file segment when a file segment download point is reached.

[0115] It is worth noting that although only some basic functional modules are disclosed in the embodiments of this invention, it does not mean that the composition of this system is limited to the above-mentioned basic functional modules. On the contrary, what this embodiment intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. The fact that this embodiment only discloses a few basic functional modules should not be considered as the scope of protection of the claims of this invention being limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above device is described separately according to its functions as various units and modules. Of course, in implementing this invention, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0116] As shown in Figure 7, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of a multimedia loading method.

[0117] Figure 7 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. As shown in Figure 7, the electronic device provided in this embodiment of the present invention includes: one or more processors 710 and a memory 720; the processors 710 in the electronic device may be one or more, and one processor 710 is used as an example in Figure 7; the memory 720 is used to store one or more programs; the one or more programs are executed by the one or more processors 710, so that the one or more processors 710 implement the multimedia loading method as described in any one embodiment of the present invention.

[0118] The electronic device may also include an input device 730 and an output device 740.

[0119] The processor 710, memory 720, input device 730 and output device 740 in this electronic device can be connected by a bus or other means. Figure 7 shows an example of connection via a bus.

[0120] The memory 720 in this electronic device serves as a computer-readable storage medium, capable of storing one or more programs. These programs can be software programs, computer-executable programs, or modules, such as the program instructions / modules corresponding to the multimedia loading method provided in this embodiment. The processor 710 executes various functional applications and data processing of the electronic device by running the software programs, instructions, and modules stored in the memory 720, thereby implementing the multimedia loading method described in the above embodiment.

[0121] The memory 720 may include a program storage area and a data storage area. The program storage area may store the operating system and applications required for at least one function; the data storage area may store data created based on the use of the electronic device. Furthermore, the memory 720 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 720 may further include memory remotely located relative to the processor 710, which can be connected to the device via a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

[0122] Input device 730 can be used to receive input digital or character information, and to generate key signal inputs related to user settings and function control of the electronic device. Output device 740 may include display devices such as a display screen.

[0123] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of a multimedia loading method.

[0124] Specifically, the computer storage medium in this embodiment of the invention can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0125] The present invention also provides a vehicle equipped with a multimedia loading device as described above.

[0126] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

[0127] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

A multimedia loading method, characterized in that, The multimedia loading method includes: Before playing the file, the file to be played is segmented into multiple multimedia file segments; When a multimedia file segment is played, calculate the file segment download point that needs to be downloaded next; Upon reaching the file segment download point, the next multimedia file segment is downloaded. The method according to claim 1, characterized in that, File segment download points include: file segment download points expressed as time points, or file segment download points expressed as file playback positions. The method according to claim 2, characterized in that, Upon reaching the file segment download point, the next multimedia file segment is downloaded, including: When the currently playing multimedia file segment reaches the file segment download point, the next multimedia file segment is downloaded. The method according to claim 2, characterized in that, Upon reaching the file segment download point, the next multimedia file segment is downloaded, including: When the current time reaches the file segment download point, the next multimedia file segment will be downloaded. The method according to claim 1, characterized in that, The file being played is segmented, including: The file being played is segmented according to a fixed time length; or The file being played is segmented based on the dynamically adjusted duration. The method according to claim 5, characterized in that, Also includes: The duration of the dynamic adjustment is adjusted based on network speed, audio quality, video quality, and user habits. The method according to claim 2, characterized in that, The calculation of the file segment download point where the next multimedia file segment needs to be downloaded includes: Based on network speed, audio quality, video quality, and user habits, calculate the download points of file segments expressed in terms of time. The method according to claim 2, characterized in that, The calculation of the file segment download point where the next multimedia file segment needs to be downloaded includes: Based on network speed, audio quality, video quality, and user habits, calculate the file segment download point expressed as the file playback position. The method according to claim 1, characterized in that, Also includes: When the user fast-forwards, the program will jump to the playback point selected by the user. The method according to any one of claims 1 to 9, characterized in that, The triggering times for calculating the download point of a file segment include: when the audio multimedia file in this segment is automatically played, or when the user fast forwards. A multimedia loading device, characterized in that, The multimedia loading device includes: The segmentation module is used to segment the file to be played into multiple multimedia file segments before playback. The download point calculation module is used to calculate the download point of the next multimedia file segment that needs to be downloaded when a multimedia file segment is played. The download module is used to download the next multimedia file segment when the file segment download point is reached. An electronic device, characterized in that, include: The system includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs any one of the steps of the method described in claims 1 to 10. A computer-readable storage medium, characterized in that, It stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the method according to any one of claims 1 to 10.

Images