Audio playback method, electronic device, and storage medium

By adding a listening clip moment field to the music application and sending it to the Media Broadcast Control Center, the problem that non-member users cannot view paid music listening clips in the control center is solved, and a better user experience is achieved.

WO2025140444A1PCT designated stage expired Publication Date: 2025-07-03HUAWEI TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/142864
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-12-27
Filing Date
2024-12-26
Publication Date
2025-07-03

AI Technical Summary

Technical Problem

In the prior art, non-member users cannot perceive whether the currently playing music is paid music in the control center outside the music application, resulting in poor user experience.

Method used

By adding fields at the start moment and end moment of the audition clip in the music application, the music application sends this information to the media broadcast control center, so that it displays the audition clip logo in the control center, so that non-member users can view the audition clips of paid music in the control center.

Benefits of technology

Improves the ability of non-member users to view paid music listening clips in the control center outside the music application, and improves the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024142864_03072025_PF_FP_ABST
    Figure CN2024142864_03072025_PF_FP_ABST
Patent Text Reader

Abstract

An audio playback method, an electronic device, and a storage medium. A first application receives and responds to a first operation, and plays first music in the first application; the first application sends first music playback information of the first music to a media playback control center application, wherein the first music playback information comprises a total duration of the first music, a playback progress of the first music, a start moment of a preview clip of the first music, and an end moment of the preview clip of the first music; and an electronic device displays a first interface comprising the media playback control center application, wherein the first interface comprises the first music playback information. By means of the method, an electronic device can display a preview clip of currently-played music on an area outside a music application, thereby improving the use experience of users.
Need to check novelty before this filing date? Find Prior Art

Description

Audio playback method, electronic device, and storage medium

[0001] This application claims priority to the Chinese patent application with application number 202311832450.2 filed with the State Intellectual Property Office of China on December 27, 2023, and priority to the Chinese patent application with the invention name “A method for audio playback, an electronic device and a storage medium”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of terminal technology, and in particular to an audio playback method, electronic device, and storage medium. Background Art

[0003] With the development and advancement of terminal technology, the number of users using multimedia playback applications (APPs) is increasing. Taking music as an example, users of music apps can generally be divided into members and non-members. Members can play the full content of paid music and free music, while non-members can only play the full content of free music.

[0004] Non-member users can only listen to snippets of paid music, not the full content. Currently, the music playback interface can be displayed within the music app. For non-member users, electronic devices can display a preview of paid music within the music playback interface to prompt them to listen to the preview of the paid music. Displaying the music playback interface isn't limited to the music app; electronic devices can also display it in the control center.

[0005] Currently, for non-member users, the music playback interface displayed in the control center does not display the preview clip icon of paid music. It is impossible to tell whether the music is free or paid, which is a poor user experience. Summary of the Invention

[0006] The present application provides an audio playback method, an electronic device, and a storage medium, which enable the electronic device to display an audition clip of the currently playing music in an upper area outside the music application, thereby improving the user experience.

[0007] In a first aspect, the present application provides an audio playback method, where an electronic device includes a first application and a media broadcast control center application, and the method includes: the first application receives and responds to a first operation, and plays the first music in the first application; the first application sends the first music playback information of the first music to the media broadcast control center application; wherein the first music playback information includes: the total duration of the first music, the playback progress of the first music, the start time of the audition segment of the first music, and the end time of the audition segment of the first music; the electronic device displays a first interface including the media broadcast control center application, and the first interface includes the first music playback information.

[0008] Optionally, the first application may be a music application on the electronic device.

[0009] Optionally, the electronic device may display the first interface in a first area, where the first area is a display area outside the first application. For example, the first area may be a display area on a control center.

[0010] Optionally, the first application may also send other music information to the media playback control center application, for example, the first music playback information may also include any one or more of the following: the playback status of the first music, the picture of the first music, the name of the first music, and the name of the singer of the first music.

[0011] Through this method, the first application can send information such as the total duration of the first music, the start time of the audition segment, and the end time of the audition segment to the media broadcast control center application, so that the media broadcast control center application can display the total duration of the first music and the audition segment of the first music. The user can view the audition segment of the first music in the media broadcast control center application.

[0012] In combination with the first aspect, in a possible implementation, before the first application receives and responds to the first user operation, the method also includes: the electronic device displays a first prompt message, the first prompt message is used to prompt the user to download a first configuration file, the first configuration file includes multiple fields, the multiple fields include a music audition segment start field and a music audition segment end field; the electronic device receives and responds to the user's operation on the first option in the first prompt message, and downloads the first configuration file.

[0013] In this way, the first application on the electronic device can download the first configuration file for updating, so that the first application can report the start time and the end time of the audition segment of the music to the media broadcast control center application.

[0014] In combination with the first aspect, in a possible implementation, before the first application sends the first music playback information of the first music to the media playback control center application, the method further includes: the first application obtains the first music playback information based on the first configuration file.

[0015] Exemplarily, the first configuration file includes multiple fields, such as at least a set meta data field, a VIP start station field, a VIP stop station field, and a set play back state field (which is a field related to music playback progress). The VIP start station field is a field related to the start time of the audition segment. The VIP stop station field is a field related to the end time of the audition segment. The set meta data field is a field related to the total duration of the music. The set play back state field is a field related to the music playback progress.

[0016] In other embodiments, the first configuration file may further include other fields, such as a "set play picture" field, a "set music name" field, a "set musician name" field, and a "set play status" field. The "set play picture" field relates to a music picture field, the "set music name" field relates to a music name field, the "set musician name" field relates to a singer name field, and the "set play status" field relates to a play status field.

[0017] In this way, after the first application downloads the first configuration file for updating, the first application can obtain the first configuration file and generate music playback information based on multiple fields in the first configuration file.

[0018] In combination with the first aspect, in a possible implementation method, after the media broadcast control center application displays the first interface on the first display area, the method also includes: the media broadcast control center application receives a second operation of the user dragging the playback progress of the first music from the first moment to the second moment; when the second moment is outside the audition clip of the first music, the media broadcast control center application rewinds the playback progress of the first music to the first moment.

[0019] Exemplarily, the first music playback information may include multiple fields, such as a VIP start station field, a VIP stop station field, a set meta data field, a set play back state field, etc. The media playback control center application may obtain the start time of the first music audition segment from the VIP start station field and obtain the end time of the first music audition segment from the VIP stop station field.

[0020] After the media broadcast control center application obtains the first music audition clip, the media broadcast control center application can determine whether the second moment is within the first music audition clip. For example, if the second moment is before the start time of the first music audition clip or after the end time of the first music audition clip, the media broadcast control center can determine that the second moment is outside the first music audition clip.

[0021] In response to the second moment being outside the first track's preview, the media broadcast control center application rewinds the first track's playback progress to the first moment. Because the media broadcast control center application retrieves the first track's preview, it can determine whether the second moment is outside the first track's preview and directly handle the process, rewinding to the initial playback time. This eliminates the need for the first application to respond, saving additional interaction between the first application and the media broadcast control center application.

[0022] In combination with the first aspect, in one possible implementation, when the second moment is within the audition segment of the first music, the media broadcast control center application sends a first instruction to the first application; in response to the first instruction, the first application continues to play the first music from the second moment; the first application sends the updated playback progress of the first music to the media broadcast control center application, and the updated playback progress includes the second moment.

[0023] After the media broadcast control center application obtains the audition clip of the first music piece, the media broadcast control center application can determine whether the second moment is within the audition clip of the first music piece. For example, if the second moment is after the start time of the audition clip of the first music piece and before the end time of the audition clip of the first music piece, the media broadcast control center can determine that the second moment is within the audition clip of the first music piece. Because the playback progress of the first music piece has changed, the first application needs to adjust the playback progress of the first music piece.

[0024] Optionally, the first application is not limited to sending only updated playback progress. It can also send other information to the media broadcast control center, such as the playback status of the first music, the picture of the first music, the name of the first music, the name of the singer of the first music, the total length of the first music, the start time of the audition clip of the first music, the end time of the audition clip of the first music, etc. This application does not limit this.

[0025] In combination with the first aspect, in a possible implementation, when the user of the first application is a non-member user and the first music is paid music, the duration of the trial listening segment of the first music is less than the total duration of the first music.

[0026] In combination with the first aspect, in one possible implementation, when the user of the first application is a member user and the first music is paid music, or the user of the first application is a member user and the first music is free music, or the user of the first application is a non-member user and the first music is free music, the length of the audition clip of the first music is equal to the total length of the first music.

[0027] In combination with the first aspect, in a possible implementation method, after the first application sends the first music playback information of the first music to the media broadcast control center application, the method also includes: the first application determines whether the playback progress of the first music in the first music playback information is the end time of the first music; when it is determined that the playback progress of the first music in the first music playback information is the end time of the first music, the first application obtains the music playback information of the second music; the first application sends the music playback information of the second music to the media broadcast control center application; wherein, the music playback information of the second music includes: the total duration of the second music, the playback progress of the second music, the start time of the audition segment of the second music, and the end time of the audition segment of the second music; the electronic device displays a second interface including the media broadcast control center application, and the second interface includes the music playback information of the second music.

[0028] The music application can periodically / irregularly send the updated playback progress of the first music to the media broadcast control center, so that the media broadcast control center can periodically / irregularly update the playback progress of the first music. Before the music application sends the updated playback progress to the media broadcast control center, the music application will determine whether the playback progress sent last time (for example, the playback progress of the first music in the first music playback information) is the end playback time of the first music. When the playback progress sent last time is the end playback time of the first music, the music application automatically switches to playing the second music, and the music application sends the music playback information of the second music to the media broadcast control center, so that the media broadcast control center can display the music playback information of the second music in the control center. When the playback progress sent last time is not the end playback time of the first music, the music application also needs to send the updated playback progress of the first music to the media broadcast control center, where the updated playback progress of the first music is later than the playback progress sent last time.

[0029] In combination with the first aspect, in a possible implementation method, the electronic device also includes a media session module and a media session service module; the first application sends the first music playback information of the first music to the media broadcast control center application, specifically including: the first application sends the first music playback information to the media session module; the media session module sends the first music playback information to the media session service module; the media session service module sends the first music playback information to the media broadcast control center application.

[0030] In combination with the first aspect, in a possible implementation, the electronic device also includes a media session module and a media control module; the media broadcast control center application sends a first instruction to the first application, specifically including: the media broadcast control center application sends the first instruction to the media control module; the media control module sends the first instruction to the first application.

[0031] In a second aspect, the present application provides an electronic device, which includes a memory and a processor, wherein the memory and the processor are coupled, and the memory is used to store a computer program. When the processor executes and calls the computer program, the electronic device executes an audio playback method provided in any possible implementation of the first aspect.

[0032] In a third aspect, the present application provides a computer-readable storage medium comprising instructions, which, when executed on an electronic device, enables the electronic device to execute an audio playback method provided in any possible implementation of the first aspect.

[0033] In a fourth aspect, the present application provides a computer program product comprising instructions. When the computer program product is run on an electronic device, the electronic device executes an audio playback method provided in any possible implementation of the first aspect.

[0034] In a fifth aspect, the present application provides a chip system, which includes one or more processors, and the processors are used to call computer instructions to enable an electronic device to execute an audio playback method provided in any possible implementation of the first aspect above.

[0035] For the description of the beneficial effects of the second to fifth aspects, reference may be made to the description of the beneficial effects in the first aspect, and this application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] 1A-1G are schematic diagrams showing an electronic device 100 playing music in a music application based on user operations;

[0037] FIG2 shows a schematic structural diagram of the electronic device 100;

[0038] FIG3 shows a schematic diagram of a software architecture of an electronic device 100;

[0039] 4A-4B are schematic diagrams showing downloading a first configuration file;

[0040] 4C-4D show UI diagrams of the electronic device 100 displaying music information of the currently playing music in the control center;

[0041] FIG5 shows an interactive schematic diagram of the electronic device 100 displaying initial music playing information in the control center;

[0042] FIG6 is a schematic diagram of a method flow of an audio playback method provided by the present application;

[0043] 7A-7B are schematic diagrams showing the media playback control center responding to a user operation of not adjusting the playback progress of the first music;

[0044] FIG8 shows an interactive diagram of a media playback control center displaying and updating music playback information based on a user operation that does not adjust the playback progress of a first piece of music in the control center;

[0045] FIG9 shows a schematic diagram of a method flow of another audio playback method provided by the present application;

[0046] 10A-10D are schematic diagrams showing the media playback control center responding to a user operation of adjusting the playback progress of a first piece of music;

[0047] FIG11 shows an interactive schematic diagram of a media playback control center displaying and updating music playback information based on a user operation to adjust the playback progress of a first piece of music in a control center;

[0048] FIG12 shows another interactive diagram of a media playback control center displaying updated music playback information in the control center;

[0049] 13A-13B show another UI diagram of the media playback control center responding to a user operation to adjust the playback progress of the first music when the first music is paid music and the user of the music application is a non-member user;

[0050] FIG14 shows another interactive diagram of a media playback control center displaying and updating music playback information based on a user operation to adjust the playback progress of a first piece of music in a control center;

[0051] FIG15 shows a schematic diagram of a method flow of another audio playback method provided by the present application;

[0052] FIG16 shows a flow chart of another audio playback method provided in the present application. DETAILED DESCRIPTION

[0053] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0054] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0055] The term "user interface (UI)" in the following embodiments of this application refers to the media interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of a wearable device.

[0056] One or more multimedia applications may be installed on the electronic device 100 , and the user may play music, videos, e-books, etc. through the multimedia applications to enhance the user experience of the electronic device.

[0057] Multimedia application users can generally be divided into member users and non-member users. Member users can play the full content of paid multimedia files and the full content of free multimedia files within the multimedia application. Non-member users can only play clips of paid multimedia files and the full content of free multimedia files within the multimedia application.

[0058] In some embodiments, the electronic device 100 may not only display the multimedia file playback interface within the multimedia application, but may also display the multimedia file playback interface on the control center, so that the user can view detailed information of the currently playing multimedia content, such as the title of the multimedia content, the total duration of the multimedia content, and the playback progress of the multimedia content.

[0059] For example, the multimedia application may be a music application, and the multimedia content may be music within the music application. The following embodiments of the present application are described by taking the electronic device 100 playing music within the music application as an example, but this is not intended to be limiting.

[0060] 1A-1G are schematic diagrams showing an electronic device 100 playing music within a music application based on user operations.

[0061] Figure 1A shows the desktop of electronic device 100. The desktop of electronic device 100 displays application icons for multiple applications, such as a weather application icon, a stock application icon, a calculator application icon, a settings application icon, an email application icon, a music application icon, a video application icon, a browser application icon, a map application icon, a gallery application icon, a memo application icon, a voice assistant application icon, and a photo application icon. A page indicator is also displayed below the multiple application icons to indicate the total number of pages on the desktop and the position of the currently displayed page in relation to other pages. For example, the desktop may include three pages, and a white dot in the page indicator may indicate that the currently displayed page is the rightmost of the three pages. Optionally, multiple tray icons (such as a dialer application icon, a messaging application icon, a contacts application icon, and a camera application icon) are located below the page indicator. The tray icons remain displayed when switching between pages. Optionally, a status bar is displayed in a portion of the upper area of ​​the desktop. The status bar may include: one or more signal strength indicators for a mobile communication signal (also known as a cellular signal), a battery status indicator, a time indicator, and the like.

[0062] For example, as shown in FIG1A , electronic device 100 may receive a user input operation (e.g., a single click) on a music application icon on the desktop. In response to the user input operation, electronic device 100 may display user interface 1100 shown in FIG1B . User interface 1100 is the main interface of the music application provided in an embodiment of the present application.

[0063] As shown in FIG1B , the user interface 1100 may include multiple music playback options, such as an artist list option, a song ranking option, a playlist option, a radio station option, and a recommended playlist option. The artist list option may display multiple songs corresponding to one or more artists based on user operations, the song ranking option may display multiple songs ranked from high to low in popularity based on user operations, the playlist option may view multiple songs collected or downloaded by the user based on user operations, the radio station option may play radio station audio based on user operations, and the recommended playlist option includes a playlist 1 option, which may display multiple songs recommended by the system to the user based on user operations.

[0064] For example, as shown in FIG1B , the electronic device 100 may receive a user input operation (e.g., a single click) for the song list 1 option in the user interface 1100. In response to the user input operation, the electronic device 100 may display the user interface 1200 shown in FIG1C . The user interface 1200 includes multiple song options recommended by the system for the user. For example, the multiple song options may include, but are not limited to, song 1 options, song 2 options, song 3 options, and song 4 options. The electronic device 100 may receive a user input operation for any one of the multiple song options and play the song content.

[0065] For example, as shown in FIG1C , the electronic device 100 may receive a user input operation (such as a single click) for the Song 1 option in the user interface 1200 . In response to the user input operation, the electronic device 100 may play Song 1 and display the music playback interface of Song 1 .

[0066] As shown in FIG1D , the electronic device 100 displays a music playback interface 1300 for song 1. The music playback interface 1300 may include the music title “Song 1,” the total duration of the music (e.g., 4 minutes and 42 seconds), the music playback progress (e.g., playing to 42 seconds), a playback progress bar, a start / pause music playback option, a play previous music option, a play next music option, a download option, a share option, and more options.

[0067] Optionally, if the current user of the music application is a member user and song 1 is free music, the music playing interface 1300 shown in FIG1D may be a music playing interface of the free music, that is, the member user can listen to the full content of the free music.

[0068] If the current user of the music application is a member user and song 1 is a paid song, the music playing interface 1300 shown in FIG1D may also be a music playing interface of the paid song, that is, the member user can listen to the full content of the paid song.

[0069] If the current user of the music application is a non-member user and song 1 is free music, the music playing interface 1300 shown in FIG1D may be a music playing interface of the free music, that is, the non-member user can listen to the full content of the free music.

[0070] In some embodiments, in response to a user input operation (e.g., a single click) on the Song 1 option in the user interface 1200, the electronic device 100 may also display a user interface 1400 shown in FIG1E . The user interface 1400 is similar to the music playback interface 1300, except that an identifier 1401 and an identifier 1402 are further shown on the playback progress bar in the user interface 1400. The identifiers 1401 and 1402 are used to indicate that the current user can only listen to the segment between the identifiers 1401 and 1402, and cannot listen to the entire content of Song 1.

[0071] In some embodiments, marker 1401 may be referred to as an audition segment start marker, and marker 1402 may be referred to as an audition segment end marker.

[0072] Optionally, when the user of the current music application is a non-member user and song 1 is paid music, when the electronic device 100 plays song 1 based on user operation, the electronic device 100 can display the user interface 1400 shown in Figure 1E. The user interface 1400 shown in Figure 1E can be a music playback interface for paid music.

[0073] In some embodiments, the electronic device 100 is not limited to displaying the music interface of the currently playing music within the music application. The electronic device 100 can also display the music interface of the currently playing music in other locations, such as in the control center.

[0074] In a possible implementation, the control center may be a pull-down notification bar.

[0075] For example, as shown in FIG1F , the electronic device 100 may receive a user sliding operation (e.g., a downward sliding operation) on the user interface 1400. In response to the user sliding operation, the electronic device 100 may display the user interface 1500 shown in FIG1G . The user interface 1500 includes a plurality of device control options, such as a WLAN on / off option, a Bluetooth on / off option, a mobile data on / off option, an airplane mode on / off option, an automatic on / off option, an instant sharing on / off option, music playback information 1501, a brightness adjustment option, and the like.

[0076] Among them, the music playback information 1501 displays multiple information of the currently playing music, such as the music name, music picture, singer name, total music duration (for example, 4 minutes and 42 seconds), music playback progress (for example, played to 42 seconds), playback progress bar, start / pause music playback option, play previous music option, play next music option, etc.

[0077] However, as shown in Figure 1G, when logo 1401 and logo 1402 are displayed in the music application, if the current user of the music application is a non-member user and song 1 is paid music, the audition clip logo is not displayed in the drop-down notification bar. For example, logo 1401 and logo 1402 are not displayed, and the user cannot perceive whether the currently playing music displayed in the drop-down notification bar is paid music or free music, resulting in a poor user experience.

[0078] Secondly, in some embodiments, the user can also drag the playback progress bar to change the playback progress of the current music. However, if the user of the current music application is a non-member user and song 1 is paid music, the user cannot tell whether song 1 is paid music or free music. When the user drags the playback progress bar to the outside of the audition segment, some music applications will automatically switch to playing the next song, some will rewind to the music playback progress before the user dragged the playback progress bar, and some will rewind to the beginning of the audition segment to start playing the music. In other words, different music applications have different strategies in response to the user dragging the music playback progress outside the audition segment, which can easily cause confusion.

[0079] Based on this, the present application provides an audio playback method, which includes but is not limited to the following steps:

[0080] Step 1: The music application receives a user operation to play a first piece of music and obtains music playing information of the first piece of music.

[0081] Music playback information includes, but is not limited to, any one or more of the following: music playback status, music title, music image, artist name, total music duration, music playback progress, audition segment start time, audition segment end time, etc. The audition segment start time and audition segment end time are used by the media playback control center to display the audition segment start mark and audition segment end mark in the control center.

[0082] Step 2: The music application sends the music playing information of the first music to the media play control center.

[0083] Step 3: The media broadcast control center displays a first user interface in the control center. The first user interface includes a start mark and an end mark of the audition segment of the first music.

[0084] In this way, the music application can report the start time and the end time of the audition segment of the first music to the media broadcast control center, so that the user can check in the control center whether the first music is free music or paid music.

[0085] In some embodiments, the user can also drag the playback progress bar to change the playback progress of the current music. However, if the user of the current music application is a non-member user and the first music is paid music, when the user drags the playback progress bar to drag the music playback progress outside the audition segment, the media playback control center can control the music playback progress to rewind to the music playback progress before the user dragged the playback progress bar, or control the music playback progress to rewind to the beginning of the audition segment to start playing music, or switch to playing the next music. Ensure that for paid music, the strategy in response to the user dragging the music playback progress outside the audition segment is the same, and no confusion will occur.

[0086] The following describes the hardware structure of an electronic device 100 provided in an embodiment of the present application.

[0087] FIG2 shows a schematic structural diagram of the electronic device 100 .

[0088] The following embodiments are described in detail using electronic device 100 as an example. It should be understood that the electronic device 100 shown in FIG2 is merely an example, and that electronic device 100 may have more or fewer components than shown in FIG2 , may combine two or more components, or may have a different component configuration. The various components shown in FIG2 may be implemented in hardware, including one or more signal processing and / or application-specific integrated circuits, software, or a combination of hardware and software.

[0089] The electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0090] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0091] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0092] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0093] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0094] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0095] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C bus lines. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, and the like via different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K via the I2C interface, enabling communication between the processor 110 and the touch sensor 180K via the I2C bus interface, thereby enabling the touch function of the electronic device 100.

[0096] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface, enabling the function of answering calls through a Bluetooth headset.

[0097] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.

[0098] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface, enabling the function of playing music through Bluetooth headphones.

[0099] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0100] The GPIO interface can be configured via software. The GPIO interface can be configured as either a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, display 194, wireless communication module 160, audio module 170, sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0101] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0102] It is understood that the interface connection relationship between the modules illustrated in the embodiment of the present invention is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0103] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0104] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0105] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0106] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0107] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0108] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0109] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0110] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with a network and other devices through wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0111] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0112] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display screen panel can also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniLED, a microLED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0113] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0114] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise and brightness. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0115] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0116] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0117] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.

[0118] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.

[0119] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0120] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0121] The electronic device 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0122] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0123] The speaker 170A, also called a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to hands-free calls through the speaker 170A.

[0124] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can place the receiver 170B close to the ear to hear the voice.

[0125] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0126] The headphone jack 170D is used to connect a wired headphone and can be the USB interface 130 or a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0127] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force acts on pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the touch intensity based on pressure sensor 180A. Electronic device 100 can also calculate the touch location based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.

[0128] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0129] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0130] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.

[0131] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0132] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.

[0133] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0134] Ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touches.

[0135] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0136] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to prevent the electronic device 100 from shutting down abnormally due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 boosts the output voltage of the battery 142 to prevent abnormal shutdown due to low temperature.

[0137] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0138] The bone conduction sensor 180M can obtain vibration signals. In some embodiments, the bone conduction sensor 180M can obtain vibration signals from the vibrating bones of the human body. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulse signals. In some embodiments, the bone conduction sensor 180M can also be set in headphones to form bone conduction headphones. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bones of the human body obtained by the bone conduction sensor 180M to implement voice functions. The application processor can parse heart rate information based on the blood pressure pulse signals obtained by the bone conduction sensor 180M to implement heart rate detection functions.

[0139] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.

[0140] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0141] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0142] The SIM card interface 195 is used to connect a SIM card.

[0143] FIG3 shows a schematic diagram of a software architecture of an electronic device 100 .

[0144] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system with a layered architecture is used as an example to illustrate the software structure of the electronic device 100.

[0145] As shown in Figure 3, a layered architecture divides the system into several layers, each with distinct roles and responsibilities. Layers communicate with each other via software interfaces. In some embodiments, the system can be divided into four layers: application layer, application framework layer, system library layer, and kernel layer, from top to bottom.

[0146] The application layer may include a series of application packages, which may include a music application and a media playback control center, etc. Among them, the music application may be used to play music, and the media playback control center may be used to display music information of the currently playing music in the control center.

[0147] Not limited to music applications and media playback control center, the application package can also include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0148] The application framework layer includes a media session module (media session) and a media control module (media controller).

[0149] The system library includes a media session service module (media session service).

[0150] The media session module is used to receive music information sent by the music application and send the music information to the media session service module. The media session service module then sends the music information to the media broadcast control center. The media broadcast control center can display the music information in the control center so that the user can view the music information of the first music in the control center.

[0151] In some embodiments, electronic device 100 may also receive user operations in the control center to change music playback information. In response to the user operation to change the music playback information, the media playback control center may send a first instruction to the media control module, indicating the user operation to change the music playback information. The media playback control center then sends the first instruction to the media session module, which then sends the first instruction to the music application.

[0152] In response to the first instruction, the music application can play music based on the updated music playback information. The music application also needs to send the updated music playback information to the media session module, which then sends the updated music playback information to the media playback control center, which can display the updated music playback information in the control center.

[0153] The application framework layer can also provide an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0154] For example, the application framework layer may also include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like. The window manager manages window programs. It can obtain the display size, determine whether a status bar exists, lock the screen, and take screenshots. The content provider stores and retrieves data and makes it accessible to applications. This data may include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and a phone book. The view system includes visual controls, such as those for displaying text and images. The view system can be used to build applications. The display interface may consist of one or more views. For example, a display interface including a text notification icon may include a view for displaying text and a view for displaying images. The telephony manager provides communication functions for the electronic device 100, such as managing call status (including connected and ended calls). The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and the like. The notification manager enables applications to display notifications in the status bar. These notifications can be used to convey notification messages and can be displayed for a short period of time, disappearing automatically without user interaction. For example, the notification manager is used to notify you of download completions, message reminders, and more. The notification manager can also appear as an icon or scrolling text bar in the system's top status bar, such as notifications from background applications. It can also appear as a dialog window on the screen. Examples include text messages in the status bar, beeping, vibrating electronic devices, or flashing indicator lights.

[0155] The system library can also include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (for example: OpenGL ES), 2D graphics engine (for example: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.

[0156] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, sensor driver, etc.

[0157] The following describes in detail an audio playback method provided in an embodiment of the present application in conjunction with a UI diagram and a software module interaction diagram.

[0158] 1. The music application obtains a first configuration file and reports the start time and the end time of the audition segment to the media broadcast control center based on the first configuration file.

[0159] Based on the above analysis, when a music app plays paid music, it does not report the start and end times of the audition clip to the media broadcast control center. The media broadcast control center is also unable to display the audition clip in the control center. Non-member users of the music app are unable to determine whether the music is free or paid. This is because the music app lacks fields for the start and end times of the audition clip. When the music app starts playing music, it does not report the start and end times of the audition clip to the media session module, and the media session module does not report the start and end times of the audition clip to the media broadcast control center.

[0160] In order to enable the music application to report the start time and end time of the audition segment to the media broadcast control center, the music application can add a new audition segment start time field and an audition segment end time field, and the media session module can also add a new audition segment start time field and an audition segment end time field, so that the music application can report the start time and end time of the audition segment to the media session module, and the media session module will then report the start time and end time of the audition segment to the media broadcast control center.

[0161] In some embodiments, the audition segment start time field and the audition segment end time field can be set in the first configuration file. The electronic device 100 can download the first configuration file from the music application server and report the audition segment start time and the audition segment end time to the media session module based on the audition segment start time field and the audition segment end time field preset in the first configuration file.

[0162] Optionally, the first configuration file may include not only the audition clip start time field and the audition clip end time field, but also other fields, such as the playback status field, the music name field, the singer name field, the total music duration field, the music playback progress field, the music picture field, etc.

[0163] Table 1

[0164] Table 1 shows a schematic diagram of the composition structure of a first configuration file. As shown in Table 1, the first configuration file includes multiple fields, such as a vip start station field, a vip stop station field, a set meta data field, a set play back state field, a set play picture field, a set music name field, a set musician name field, and a set play statua field. Among them, the vip start station field is a field about the start time of the audition clip. The vip stop station field is a field about the end time of the audition clip. The set meta data field is a field about the total length of the music. The set play back state field is a field about the music playback progress field. The set play picture field is a field about the music picture field. The set music name field is a field about the music name field. The set musician name field is a field about the singer name field. The set play statua field is a field about the playback status field.

[0165] After obtaining the first configuration file, the music application can report the start time of the audition segment to the media session module based on the VIP start station field in the first configuration file. The music application can also report the end time of the audition segment to the media session module based on the VIP stop station field in the first configuration file.

[0166] Optionally, the first configuration file may also be updated periodically / irregularly.

[0167] Optionally, the first configuration file in the media session module may be pre-installed in the electronic device 100 when the electronic device 100 leaves the factory. The first configuration file in the media session module may also be downloaded periodically / irregularly by the electronic device 100 from the music application server.

[0168] The music application on the electronic device 100 may download the first configuration file from the music application server.

[0169] In some embodiments, if the music application is not pre-installed with the first configuration file when the electronic device 100 downloads the music application, after downloading the music application, the music application server can send the first configuration file to the electronic device 100, so that the electronic device 100 can bind and store the first configuration file and the music application. For example, the first configuration file can be stored in the same area as the installation file of the music application.

[0170] For example, as shown in FIG4A , in response to the first configuration file sent by the music application server, electronic device 100 may display prompt bar 5100 shown in FIG4A . Prompt bar 5100 includes the text "Music application has been updated. Do you want to download the update file?" This text prompts the user whether to update the music application. Prompt bar 5100 also includes a confirmation option and a cancel option. The user can use the confirmation option to update the music application and obtain the first configuration file. The user can also use the cancel option to stop updating the music application.

[0171] When the user confirms to update the music application, as shown in Figure 4A, the electronic device 100 can receive the user's input operation (such as a single click) for the confirmation option in the prompt bar 5100. In response to the user's input operation, the electronic device 100 can display the prompt bar 5101 shown in Figure 4B, which includes the text "Downloading update file". The prompt bar 5101 also includes a download progress 5102 and a cancel option 5103. The text can be used to prompt the user that the current electronic device 100 is downloading the first configuration file from the music application server. The prompt type of the text can also be any one or more of a picture prompt, a dynamic image prompt, and a video prompt. The download progress 5102 is used to indicate the download progress of the first configuration file downloaded by the electronic device 100 from the music application server. The cancel option 5103 can be used to trigger the electronic device 100 to cancel downloading the first configuration file from the music application server.

[0172] Through this method, the electronic device 100 can subsequently download the first configuration file from the music application server.

[0173] 2. The music app plays music and displays the music information of the currently playing music in the control center.

[0174] 4C and 4D show UI diagrams showing the electronic device 100 displaying music information of the currently playing music in the control center.

[0175] 1A to 1E , the electronic device 100 may receive a user operation to play music in a music application, such as Music 1, and display the music playback interface 1300 shown in FIG. 1D or the user interface 1400 shown in FIG. 1E .

[0176] Based on the above description, it can be seen that when the user of the current music application is a member user and song 1 is free music, the music playback interface 1300 shown in Figure 1D can be a music playback interface for free music.

[0177] When the user of the current music application is a member user and song 1 is paid music, the music playback interface 1300 shown in FIG1D may also be a music playback interface for paid music.

[0178] When the user of the current music application is a non-member user and song 1 is free music, the music playback interface 1300 shown in FIG1D may be a music playback interface for free music.

[0179] When the user of the current music application is a non-member user and song 1 is paid music, the user interface 1400 shown in Figure 1E can be a music playback interface for paid music.

[0180] The electronic device 100 is not limited to displaying the music interface of the currently playing music in the music application. The electronic device 100 can also display the music interface of the currently playing music in other locations, such as in the control center.

[0181] In a possible implementation, the control center may be a pull-down notification bar.

[0182] For example, as shown in FIG4C , the electronic device 100 may receive a sliding operation (eg, a downward sliding operation) from the user on the user interface 1400 . In response to the sliding operation from the user, the electronic device 100 may display the user interface 1600 shown in FIG4D .

[0183] The user interface 1600 shown in Figure 4D is similar to the user interface 1500 shown in Figure 1F, except that the music playback information 1601 shown in the user interface 1600 also includes an identifier 1602 and an identifier 1603. The identifier 1602 and the identifier 1603 are used to indicate that the current user can only listen to the segment between the identifier 1602 and the identifier 1603, and cannot listen to the complete content of song 1.

[0184] In some embodiments, the logo 1602 may not be displayed in the music playback information 1601.

[0185] In other embodiments, if the user of the music application is a member user and song 1 is paid music, or the user of the music application is a non-member user and song 1 is free music, or the current user of the music application is a member user and song 1 is free music, the electronic device 100 may not display the logo 1602 and logo 1603 shown in Figure 4D.

[0186] In this way, if the music application is pre-installed with the first configuration file, the music application can report the audition segment start time and audition segment end time fields in the first configuration file to the media session module. The media session module then reports the audition segment start time and audition segment end time to the media broadcast control center. The media broadcast control center can then display the music audition segment to improve the user experience.

[0187] As shown in FIG5 , FIG5 shows an interactive schematic diagram of the electronic device 100 displaying initial music playing information in the control center.

[0188] The electronic device 100 may display the initial music playing information in the control center, including but not limited to the following steps:

[0189] 1. The music app receives a user action to play music.

[0190] The user operation of playing music can refer to the description in the embodiments of Figures 1A to 1C. The music application can play the music in the music application based on the user operation and display the music playback interface.

[0191] 2. The music application sends the initial music playing information of the first music to the media session module.

[0192] In response to the user operation of playing music, the music application can obtain initial music playing information of the first music and send the initial music playing information of the first music to the media session module.

[0193] The initial music playback information of the first music may include but is not limited to any one or more of the following: playback status (such as playing status or paused playback status), music name, music picture, singer name, total music duration, music playback progress, audition clip start time, audition clip end time, etc.

[0194] Optionally, when the first music is free music, the initial music playback information of the first music may not include the start time of the trial listening segment and the end time of the trial listening segment.

[0195] Optionally, when the first music is free music, the start time of the trial listening segment may be the start time of playing the first music, and the end time of the trial listening segment may be the end time of playing the first music.

[0196] When the first music is paid music, the initial music playing information of the first music may include the start time of the trial listening segment and the end time of the trial listening segment.

[0197] Optionally, when the user of the music application is a member user and the first music piece is a paid music piece, the start time of the trial listening clip can be the start time of the first music piece, and the end time of the trial listening clip can be the end time of the first music piece. That is, the trial listening clip is the complete content of the first music piece, and the member user can listen to the complete content of the first music piece.

[0198] 3. The media session module sends the initial music playing information of the first music to the media session service module.

[0199] After the media session module receives the initial music playing information sent by the music application, the media session service module sends the initial music playing information of the first music to the media session service module.

[0200] 4. The media session service module sends the initial music playing information of the first music to the media play control center.

[0201] 5. The media playback control center displays the initial music playback information of the first music in the control center.

[0202] After receiving the initial music playback information of the first music sent by the media session service module, the media playback control center can display the initial music playback information of the first music in the control center, so that the user can view the initial music playback information of the first music in the control center.

[0203] Exemplarily, the media playback control center can also display the music playback information 1501 shown in Figure 1G in the control center. In this way, the electronic device 100 can quickly view the music information of the music currently playing by the music application in the control center without opening the music application.

[0204] Exemplarily, the media playback control center can display the music playback information 1601 shown in Figure 4D in the control center. In this way, when the user of the music application is a non-member user and the first music is paid music, the user can view the audition clip of the first music in the control center.

[0205] FIG6 is a flowchart of an audio playback method provided by the present application.

[0206] As shown in Figure 6, the software architecture of electronic device 100 includes, but is not limited to, the interaction and collaboration between the application layer, application framework layer, system library, and kernel layer. The application layer primarily involves music applications and a media playback control center. The application framework layer primarily involves a media session module and a media control module. The system library primarily includes, among other things, a media session service module.

[0207] After the electronic device 100 receives the user's operation to play the first music in the music application, the electronic device 100 may display the music information of the first music in the control center, including but not limited to the following steps.

[0208] S601: The music application receives a user operation to play music.

[0209] The user operation of playing music can refer to the description in the embodiments of Figures 1A to 1C. The music application can play the music in the music application based on the user operation and display the music playback interface.

[0210] For example, the music playing interface may be the music playing interface 1300 shown in FIG1D . The music playing interface may also be the user interface 1400 shown in FIG1E .

[0211] S602: The music application obtains a first configuration file.

[0212] S603: The music application generates initial music playing information of the first music based on multiple fields in the first configuration file.

[0213] Optionally, the music application may not only be based on the multiple fields in the first configuration file, but may also obtain the user account information logged into the music application and the music information of the first music piece to generate the initial music playback information for the first music piece. The user account information logged into the music application may include both member and non-member users, and the music information of the first music piece may include both free and paid music. The user account information and music information are used to determine the start and end times of the audition segment in the music playback information.

[0214] For example, if the first piece of music is paid music and the user of the music application is a member, or if the first piece of music is free music and the user of the music application is a member, or if the first piece of music is free music and the user of the music application is a non-member, the current user has permission to listen to the entire content of the first piece of music. In this case, the start time of the audition clip in the music playback information is the same as the start time of the first piece of music, and the end time of the audition clip in the music playback information is the same as the stop time of the first piece of music. If the first piece of music is paid music and the user of the music application is a non-member, the current user does not have permission to listen to the entire content of the first piece of music and can only listen to a portion of the first piece of music. In this case, at least one of the start time and the end time of the audition clip is different from the start time and the stop time of the first piece of music.

[0215] In response to a user operation of playing music, the music application may obtain a first configuration file and obtain multiple fields from the first configuration file.

[0216] Exemplarily, the multiple fields in the first configuration file may be the multiple fields shown in Table 1, and the music application may generate initial music playback information of the first music based on the multiple fields.

[0217] The initial music playback information of the first music may include, but is not limited to, any one or more of the following: playback status (e.g., playing status or paused status), music title, music image, singer name, total music duration, music playback progress, audition segment start time, audition segment end time, etc. The audition segment start time may refer to the start time of the music audition segment, and the audition segment end time may refer to the end time of the music audition segment.

[0218] In some embodiments, when the start time of the music audition segment is the start time of the first music, the start time of the audition segment in the initial music playback information of the first music can be the same as the start time of the first music, for example, it can be time 0.

[0219] In some embodiments, when the end time of the music audition segment is the end time of the first music, the end time of the audition segment in the initial music playback information of the first music may be the same as the stop time of the first music.

[0220] S604: The music application sends initial music playing information of the first music to the media session module.

[0221] S605: The media session module sends the initial music playing information of the first music to the media session service module.

[0222] S606: The media session service module sends the initial music playing information of the first music to the media play control center.

[0223] After the music application obtains the initial music playback information of the first music, the music application sends the initial music playback information of the first music to the media session module, the media session module then sends the initial music playback information of the first music to the media session service module, and the media session service module then sends the initial music playback information of the first music to the media broadcast control center, so that the media broadcast control center can display the music playback interface of the first music in the control center based on the initial music playback information of the first music.

[0224] S607: The media playback control center displays a first user interface in the control center, where the first user interface includes initial music playback information of the first music.

[0225] After receiving the initial music playing information of the first music sent by the media session service module, the media broadcast control center displays a first user interface in the control center, where the first user interface includes the initial music playing information of the first music.

[0226] Among them, the first user interface may include playing status, music name, music picture, singer name, total music duration, and music playing progress.

[0227] In some embodiments, when the user of the music application is a member and the first music is paid music, or the user of the music application is a member and the first music is free music, or the user of the music application is a non-member and the first music is free music, the first user interface may not include the start time and end time of the audition segment. For example, the first user interface may be user interface 1500 shown in Figure 1G, and user interface 1500 includes music playback information 1501. In this way, the electronic device 100 can quickly view the music information of the music currently playing in the music application in the control center without opening the music application.

[0228] In some embodiments, when the user of the music application is a non-member user and the first music is paid music, the first user interface may include an audition segment start identifier and / or an audition segment end identifier, the audition segment start identifier is used to indicate the audition segment start time, and the audition segment end identifier is used to indicate the audition segment end time. Exemplarily, the first user interface may be the user interface 1600 shown in FIG4D , the user interface 1600 includes music playback information 1601, the audition segment start identifier may be identifier 1602 in the music playback information 1601, and the audition segment end identifier may be identifier 1603 in the music playback information 1601. In this way, when the user of the music application is a non-member user and the first music is paid music, the user can view the audition segment of the first music in the control center.

[0229] Optionally, since the playing progress of the first music is continuously updated, S602-S607 may be executed continuously / irregularly / periodically so that the media broadcast control center can update the playing progress of the first music.

[0230] 3. The media playback control center receives the user operation to change the music playback information and updates the music information in the control center.

[0231] Exemplarily, the user operation of changing the music playing information may include but is not limited to any one of the following: pausing the playing of music, switching to playing the previous music, switching to playing the next music, adjusting the playing progress of the first music, and the like.

[0232] In some embodiments, the user operation of changing the music playing information can be divided into two categories, namely, the user operation of adjusting the playing progress of the first music and the user operation of not adjusting the playing progress of the first music.

[0233] 7A-7B are schematic diagrams showing the media broadcast control center responding to a user operation of not adjusting the playback progress of the first music.

[0234] Exemplarily, the user operation other than adjusting the playing progress of the first music may be a user operation of pausing the playing of the first music.

[0235] As shown in FIG7A , the electronic device 100 may receive a user input operation (e.g., a single click) for the start / pause music playback option in the user interface 1600. In response to the user input operation, the electronic device 100 may display the user interface 7100 shown in FIG7B . The user interface 7100 is similar to the user interface 1600, except that the display format of the start / pause music playback option in the user interface 7100 is switched from the currently playing state to the stopped state. When the music application pauses song 1, the media playback control center also updates the music playback information accordingly, i.e., the music playback information indicating that song 1 is paused is displayed in the control center.

[0236] The user operation other than adjusting the playing progress of the first music may also be other operations, such as switching to playing the previous music, switching to playing the next music, etc.

[0237] FIG8 shows an interactive schematic diagram of a media playback control center displaying and updating music playback information based on a user operation of a non-adjusted first music playback progress in a control center.

[0238] 1. The media broadcast control center receives a user operation other than adjusting the playback progress of the first music.

[0239] For example, the user operation other than adjusting the playing progress of the first music may be an input operation for the option of starting / pausing playing music as shown in FIG. 7A .

[0240] In other embodiments, other operations other than adjusting the playing progress of the first music may be performed, such as switching to playing the previous music, switching to playing the next music, etc.

[0241] 2. The media broadcast control center sends a first instruction to the media control module.

[0242] 3. The media control module sends a first instruction to the media session module.

[0243] 4. The media session module sends a first instruction to the music application.

[0244] In response to a user operation other than adjusting the playback progress of the first music, the media playback control center may send a first instruction to the media control module, the media control module may send the first instruction to the media session module, and the media session module may send the first instruction to the music application.

[0245] The first instruction is used to indicate the type of user operation. For example, the type of user operation may include but is not limited to starting / pausing music, switching to playing the previous music, switching to playing the next music, etc.

[0246] 5. In response to the first instruction, the music application plays the second music or pauses the first music.

[0247] After receiving the first instruction sent by the media session module, the music application may play the second music or pause the first music in response to the first instruction.

[0248] In some embodiments, if the first instruction indicates a user operation of pausing playing of music, then in response to the first instruction, the music application pauses playing of the first music.

[0249] In some embodiments, if the first instruction indicates a user operation of switching to playing the previous music or switching to playing the next music, then in response to the first instruction, the music application can continue to play the second music, which is the previous music or the next music of the first music.

[0250] In some embodiments, in response to the first instruction, the music application also needs to obtain updated music playback information so that the media playback control center can update the music information of the currently playing music.

[0251] Among them, the updated music playback information may include but is not limited to any one or more of the following: playback status (such as playing status or paused playback status), music name, music picture, singer name, total music duration, music playback progress, audition clip start time, audition clip end time, etc.

[0252] The updated music playing information may be different from the initial music playing information.

[0253] For example, when the user operation other than adjusting the playback progress of the first music is a user operation to pause the playback of the first music, the playback status in the updated music playback information is different from the playback status in the initial music playback information. For example, the playback status in the initial music playback information is the playing status, and the playback status in the updated music playback information is the paused playback status.

[0254] In some embodiments, when the user operation other than adjusting the playback progress of the first music is a user operation of pausing the playback of the first music, the updated music playback information may also include only the playback status (e.g., paused playback status). In this way, the amount of information sent by the music application to the media playback control center can be reduced.

[0255] For example, when the user operation other than adjusting the playback progress of the first music is to switch to playing the previous music or to switch to playing the next music, the music name, music picture, singer name, total music duration, music playback progress, audition clip start time, and audition clip end time in the updated music playback information are different from the music name, music picture, singer name, total music duration, music playback progress, audition clip start time, and audition clip end time in the initial music playback information.

[0256] 6. The music application sends the updated music playback information to the media session module.

[0257] 7. The media session module sends the updated music playback information to the media session service module.

[0258] 8. The media session service module sends the updated music playback information to the media playback control center.

[0259] 9. The media playback control center displays updated music playback information in the control center.

[0260] In response to the first instruction, after the music application obtains the updated music playback information, the music application sends the updated music playback information to the media session module, the media session module then sends the updated music playback information to the media session service module, and the media session service module then sends the updated music playback information to the media playback control center.

[0261] After receiving the updated music playback information sent by the media session service module, the media playback control center may display the updated music playback information in the control center.

[0262] For example, when the user operation other than adjusting the playback progress of the first music is to pause the playback of the first music, the media playback control center can display the user interface 7100 shown in Figure 7B based on the updated music playback information, that is, the media playback control center displays the music pause playback interface in the control center.

[0263] FIG9 shows a schematic flow chart of another audio playback method provided by the present application.

[0264] S901: The media broadcast control center receives a user operation other than adjusting the playback progress of a first piece of music.

[0265] User operations other than adjusting the playing progress of the first music may include but are not limited to any of the following: starting / pausing playing music, switching to playing the previous music, switching to playing the next music, etc.

[0266] Exemplarily, the user operation other than adjusting the playing progress of the first music may be an input operation for the start / pause music playing option shown in FIG. 7A , which switches the first music from the start playing pause state to the pause playing state.

[0267] S902: The media broadcast control center sends a first instruction to the media control module.

[0268] S903: The media control module sends a first instruction to the media session module.

[0269] S904: The media session module sends a first instruction to the music application.

[0270] In response to a user operation other than adjusting the playback progress of the first music, the media playback control center sends a first instruction to the media control module, the media control module sends the first instruction to the media session module, and the media session module sends the first instruction to the music application.

[0271] The first instruction is used to indicate the type of user operation. For example, the type of user operation may include but is not limited to starting / pausing music, switching to playing the previous music, switching to playing the next music, etc.

[0272] S905: In response to the first instruction, the music application plays the second music or pauses the first music.

[0273] After receiving the first instruction sent by the media session module, the music application may play the second music or pause the first music in response to the first instruction.

[0274] In some embodiments, if the first instruction indicates a user operation of pausing playing of music, then in response to the first instruction, the music application pauses playing of the first music.

[0275] In some embodiments, if the first instruction indicates a user operation of switching to playing the previous music or switching to playing the next music, then in response to the first instruction, the music application can continue to play the second music, which is the previous music or the next music of the first music.

[0276] S906: The music application obtains updated music playback information.

[0277] Updated music playback information may include but is not limited to any one or more of the following: playback status (such as playing status or paused playback status), music name, music picture, singer name, total music duration, music playback progress, audition clip start time, audition clip end time, etc.

[0278] The updated music playing information may be different from the initial music playing information.

[0279] For example, when the user operation other than adjusting the playback progress of the first music is a user operation to pause the playback of the first music, the playback status in the updated music playback information is different from the playback status in the initial music playback information. For example, the playback status in the initial music playback information is the playing status, and the playback status in the updated music playback information is the paused playback status.

[0280] In some embodiments, when the user operation other than adjusting the playback progress of the first music is a user operation of pausing the playback of the first music, the updated music playback information may also include only the playback status (e.g., paused playback status). In this way, the amount of information sent by the music application to the media playback control center can be reduced.

[0281] For example, when the user operation other than adjusting the playback progress of the first music is to switch to playing the previous music or to switch to playing the next music, the music name, music picture, singer name, total music duration, music playback progress, audition segment start time, and audition segment end time in the updated music playback information are different from the music name, music picture, singer name, total music duration, music playback progress, audition segment start time, and audition segment end time in the initial music playback information.

[0282] The audition clip start time may refer to the start time of the music audition clip, and the audition clip end time may refer to the end time of the music audition clip.

[0283] In some embodiments, when the start time of the music audition segment is the start time of the first music or the second music, the start time of the audition segment in the updated music playback information can be the same as the start time of the first music or the second music, for example, it can be time 0.

[0284] In some embodiments, when the end time of the music audition segment is the end time of the first music, the end time of the audition segment in the initial music playback information of the first music can be the same as the stop time of the first music or the second music.

[0285] S907: The music application sends the updated music playing information to the media session module.

[0286] S908: The media session module sends the updated music playing information to the media session service module.

[0287] S909: The media session service module sends the updated music playback information to the media playback control center.

[0288] After the music application obtains the updated music playback information, the music application sends the updated music playback information to the media session module, the media session module then sends the updated music playback information to the media session service module, and the media session service module then sends the updated music playback information to the media broadcast control center, so that the media broadcast control center can display the music playback interface of the first music or the second music in the control center based on the updated music playback information.

[0289] S910: The media playback control center displays a second user interface in the control center, where the second user interface includes updated music playback information.

[0290] After receiving the updated music playing information sent by the media session service module, the media play control center displays a second user interface in the control center, where the second user interface includes the updated music playing information.

[0291] Among them, the second user interface may include the playing status, music name, music picture, singer name, total music duration, and music playing progress.

[0292] In some embodiments, when the user of the music application is a member user and the first music or the second music is paid music, or the user of the music application is a member user and the first music or the second music is free music, or the user of the music application is a non-member user and the first music or the second music is free music, the second user interface may not include the start time and the end time of the audition segment. In this way, the electronic device 100 can quickly view the music information of the music currently playing in the music application in the control center without opening the music application.

[0293] In some embodiments, when the user of the music application is a non-member user and the first music or the second music is paid music, the second user interface may include an audition segment start identifier and / or an audition segment end identifier, the audition segment start identifier is used to indicate the audition segment start time, and the audition segment end identifier is used to indicate the audition segment end time. Exemplarily, the second user interface may be user interface 7100 shown in FIG7B , user interface 7100 includes updating music playback information, the audition segment start identifier may be identifier 1602, and the audition segment end identifier may be identifier 1603. In this way, when the user of the music application is a non-member user and the first music is paid music, the user can view the audition segment of the first music or the second music in the control center.

[0294] Optionally, when the first music is paused, the playing progress of the first music also stops updating, and S906-S910 do not need to be executed continuously / irregularly / periodically.

[0295] Optionally, when the music application plays the second music, since the playing progress of the second music is continuously updated, S906-S910 can be executed continuously / irregularly / periodically so that the media playback control center can update the playing progress of the second music.

[0296] 10A to 10D are schematic diagrams showing the media playback control center responding to a user operation of adjusting the playback progress of the first music.

[0297] The first music may be paid music or free music.

[0298] If the first music is paid music and the user of the music application is a member, the first user interface may not include a preview segment start marker and a preview segment end marker. For example, the first user interface may be user interface 1500 shown in FIG1G . Optionally, the first user interface may also include a preview segment start marker and a preview segment end marker. The preview segment start marker may be located at the beginning of the first music, and the preview segment end marker may be located at the end of the first music.

[0299] If the first music is paid music and the user of the music application is a non-member user, the first user interface may include a trial listening segment start mark and / or a trial listening segment end mark. For example, the first user interface may be user interface 1600 shown in FIG4D .

[0300] In the case that the first music is free music, when the user of the music application is a non-member user or a member user, the first user interface may not include the audition segment start mark and the audition segment end mark. For example, the first user interface may be the user interface 1500 shown in Figure 1G.

[0301] First, the specific implementation of the media broadcast control center responding to the user operation of adjusting the playback progress of the first music when the first music is paid music is introduced.

[0302] 10A-10B show a UI diagram of a media broadcast control center responding to a user operation of adjusting the playback progress of the first music when the first music is paid music and the user of the music application is a non-member user.

[0303] As shown in Figure 10A, the initial playing progress of the first music is located at position 1604 shown in Figure 10A. The user can speed up the playing progress of the first music, and the user can also slow down the playing progress of the first music.

[0304] For example, as shown in FIG. 10B , the electronic device 100 may receive a user operation of dragging the play progress bar from position 1604 to position 1605 .

[0305] In response to the user's drag operation, when position 1605 is still within the audition segment of the first music, as shown in FIG10B , electronic device 100 may display user interface 7200 to adjust the playback progress of the first music to a target playback progress, which may be position 1605 shown in user interface 7200. The target playback progress is different from the initial playback progress.

[0306] Figures 10C-10D show UI diagrams of the media broadcast control center responding to the user's operation of adjusting the playback progress of the first music when the first music is paid music and the user of the music application is a member user, or the first music is free music and the user of the music application is a member user, or the first music is free music and the user of the music application is a non-member user.

[0307] If the first music is paid music and the user of the music application is a member, or if the first music is free music and the user of the music application is a member, or if the first music is free music and the user of the music application is a non-member, the user can listen to the entire content of the first music. The user can adjust the playback progress of the first music to any position.

[0308] As shown in Figure 10C, the initial playing progress of the first music is located at position 1604 shown in Figure 10C. The user can speed up the playing progress of the first music, or the user can slow down the playing progress of the first music.

[0309] For example, as shown in FIG. 10C , the electronic device 100 may receive a user operation of dragging the play progress bar from position 1604 to position 1607 .

[0310] In response to the user's drag operation, since the user can listen to the entire content of the first music, as shown in FIG10D , the electronic device 100 can display a user interface 7300 and adjust the playback progress of the first music to a target playback progress, which can be position 1607 shown in the user interface 7300. The target playback progress is different from the initial playback progress.

[0311] FIG11 shows an interactive schematic diagram of a media playback control center displaying and updating music playback information based on a user operation of adjusting the playback progress of a first piece of music in a control center.

[0312] 1. The media playback control center receives a user operation to adjust the first music to the target playback progress.

[0313] For example, the user operation of adjusting the play progress of the first music may be the user operation of dragging the play progress bar from position 1604 to position 1605 as shown in FIG. 10A .

[0314] Exemplarily, the user operation of adjusting the play progress of the first music may also be the user operation of dragging the play progress bar from position 1604 to position 1607 as shown in FIG. 10C .

[0315] 2. The media broadcast control center determines that the target playback progress is within the trial listening segment of the first music, or that the current user has the right to listen to the full content of the first music.

[0316] In response to the user operation of adjusting the first music to the target playback progress, the media playback control center can determine that the target playback progress is within the audition segment of the first music, or that the current user has the authority to listen to the complete content of the first music.

[0317] If the first music is paid music and the user of the music application is a member, or if the first music is free music and the user of the music application is a member, or if the first music is free music and the user of the music application is a non-member, the current user has the right to listen to the entire content of the first music. The user can adjust the playback progress of the first music to any position.

[0318] 3. The media broadcast control center sends a first instruction to the media control module.

[0319] 4. The media control module sends a first instruction to the media session module.

[0320] 5. The media session module sends a first instruction to the music application.

[0321] In response to the user operation of adjusting the first music to the target playback progress, when the target playback progress is within the audition segment of the first music, or the current user has the authority to listen to the complete content of the first music, the media broadcast control center can send a first instruction to the media control module, the media control module then sends the first instruction to the media session module, and the media session module then sends the first instruction to the music application.

[0322] The first instruction is used to indicate the type of user operation. For example, the type of user operation may include adjusting the first music to the target playback progress, etc.

[0323] Optionally, the first instruction may carry target playback progress information.

[0324] Optionally, the target playback progress information may also be sent to the music application independently of the first instruction, and this application does not limit this.

[0325] 6. In response to the first instruction, the music application plays the first music and adjusts the playing progress to the target.

[0326] After receiving the first instruction sent by the media session module, the music application adjusts the first music to the target playback progress in response to the first instruction.

[0327] In some embodiments, in response to the first instruction, the music application also needs to obtain updated music playback information so that the media playback control center can update the music information of the currently playing music.

[0328] Among them, the updated music playback information may include but is not limited to any one or more of the following: playback status (such as playing status or paused playback status), music name, music picture, singer name, total music duration, music playback progress, audition clip start time, audition clip end time, etc.

[0329] The updated music playing information may be different from the initial music playing information. For example, the music playing progress in the updated music playing information is different from the music playing progress in the initial music playing information.

[0330] In some embodiments, the updated music playing information may also include only the music playing progress, which can reduce the amount of information sent by the music application to the media play control center.

[0331] 7. The music application sends the updated music playback information to the media session module.

[0332] 8. The media session module sends the updated music playback information to the media session service module.

[0333] 9. The media session service module sends the updated music playback information to the media playback control center.

[0334] 10. The media playback control center displays updated music playback information in the control center.

[0335] In response to the first instruction, after the music application obtains the updated music playback information, the music application sends the updated music playback information to the media session module, the media session module then sends the updated music playback information to the media session service module, and the media session service module then sends the updated music playback information to the media playback control center.

[0336] After receiving the updated music playback information sent by the media session service module, the media playback control center may display the updated music playback information in the control center.

[0337] Exemplarily, the media playback control center may display the user interface 7200 shown in FIG. 10B or the user interface 7300 shown in FIG. 10D based on the updated music playback information, that is, the media playback control center displays the target playback progress of the first music in the control center.

[0338] FIG. 12 shows another interactive schematic diagram of a media playback control center displaying updated music playback information in the control center.

[0339] S1201: The media broadcast control center obtains the playback progress of the first music.

[0340] In some embodiments, the electronic device 100 can adjust the playing progress of the first music through user operation.

[0341] For example, the user operation of adjusting the play progress of the first music may be the user operation of dragging the play progress bar from position 1604 to position 1605 as shown in FIG. 10A .

[0342] Exemplarily, the user operation of adjusting the play progress of the first music may also be the user operation of dragging the play progress bar from position 1604 to position 1607 as shown in FIG. 10C .

[0343] S1202: The media broadcast control center determines that the target playback progress is within the audition segment of the first music.

[0344] Based on the description of the embodiments in Figures 5 and 6, when the electronic device 100 receives a user's request to play the first music in the music application, the music application sends the initial music playback information of the first music to the media playback control center. The media playback control center can obtain an audition clip of the first music from the initial music playback information. The audition clip of the first music includes the start time and the end time of the audition clip of the first music.

[0345] For example, if the first music is paid music and the user of the music application is a member, or if the first music is free music and the user of the music application is a member, or if the first music is free music and the user of the music application is a non-member, and the current user has permission to listen to the full content of the first music, then the start time of the trial listening segment in the music playback information is the same as the start time of the first music, and the end time of the trial listening segment in the music playback information is the same as the stop time of the first music. That is, the trial listening segment of the first music is the full content of the first music.

[0346] If the first song is paid music and the user of the music application is a non-member, the current user does not have permission to listen to the entire first song and can only listen to a portion of the first song. That is, the preview clip of the first song is less than the entire first song. At least one of the start time and the end time of the preview clip differs from the start time and the stop time of the first song.

[0347] Exemplarily, the initial music playback information of the first music may include multiple fields, such as a VIP start station field, a VIP stop station field, a set meta data field, a set play back state field, a set play picture field, a set music name field, a set musician name field, and a set play status field. The media playback control center may obtain the start time of the audition segment of the first music from the VIP start station field and the end time of the audition segment of the first music from the VIP stop station field.

[0348] After the media broadcast control center obtains the audition clip of the first music piece, the media broadcast control center can determine whether the target playback progress is within the audition clip of the first music piece. For example, if the target playback progress is after the start time of the audition clip of the first music piece and before the end time of the audition clip of the first music piece, the media broadcast control center can determine that the target playback progress is within the audition clip of the first music piece.

[0349] S1203: The media broadcast control center sends a first instruction (target playback progress) to the media control module.

[0350] S1204: The media control module sends a first instruction (target playback progress) to the media session module.

[0351] S1205: The media session module sends a first instruction (target playback progress) to the music application.

[0352] In response to the user operation of adjusting the first music to the target playback progress, when the target playback progress is within the audition segment of the first music, or the current user has the authority to listen to the complete content of the first music, the media broadcast control center can send a first instruction to the media control module, the media control module then sends the first instruction to the media session module, and the media session module then sends the first instruction to the music application.

[0353] The first instruction is used to indicate the type of user operation. For example, the type of user operation may include adjusting the first music to the target playback progress, etc.

[0354] Optionally, the first instruction may carry target playback progress information.

[0355] Optionally, the target playback progress information may also be sent to the music application independently of the first instruction, and this application does not limit this.

[0356] S1206: In response to the first instruction, the music application adjusts the first music to the target playback progress.

[0357] After receiving the first instruction sent by the media session module, the music application adjusts the first music to the target playback progress in response to the first instruction.

[0358] S1207: The music application obtains updated music playback information.

[0359] The first instruction to update the music playback information may include but is not limited to any one or more of the following: playback status (such as playing status or paused playback status), music name, music picture, singer name, total music duration, music playback progress, audition clip start time, audition clip end time, etc.

[0360] The updated music playing information may be different from the initial music playing information. For example, the music playing progress in the updated music playing information is different from the music playing progress in the initial music playing information.

[0361] In some embodiments, the updated music playing information may also include only the music playing progress, which can reduce the amount of information sent by the music application to the media play control center.

[0362] S1208: The music application sends the updated music playing information to the media session module.

[0363] S1209: The media session module sends the updated music playing information to the media session service module.

[0364] S1210: The media session service module sends the updated music playback information to the media playback control center.

[0365] In response to the first instruction, after the music application obtains the updated music playback information, the music application sends the updated music playback information to the media session module, the media session module then sends the updated music playback information to the media session service module, and the media session service module then sends the updated music playback information to the media playback control center.

[0366] S1211: The media playback control center displays a third user interface in the control center, where the third user interface includes updated music playback information.

[0367] After receiving the updated music playback information sent by the media session service module, the media playback control center may display a third user interface in the control center, where the third user interface includes the updated music playback information.

[0368] Among them, the second user interface may include the playing status, music name, music picture, singer name, total music duration, and music playing progress.

[0369] For example, the third user interface may be the user interface 7200 shown in FIG. 10B or the user interface 7300 shown in FIG. 10D .

[0370] Optionally, since the playback progress of the first music is continuously updated, S1207-S1211 may be executed continuously / irregularly / periodically so that the media broadcast control center can update the playback progress of the second music.

[0371] In some embodiments, the music application can periodically / irregularly send the updated playback progress of the first music to the media broadcast control center, so that the media broadcast control center can periodically / irregularly update the playback progress of the first music. Before the music application sends the updated playback progress to the media broadcast control center, the music application will determine whether the playback progress sent last time is the end playback time of the first music. When the playback progress sent last time is the end playback time of the first music, the music application automatically switches to playing the second music, and the music application sends the music playback information of the second music to the media broadcast control center, so that the media broadcast control center can display the music playback information of the second music in the control center. When the playback progress sent last time is not the end playback time of the first music, the music application also needs to send the updated playback progress of the first music to the media broadcast control center, wherein the updated playback progress of the first music is later than the playback progress sent last time.

[0372] 13A-13B show another UI diagram of the media broadcast control center responding to the user operation of adjusting the playback progress of the first music when the first music is paid music and the user of the music application is a non-member user.

[0373] In some embodiments, when a user drags the playback progress of a first music track outside the audition segment, in one possible implementation, the electronic device 100 rewinds the playback progress of the first music track to the initial playback progress, which is the playback progress before the user adjusted the playback progress of the first music track. In other possible implementations, the electronic device 100 rewinds the playback progress of the first music track to the start of the audition segment. In other possible implementations, the electronic device 100 automatically switches to playing the second music track, thereby notifying the user that they cannot listen to music content outside the audition segment.

[0374] For example, the embodiment of the present application is described by taking the example that when the user drags the playback progress of the first music out of the audition segment, the electronic device 100 rewinds the playback progress of the first music to the first progress.

[0375] As shown in Figure 13A, the initial playing progress of the first music is located at position 1604 shown in Figure 13A. The user can speed up the playing progress of the first music, and the user can also slow down the playing progress of the first music.

[0376] For example, as shown in FIG. 13A , the electronic device 100 may receive a user operation of dragging the playback progress bar from position 1604 to position 1606 .

[0377] In response to the user's dragging operation, since position 1606 is outside the audition segment, as shown in Figure 13B, the electronic device 100 can display the user interface 1600, that is, the playback progress of the first music is rewound to the initial playback progress to prompt the user that the audio content outside the audition segment cannot be listened to.

[0378] In some embodiments, in response to the user's dragging operation, when the position 1606 is outside the audition clip, the electronic device 100 may also display the prompt information 1608 shown in Figure 13B in the control center. The prompt information 1608 includes the text "You can currently only listen to the audition clip. You can listen to the full content after purchasing a membership. Do you want to purchase a membership?" This prompt information is used to remind the user that the playback progress of the first music cannot be adjusted beyond the audition clip. The prompt information 1608 also includes a purchase membership option and a cancel option. The user can purchase a membership of the music application through the purchase membership option. After purchasing the membership of the music application, the user can listen to the full content of the first music, and the user can also adjust the playback progress of the music application at will. The user can also choose not to purchase a membership of the music application through the cancel option. The user can still only listen to the audition clip of the music application, and the user can only adjust the playback progress of the music application within the audition clip.

[0379] Optionally, in response to the user's dragging operation, when the position 1606 is outside the audition segment, the electronic device 100 may not display the prompt information 1608 shown in FIG. 13B , and this application does not impose any limitation on this.

[0380] FIG. 14 shows another interactive schematic diagram of a media playback control center displaying and updating music playback information based on a user operation of adjusting the playback progress of a first piece of music in a control center.

[0381] 1. The media playback control center receives a user operation to adjust the first music to the target playback progress.

[0382] For example, the user operation of adjusting the play progress of the first music may be the user operation of dragging the play progress bar from position 1604 to position 1606 as shown in FIG. 13A .

[0383] 2. When it is determined that the target playback progress is outside the music audition segment, the media broadcast control center will rewind the playback progress to the initial playback progress.

[0384] 3. The media playback control center continues to display the initial music playback information.

[0385] In response to a user operation of adjusting the first music to a target playback progress, the media playback control center may determine whether the target playback progress is within the audition segment.

[0386] When it is determined that the target playback progress is outside the music audition segment, the media playback control center can rewind the playback progress to the initial playback progress to prompt the user that the audio content outside the audition segment cannot be listened to.

[0387] When it is determined that the target playback progress is within the music audition segment, the media playback control center can adjust the playback progress to the target playback progress. For details, please refer to the description in the embodiments of Figures 11 and 12.

[0388] In response to the media broadcast control center rewinding the playback progress to the initial playback progress, the media broadcast control center does not need to obtain updated music playback information from the music application, and the media broadcast control center still displays the initial music playback information.

[0389] FIG15 shows a schematic flow chart of another audio playback method provided in the present application.

[0390] S1501: The media broadcast control center receives a user operation for adjusting the playback progress of a first piece of music.

[0391] For example, the user operation of adjusting the play progress of the first music may be the user operation of dragging the play progress bar from position 1604 to position 1606 as shown in FIG. 13A .

[0392] S1502: When the target playback progress is outside the music audition segment, the media playback control center rewinds the playback progress to the initial playback progress.

[0393] In response to a user operation of adjusting the first music to a target playback progress, the media playback control center may determine whether the target playback progress is within the audition segment.

[0394] When it is determined that the target playback progress is within the music audition segment, the media playback control center can adjust the playback progress to the target playback progress. For details, please refer to the description in the embodiments of Figures 11 and 12.

[0395] When it is determined that the target playback progress is outside the music audition segment, the media playback control center can rewind the playback progress to the initial playback progress to prompt the user that the audio content outside the audition segment cannot be listened to.

[0396] S1503: The media broadcast control center displays a first user interface in the control center, where the first user interface includes initial music playback information of the first music.

[0397] In response to the media broadcast control center rewinding the playback progress to the initial playback progress, the media broadcast control center does not need to obtain updated music playback information from the music application, and the media broadcast control center still displays the initial music playback information.

[0398] The media playback control center may display a first user interface in the control center, where the first user interface includes initial music playback information of the first music.

[0399] For example, the first user interface may be the user interface 1600 shown in FIG4D . The initial music playing information may be the music playing information 1601 shown in the user interface 1600 .

[0400] In some embodiments, in response to the user's drag operation, when the target playback progress is outside the audition clip, the electronic device 100 may also display the prompt information 1608 shown in Figure 13B in the control center. The prompt information 1608 includes the text "You can only listen to the audition clip at present. You can listen to the full content after purchasing a membership. Do you want to purchase a membership?" This prompt information is used to remind the user that the playback progress of the first music cannot be adjusted beyond the audition clip. The prompt information 1608 also includes a purchase membership option and a cancel option. The user can purchase a membership of the music application through the purchase membership option. After purchasing the membership of the music application, the user can listen to the full content of the first music, and the user can also adjust the playback progress of the music application at will. The user can also choose not to purchase a membership of the music application through the cancel option. The user can still only listen to the audition clip of the music application, and the user can only adjust the playback progress of the music application within the audition clip.

[0401] Optionally, in response to the user's dragging operation, when the target playback progress is outside the audition segment, the electronic device 100 may not display the prompt information 1608 shown in FIG. 13B , and this application does not impose any limitation on this.

[0402] FIG16 shows a flow chart of another audio playback method provided in the present application.

[0403] S1601: The first application receives and responds to a first operation, and plays the first music in the first application.

[0404] Optionally, the first application may be a music application on the electronic device.

[0405] S1602. The first application sends the first music playback information of the first music to the media broadcast control center application; wherein the first music playback information includes: the total duration of the first music, the playback progress of the first music, the start time of the audition segment of the first music, and the end time of the audition segment of the first music.

[0406] Optionally, the first application may also send other music information to the media playback control center application, for example, the first music playback information may also include any one or more of the following: the playback status of the first music, the picture of the first music, the name of the first music, and the name of the singer of the first music.

[0407] S1603: The electronic device displays a first interface including a media playback control center application, where the first interface includes first music playback information.

[0408] Optionally, the electronic device may display the first interface in a first area, where the first area is a display area outside the first application. For example, the first area may be a display area on a control center.

[0409] Exemplarily, the first interface may be the user interface 1600 shown in FIG. 4D .

[0410] Through this method, the first application can send information such as the total duration of the first music, the start time of the audition segment, and the end time of the audition segment to the media broadcast control center application, so that the media broadcast control center application can display the total duration of the first music and the audition segment of the first music. The user can view the audition segment of the first music in the media broadcast control center application.

[0411] In one possible implementation, before the first application receives and responds to the first user operation, the method also includes: the electronic device displays a first prompt message, the first prompt message is used to prompt the user to download a first configuration file, the first configuration file includes multiple fields, the multiple fields include a music audition segment start field and a music audition segment end field; the electronic device receives and responds to the user's operation on the first option in the first prompt message, and downloads the first configuration file.

[0412] For example, the first prompt information may be the prompt bar 5100 shown in Figure 4A. The first option may be the confirmation option shown in Figure 4A.

[0413] In this way, the first application on the electronic device can download the first configuration file for updating, so that the first application can report the start time and the end time of the audition segment of the music to the media broadcast control center application.

[0414] In a possible implementation, before the first application sends the first music playback information of the first music to the media playback control center application, the method further includes: the first application obtains the first music playback information based on the first configuration file.

[0415] Exemplarily, the first configuration file includes multiple fields, such as at least a set meta data field, a VIP start station field, a VIP stop station field, and a set play back state field (which is a field related to music playback progress). The VIP start station field is a field related to the start time of the audition segment. The VIP stop station field is a field related to the end time of the audition segment. The set meta data field is a field related to the total duration of the music. The set play back state field is a field related to the music playback progress.

[0416] In other embodiments, the first configuration file may further include other fields, such as a "set play picture" field, a "set music name" field, a "set musician name" field, and a "set play status" field. The "set play picture" field relates to a music picture field, the "set music name" field relates to a music name field, the "set musician name" field relates to a singer name field, and the "set play status" field relates to a play status field.

[0417] In this way, after the first application downloads the first configuration file for updating, the first application can obtain the first configuration file and generate music playback information based on multiple fields in the first configuration file.

[0418] In one possible implementation, after the media broadcast control center application displays the first interface on the first display area, the method also includes: the media broadcast control center application receives a second operation of the user dragging the playback progress of the first music from the first moment to the second moment; when the second moment is outside the audition segment of the first music, the media broadcast control center application rewinds the playback progress of the first music to the first moment.

[0419] Exemplarily, the first moment may be the moment corresponding to the position 1604 shown in FIG. 13A .

[0420] The second moment may be the moment corresponding to the position 1606 shown in FIG. 13A .

[0421] Exemplarily, the first music playback information may include multiple fields, such as a VIP start station field, a VIP stop station field, a set meta data field, a set play back state field, etc. The media playback control center application may obtain the start time of the first music audition segment from the VIP start station field and obtain the end time of the first music audition segment from the VIP stop station field.

[0422] After the media broadcast control center application obtains the first music audition clip, the media broadcast control center application can determine whether the second moment is within the first music audition clip. For example, if the second moment is before the start time of the first music audition clip or after the end time of the first music audition clip, the media broadcast control center can determine that the second moment is outside the first music audition clip.

[0423] In response to the second moment being outside the first track's preview, the media broadcast control center application rewinds the first track's playback progress to the first moment. Because the media broadcast control center application retrieves the first track's preview, it can determine whether the second moment is outside the first track's preview and directly handle the process, rewinding to the initial playback time. This eliminates the need for the first application to respond, saving additional interaction between the first application and the media broadcast control center application.

[0424] In one possible implementation, when the second moment is within the audition segment of the first music, the media broadcast control center application sends a first instruction to the first application; in response to the first instruction, the first application continues to play the first music from the second moment; the first application sends the updated playback progress of the first music to the media broadcast control center application, and the updated playback progress includes the second moment.

[0425] For example, the first moment may be the moment corresponding to the position 1604 shown in FIG10A , and the second moment may be the moment corresponding to the position 1605 shown in FIG10A .

[0426] For example, the first moment may be the moment corresponding to the position 1604 shown in FIG10C , and the second moment may be the moment corresponding to the position 1607 shown in FIG10D .

[0427] After the media broadcast control center application obtains the audition clip of the first music piece, the media broadcast control center application can determine whether the second moment is within the audition clip of the first music piece. For example, if the second moment is after the start time of the audition clip of the first music piece and before the end time of the audition clip of the first music piece, the media broadcast control center can determine that the second moment is within the audition clip of the first music piece. Because the playback progress of the first music piece has changed, the first application needs to adjust the playback progress of the first music piece.

[0428] Optionally, the first application is not limited to sending only updated playback progress. It can also send other information to the media broadcast control center, such as the playback status of the first music, the picture of the first music, the name of the first music, the name of the singer of the first music, the total length of the first music, the start time of the audition clip of the first music, the end time of the audition clip of the first music, etc. This application does not limit this.

[0429] In a possible implementation, when the user of the first application is a non-member user and the first music is paid music, the duration of the trial listening segment of the first music is less than the total duration of the first music.

[0430] In one possible implementation, when the user of the first application is a member user and the first music is paid music, or the user of the first application is a member user and the first music is free music, or the user of the first application is a non-member user and the first music is free music, the length of the audition clip of the first music is equal to the total length of the first music.

[0431] In one possible implementation, after the first application sends the first music playback information of the first music to the media broadcast control center application, the method also includes: the first application determines whether the playback progress of the first music in the first music playback information is the end time of the first music; when it is determined that the playback progress of the first music in the first music playback information is the end time of the first music, the first application obtains the music playback information of the second music; the first application sends the music playback information of the second music to the media broadcast control center application; wherein the music playback information of the second music includes: the total duration of the second music, the playback progress of the second music, the start time of the audition segment of the second music, and the end time of the audition segment of the second music; the electronic device displays a second interface including the media broadcast control center application, and the second interface includes the music playback information of the second music.

[0432] The music application can periodically / irregularly send the updated playback progress of the first music to the media broadcast control center, so that the media broadcast control center can periodically / irregularly update the playback progress of the first music. Before the music application sends the updated playback progress to the media broadcast control center, the music application will determine whether the playback progress sent last time (for example, the playback progress of the first music in the first music playback information) is the end playback time of the first music. When the playback progress sent last time is the end playback time of the first music, the music application automatically switches to playing the second music, and the music application sends the music playback information of the second music to the media broadcast control center, so that the media broadcast control center can display the music playback information of the second music in the control center. When the playback progress sent last time is not the end playback time of the first music, the music application also needs to send the updated playback progress of the first music to the media broadcast control center, where the updated playback progress of the first music is later than the playback progress sent last time.

[0433] In one possible implementation, the electronic device also includes a media session module and a media session service module; the first application sends the first music playback information of the first music to the media broadcast control center application, specifically including: the first application sends the first music playback information to the media session module; the media session module sends the first music playback information to the media session service module; the media session service module sends the first music playback information to the media broadcast control center application.

[0434] In one possible implementation, the electronic device also includes a media session module and a media control module; the media broadcast control center application sends a first instruction to the first application, specifically including: the media broadcast control center application sends the first instruction to the media control module; the media control module sends the first instruction to the first application.

[0435] The above are only some of the embodiments and implementations of this application. The scope of protection of this application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

[0436] It is understood that the various user interfaces described in the embodiments of this application are merely exemplary interfaces and do not limit the scope of this application. In other embodiments, the user interface may adopt a different interface layout, include more or fewer controls, and add or remove other functional options. As long as they are based on the same inventive concept provided by this application, they are all within the scope of protection of this application.

[0437] It should be noted that, without causing any contradiction or conflict, any feature in any embodiment of the present application, or any part of any feature, can be combined, and the technical solution after the combination is also within the scope of the embodiments of the present application.

[0438] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. An audio playing method, characterized in that, The electronic device includes a first application and a media playback control center application, and the method includes: The first application receives and responds to a first operation, and plays a first piece of music in the first application; The first application sends first music playback information of the first piece of music to the media playback control center application; wherein, the first music playback information includes: the total duration of the first piece of music, the playback progress of the first piece of music, the start time of the audition segment of the first piece of music, and the end time of the audition segment of the first piece of music; The electronic device displays a first interface including the media playback control center application, and the first interface includes the first music playback information.

2. The method according to claim 1, wherein Before the first application receives and responds to the first user operation, the method further includes: The electronic device displays a first prompt message for prompting the user to download a first configuration file, the first configuration file includes multiple fields, and the multiple fields include a music audition segment start field and a music audition segment end field; The electronic device receives and responds to the user's operation on the first option in the first prompt message, and downloads the first configuration file.

3. The method according to claim 2, characterized in that, Before the first application sends the first music playback information of the first piece of music to the media playback control center application, the method further includes: The first application obtains the first music playback information based on the first configuration file.

4. The method according to any one of claims 1 to 3, characterized in that After the media playback control center application displays the first interface in the first display area, the method further includes: The media playback control center application receives a second operation in which the user drags the playback progress of the first piece of music from a first time to a second time; When the second time is outside the audition segment of the first piece of music, the media playback control center application reverts the playback progress of the first piece of music back to the first time.

5. The method according to claim 4, characterized in that The method further includes: When the second time is within the audition segment of the first piece of music, the media playback control center application sends a first instruction to the first application; In response to the first instruction, the first application continues to play the first piece of music from the second time; The first application sends the updated playback progress of the first piece of music to the media playback control center application, and the updated playback progress includes the second time.

6. The method according to claim 4 or 5, characterized in that, When the user of the first application is a non-member user and the first piece of music is a paid music, the duration of the audition segment of the first piece of music is less than the total duration of the first piece of music.

7. The method according to claim 5, wherein When the user of the first application is a member user, the first piece of music is a paid music, or when the user of the first application is a member user, the first piece of music is a free music, or when the user of the first application is a non-member user and the first piece of music is a free music, the duration of the audition segment of the first piece of music is equal to the total duration of the first piece of music.

8. The method according to any one of claims 1-7, characterized in that, After the first application sends the first music playback information of the first piece of music to the media playback control center application, the method further includes: The first application determines whether the playback progress of the first piece of music in the first music playback information is the end time of the first piece of music; When it is determined that the playing progress of the first music in the first music playing information is the end time of the first music, the first application obtains the music playing information of the second music; The first application sends the music playing information of the second music to the media playback control center application; wherein, the music playing information of the second music includes: the total duration of the second music, the playing progress of the second music, the start time of the audition segment of the second music, and the end time of the audition segment of the second music; The electronic device displays a second interface including the media playback control center application, and the second interface includes the music playing information of the second music.

9. The method according to any one of claims 1-8, characterized in that, The electronic device further includes a media session module and a media session service module; the first application sending the first music playing information of the first music to the media playback control center application specifically includes: The first application sends the first music playing information to the media session module; The media session module sends the first music playing information to the media session service module; The media session service module sends the first music playing information to the media playback control center application.

10. The method according to any one of claims 5-7, characterized in that, The electronic device further includes a media session module and a media control module; the media playback control center application sending the first instruction to the first application specifically includes: The media playback control center application sends the first instruction to the media control module; The media control module sends the first instruction to the first application.

11. The method according to any one of claims 1 to 10, characterized in that, The first music playing information further includes any one or more of the following: the playing state of the first music, the picture of the first music, the name of the first music, and the name of the singer of the first music.

12. An electronic device, characterized in that, The electronic device includes a memory and a processor; wherein, the memory and the processor are coupled, and the memory is used to store a computer program. When the processor executes and calls the computer program, the electronic device executes the method according to any one of claims 1-11.

13. A computer-readable storage medium, comprising instructions, characterized in that, When the instruction runs on the electronic device, the electronic device executes the method according to any one of claims 1-11.

Citation Information

Patent Citations

  • Song playing method, device and system

    CN110309348A

  • Multimedia playing method and device

    CN111935357A

  • Display method, mobile terminal and storage medium

    CN113434107A

  • Playing notification display method and device

    CN117177022A

  • Mulitple master music playback

    US20200081681A1