Display method, device and storage medium of audio playing interface

Abstract

The application discloses a display method and device of an audio playing interface and a storage medium, and belongs to the technical field of audio playing. The method comprises the following steps: displaying an audio playing interface, wherein the audio playing interface is used for playing target audio; displaying an audio playing element in the audio playing interface, wherein the audio playing element is used for presenting the effect of playing the target audio; and displaying a dynamic element on the first side of the audio playing element, wherein at least one of the display style and the movement mode of the dynamic element is related to the characteristics of the target audio. The application can improve the relevance between the display element in the audio playing interface and the target audio.

Description

Technical Field

[0001] This application relates to the field of audio playback technology, and in particular to a method, device and storage medium for displaying an audio playback interface. Background Technology

[0002] During the playback of the target audio, the client will display the corresponding audio playback interface.

[0003] In related technologies, the client displays the album art, lyrics, and playback controls for controlling the playback of the target audio in the audio playback interface, such as pause controls, playback progress controls, audio switching controls, and volume controls.

[0004] Displaying the audio playback interface in the above manner has the problem of weak correlation between the displayed elements in the audio playback interface and the target audio. Summary of the Invention

[0005] This application provides a method, device, and storage medium for displaying an audio playback interface, which can improve the correlation between display elements in the audio playback interface and the target audio. The technical solution is as follows: According to one aspect of this application, a method for displaying an audio playback interface is provided, the method comprising: The audio playback interface is displayed, and the audio playback interface is used to play the target audio; The audio playback interface displays an audio playback element, which is used to present the effect of the target audio being played. A dynamic element is displayed on the first side of the audio playback element, and at least one of the display style and movement mode of the dynamic element is related to the characteristics of the target audio.

[0006] According to another aspect of this application, a display device for an audio playback interface is provided, the device comprising: The display module is used to display the audio playback interface, which is used to play the target audio. The display module is also used to display audio playback elements in the audio playback interface, the audio playback elements being used to present the effect of the target audio being played; The display module is also configured to display dynamic elements on the first side of the audio playback element, wherein at least one of the display style and movement mode of the dynamic elements is related to the characteristics of the target audio.

[0007] In an optional design, the display module is used for: A fog element is displayed on the first side of the audio playback element; The fog element is a display element used to simulate dynamic fog.

[0008] In an optional design, the display style of the fog element includes at least one of the following: fog brightness; fog color saturation; fog particle density; fog transparency; fog diffusion range; The movement modes of the fog elements include at least one of the following: fog rising speed; fog turbulence; fog disturbance frequency; fog movement amplitude; fog diffusion speed.

[0009] In an optional design, the device further includes: The acquisition module is used to acquire audio segments of the target audio. The determination module is used to determine the number of beats per minute (BPM), loudness, spectral intensity, and rhythm density of the audio segment; The determining module is further configured to determine the energy value of the audio segment based on the loudness, spectral intensity, and rhythm density of the audio segment; The determining module is also used to determine the display style and movement mode of the fog element based on the BPM and energy value of the audio segment.

[0010] In an optional design, the determining module is used for: If the BPM of the audio segment is greater than a first threshold, at least one of the following: fog rise velocity, fog turbulence, and fog disturbance frequency of the fog element is determined based on the BPM of the audio segment. If the BPM of the audio segment is less than or equal to the first threshold, at least one of the fog movement amplitude and fog diffusion speed of the fog element is determined based on the BPM of the audio segment. If the energy value of the audio segment is greater than the second threshold, at least one of the following is determined based on the energy value of the audio segment: fog brightness, fog color saturation, and fog particle density. If the energy value of the audio segment is less than or equal to the second threshold, at least one of the following is determined based on the energy value of the audio segment: fog brightness, fog transparency, and fog diffusion range of the fog element.

[0011] In an optional design, the display module is used for: Display a record player element in the audio playback interface; The record player element is a display element used to simulate a record player playing the target audio, and the display style of the record player element is related to the characteristics of the target audio.

[0012] In an optional design, the phonograph element includes a light-emitting element, and the display style of the phonograph element includes at least one of the following: The flickering frequency of the luminescent element; the breathing cycle of the luminescent element; the brightness of the luminescent element; the luminescent radius of the luminescent element; and the halo intensity of the luminescent element.

[0013] In an optional design, the device further includes: The acquisition module is used to acquire audio segments of the target audio. The determination module is used to determine the BPM, loudness, spectral intensity, and rhythm density of the audio segment; The determining module is further configured to determine the energy value of the audio segment based on the loudness, spectral intensity, and rhythm density of the audio segment; The determining module is also used to determine the display style of the record player element based on the BPM and energy value of the audio segment.

[0014] In an optional design, the determining module is used for: Based on the BPM of the audio segment, determine at least one of the flashing frequency of the light-emitting element of the record player element and the breathing cycle of the light-emitting element; Based on the energy value of the audio segment, determine at least one of the following: the brightness of the light-emitting element of the record player element, the light-emitting radius of the light-emitting element, and the halo intensity of the light-emitting element.

[0015] In an optional design, the device further includes: The get module is used to obtain the local time; The determining module is used to determine at least one of the target color temperature and the target brightness upper limit based on the local time; The determining module is further configured to determine the color temperature of the display elements in the audio playback interface based on the target color temperature, and / or determine the brightness of the display elements in the audio playback interface based on the target brightness upper limit.

[0016] In an optional design, the device further includes: The acquisition module is used to acquire the cover image corresponding to the target audio. The determination module is used to determine the representative color among the different colors corresponding to the cover image; The determining module is further configured to determine the color of the display elements in the audio playback interface based on the representative color.

[0017] According to another aspect of this application, a computer device is provided, the computer device including a processor and a memory, the memory storing at least one program, the at least one program being loaded and executed by the processor to implement the audio playback interface display method as described above.

[0018] According to another aspect of this application, a computer-readable storage medium is provided, wherein at least one program is stored therein, the at least one program being loaded and executed by a processor to implement the method for displaying an audio playback interface as described above.

[0019] According to another aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the audio playback interface display method provided in various alternative implementations of the above aspects.

[0020] The beneficial effects of the technical solution provided in this application include at least the following: By displaying an audio playback interface and its audio playback elements while playing target audio, and displaying dynamic elements for the audio playback elements, and since at least one of the display style and movement mode of the dynamic elements is related to the characteristics of the target audio, it is possible to display different dynamic elements in the audio playback interface when playing different target audio, thereby improving the correlation between the displayed elements in the audio playback interface and the target audio. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0022] Figure 1 This is a structural block diagram of a computer system provided in an exemplary embodiment of this application; Figure 2 This is a schematic diagram illustrating the process of displaying an audio playback interface provided in an exemplary embodiment of this application; Figure 3 This is a flowchart illustrating an exemplary embodiment of the method for displaying an audio playback interface provided in this application. Figure 4 This is a flowchart illustrating an exemplary embodiment of the method for displaying an audio playback interface provided in this application. Figure 5 This is a schematic diagram of a record player element and a fog element provided in an exemplary embodiment of this application; Figure 6 This is a schematic diagram illustrating the correspondence provided in an exemplary embodiment of this application; Figure 7 This is a schematic diagram of a system architecture provided in an exemplary embodiment of this application; Figure 8 This is a schematic diagram illustrating the display process of an audio playback interface provided in an exemplary embodiment of this application; Figure 9 This is a schematic diagram of the structure of a display device for an audio playback interface provided in an exemplary embodiment of this application; Figure 10 This is a schematic diagram of the structure of a display device for an audio playback interface provided in an exemplary embodiment of this application; Figure 11 This is a schematic diagram of the structure of a terminal provided in an exemplary embodiment of this application.

[0023] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application. Detailed Implementation

[0024] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0025] Figure 1 This is a structural block diagram of a computer system provided in an exemplary embodiment of this application. The computer system 100 includes: a terminal 110 and a server 120.

[0026] Terminal 110 has an application 111 installed and running that supports audio playback. This application 111 includes any one of the following: music streaming applications, song streaming applications, live streaming applications, social networking applications, office applications, game applications, food delivery applications, online shopping applications, video-on-demand applications, short video applications, financial applications, lifestyle service applications, navigation applications, medical applications, learning applications, and mini-programs. In some embodiments, application 111 is a client. Terminal 110 is the terminal used by user 112, and user account 112 can be logged into application 111. Terminal 110 can refer to one of multiple terminals. Optionally, the device type of terminal 110 includes at least one of the following: smartphone, tablet, smartwatch, e-book reader, MP3 player, MP4 player, laptop, and desktop computer.

[0027] Terminal 110 is connected to server 120 via wireless or wired network.

[0028] Server 120 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Server 120 provides background services for application 111 that supports audio playback. Optionally, server 120 undertakes the primary computing task, and terminal 110 undertakes the secondary computing task; or, server 120 undertakes the secondary computing task, and terminal 110 undertakes the primary computing task; or, server 120 and terminal 110 collaborate on computing using a distributed computing architecture.

[0029] In an illustrative example, server 120 includes processor 121, user account database 122, audio management module 123, and user-facing input / output interface (I / O interface) 124. Processor 121 loads instructions stored in server 120 and processes data in user account database 122 and audio management module 123. User account database 122 stores user account data used by terminal 110 and other terminals, such as user account avatars, nicknames, and group memberships. Audio management module 123 provides services for audio playback-related functions of application 111. User-facing I / O interface 124 establishes communication and exchanges data with terminal 110 via wireless or wired network.

[0030] Based on the above description of the implementation environment involved in this application, the method provided in the embodiments of this application will be described below.

[0031] Figure 2 This is a schematic diagram illustrating the process of displaying an audio playback interface according to an exemplary embodiment of this application. Figure 2 As shown, when playing target audio 201, the client displays an audio playback interface 202. The audio playback interface 202 is a user interface for playing the target audio 201, which can be understood as the audio currently being played by the client. The client displays an audio playback element 203 in the audio playback interface 202, and displays a dynamic element 204 on the first side of the audio playback element 203, for example, displaying the dynamic element 204 above the audio playback element 203. The audio playback element 203 is used to present the effect of playing the target audio 201, and at least one of the display style and movement mode of the dynamic element 204 is related to the characteristics of the target audio 201.

[0032] In some embodiments, the audio playback element 203 in the audio playback interface 202 is a record player element, which is a display element used to simulate a record player playing the target audio 201. The display style of the record player element is related to the characteristics of the target audio 201. The dynamic element 204 in the audio playback interface 202 is a fog element, which is a display element used to simulate dynamic fog. Optionally, during the display of the audio playback interface 202, the client acquires an audio segment of the target audio 201 and determines the beats per minute (BPM), loudness, spectral intensity, and rhythm density of the audio segment. Then, based on the loudness, spectral intensity, and rhythm density of the audio segment, the client determines the energy value of the audio segment. After obtaining the BPM and energy value of the audio segment, the client determines the display style of the record player element and the display style and movement mode of the fog element based on the BPM and energy value of the audio segment, thereby displaying the record player element according to the determined display style and the fog element according to the determined display style and movement mode. Optionally, the record player element includes a light-emitting element, which is a display element with a light-emitting effect within the record player element. The display style of the record player element includes at least one of the following: the flashing frequency of the light-emitting element; the breathing cycle of the light-emitting element; the brightness of the light-emitting element; the luminous radius of the light-emitting element; and the halo intensity of the light-emitting element. Optionally, the display style of the fog element includes at least one of the following: fog brightness; fog color saturation; fog particle density; fog transparency; and fog diffusion range. The movement mode of the fog element includes at least one of the following: fog rising speed; fog turbulence; fog disturbance frequency; fog movement amplitude; and fog diffusion speed.

[0033] By displaying an audio playback interface and its audio playback elements while playing target audio, and displaying dynamic elements for the audio playback elements, and since at least one of the display style and movement mode of the dynamic elements is related to the characteristics of the target audio, it is possible to display different dynamic elements in the audio playback interface when playing different target audio, thereby improving the correlation between the displayed elements in the audio playback interface and the target audio.

[0034] Figure 3 This is a flowchart illustrating a method for displaying an audio playback interface according to an exemplary embodiment of this application. This method can be used in computer devices, such as those used for... Figure 1 The client in the terminal shown. Figure 3 As shown, the method includes: Step 302: Display the audio playback interface.

[0035] The audio playback interface is the user interface in the client used to play audio. The target audio is the audio currently being played by the client, and the audio playback interface is used to play the target audio. When the client is triggered to play the target audio, it can display the audio playback interface; or the client can be triggered to display the audio playback interface first, and then the client can be triggered to play the target audio. In some embodiments, the type of target audio includes at least one of the following: a complete song, a song fragment, a medley, instrumental music, musical accompaniment, a song with vocals, and a song without vocals. This application does not limit the type of target audio.

[0036] The audio playback interface displays one or more of the following: the name of the target audio, the artist, the lyrics, the cover art, the current time, the current date, playback controls, audio playback elements, and dynamic elements. Playback controls are used to control the playback of the target audio, and may include at least one of the following: pause controls, playback progress controls, audio switching controls, and volume controls. For a description of audio playback elements and dynamic elements, please refer to the relevant content below.

[0037] In some embodiments, the client obtains the target audio data through locally stored data to play the target audio, or obtains the target audio data through downloaded data to play the target audio, or obtains the target audio data through data shared by other computer devices other than the client's computer device to play the target audio. This application embodiment does not limit the method of obtaining the target audio data.

[0038] Step 304: Display the audio playback elements in the audio playback interface.

[0039] Audio playback elements are display elements in an audio playback interface. They are used to present the effect of the target audio being played; in other words, they are display elements that reflect the currently playing target audio. Audio playback elements can be display elements simulating objects in the real world, semi-simulated / semi-fictional display elements, or purely fictional display elements; this application embodiment does not impose any limitations on this. Audio playback elements can be static or dynamic display elements; this application embodiment does not impose any limitations on this. Audio playback elements can be three-dimensional or two-dimensional display elements; this application embodiment does not impose any limitations on this.

[0040] In some embodiments, the audio playback element in the audio playback interface is a record player element, which is a display element used to simulate a record player playing the target audio. The record player simulated by the record player element can be a real record player, a semi-real / semi-fictional record player, or a purely fictional record player; this application embodiment does not impose any restrictions on this.

[0041] Step 306: Display the dynamic element on the first side of the audio playback element.

[0042] Dynamic elements are display elements in an audio playback interface. They are dynamic display elements, or display elements with dynamic effects. Dynamic elements can be three-dimensional or two-dimensional; this application embodiment does not limit this. Optionally, the dynamics of a dynamic element are manifested through its overall movement or through the movement of its constituent units. For example, a dynamic element might be a fog element, a display element used to simulate dynamic fog. In this case, the dynamics of the fog element are manifested through the movement of the particles that constitute the fog element; these particles are the basic constituent units of the fog element. At least one of the display style and movement mode of the dynamic element is related to the characteristics of the target audio.

[0043] The first side of the audio playback element can be any side surrounding the audio playback element, such as above, below, left, or right. In some embodiments, the client displays the dynamic element at a first distance from the first side of the audio playback element, where the first distance is preset.

[0044] In summary, the method provided in this embodiment displays an audio playback interface and its audio playback elements while playing target audio, and displays dynamic elements for the audio playback elements. Since at least one of the display style and movement mode of the dynamic elements is related to the characteristics of the target audio, it is possible to display different dynamic elements in the audio playback interface when playing different target audio, thereby improving the correlation between the displayed elements in the audio playback interface and the target audio.

[0045] Figure 4 This is a flowchart illustrating a method for displaying an audio playback interface according to an exemplary embodiment of this application. This method can be used in computer devices, such as those used for... Figure 1 The client in the terminal shown. Figure 4 As shown, the method includes: Step 402: Display the audio playback interface.

[0046] The audio playback interface is the user interface in the client used to play audio. The target audio is the audio currently being played by the client, and the audio playback interface is used to play the target audio. When the client is triggered to play the target audio, it can display the audio playback interface; or the client can be triggered to display the audio playback interface first, and then the client can be triggered to play the target audio. In some embodiments, the type of target audio includes at least one of the following: a complete song, a song fragment, a medley, instrumental music, musical accompaniment, a song with vocals, and a song without vocals. This application does not limit the type of target audio.

[0047] The audio playback interface displays one or more of the following: the name of the target audio, the artist, the lyrics, the cover art, the current time, the current date, playback controls, audio playback elements, and dynamic elements. Playback controls are used to control the playback of the target audio, and may include at least one of the following: pause controls, playback progress controls, audio switching controls, and volume controls. For a description of audio playback elements and dynamic elements, please refer to the relevant content below.

[0048] Step 404: Display the audio playback elements in the audio playback interface.

[0049] Audio playback elements are display elements in an audio playback interface. They are used to present the effect of the target audio being played; in other words, they are display elements that reflect the currently playing target audio. Audio playback elements can be display elements simulating objects in the real world, semi-simulated / semi-fictional display elements, or purely fictional display elements; this application embodiment does not impose any limitations on this. Audio playback elements can be static or dynamic display elements; this application embodiment does not impose any limitations on this either.

[0050] In some embodiments, the audio playback element in the audio playback interface is a record player element. The client displays the record player element in the audio playback interface. The record player element is a display element used to simulate a record player playing the target audio. The record player simulated by the record player element can be a real record player, a semi-real / semi-fictional record player, or a purely fictional record player; this application embodiment does not impose any limitations on this. The display style of the record player element is related to the characteristics of the target audio.

[0051] Optionally, the record player element includes a light-emitting element, which is a display element within the record player element that has a light-emitting effect. For example, the record player element includes a base for the record player, on which there are light-emitting elements used to simulate light-emitting diodes (LEDs). The display style of the record player element includes at least one of the following: the blink frequency of the light-emitting element; the breathing cycle of the light-emitting element; the brightness of the light-emitting element; the luminous radius of the light-emitting element; and the halo intensity of the light-emitting element. Wherein, the blink frequency of the light-emitting element refers to the number of times the light-emitting element alternates between bright and dark states per unit time. The breathing cycle of the light-emitting element refers to the cycle time during which the luminous intensity of the light-emitting element increases to its maximum value and then decreases to its minimum value. The brightness of the light-emitting element refers to the intensity of the light emitted by the light-emitting element. The luminous radius of the light-emitting element refers to the radius of the range of the light-emitting effect of the light-emitting element within the user interface. The halo intensity of the light-emitting element refers to the degree of intensity of the gradual transition between the edge of the light-emitting element and the background.

[0052] The following describes the process by which the client determines the display style of the record player element: The client acquires an audio segment of the target audio, which includes the segment currently being played by the client in the target audio, the segment preceding the segment currently being played by the client in the target audio, or the segment following the segment currently being played by the client in the target audio. In some embodiments, the client acquires the audio segment of the target audio through the player's buffer. After obtaining the audio segment of the target audio, the client determines the BPM, loudness, spectral intensity, and tempo density of the audio segment. The BPM of the audio segment reflects its tempo. The client can obtain the beat interval of the audio segment by performing short-time energy analysis, onset detection, tempo peak analysis, or beat tracking, thereby determining the BPM of the audio segment. The loudness of the audio segment reflects its volume. The client can determine the loudness of the audio segment based on the root mean square (RMS), short-time volume envelope, or loudness units full scale (LUFS) corresponding to the audio segment. The spectral intensity of an audio clip reflects the energy saturation of its frequency distribution. The client can determine the spectral intensity of the audio clip based on the frequency band energy or multi-band weighted energy obtained by performing a Fast Fourier Transform (FFT) on the audio clip. The rhythm density of an audio clip reflects the density of rhythmic changes within the audio clip per unit time. The client can determine the rhythm density of the audio clip based on the number of rhythm peaks or onsets within a unit time. After obtaining the loudness, spectral intensity, and rhythm density of the audio clip, the client determines the energy value of the audio clip based on these parameters, for example, by summing or weighting the loudness, spectral intensity, and rhythm density. After obtaining the BPM and energy value of the audio clip, the client determines the display style of the record player element based on these parameters.

[0053] Optionally, the client determines at least one of the blink frequency and breathing cycle of the luminous element of the record player element based on the BPM of the audio clip. The client also determines at least one of the brightness, luminous radius, and halo intensity of the luminous element based on the energy value of the audio clip. In some embodiments, the client determines the display style of the record player element by determining its display parameters, which control the display style. Each dimension of the record player element's display style (e.g., the blink frequency and breathing cycle of the luminous element) corresponds to a specific display parameter. During the determination of the record player element's display style, the client maps the BPM and energy value of the audio clip to the corresponding display parameters of the record player element according to preset rules. For example, the display parameters of the record player element are obtained based on the following formula: Map(x, inputMin, inputMax, outputMin, outputMax) =outputMin + Clamp((x - inputMin) / (inputMax - inputMin), 0, 1) (outputMax - outputMin); The output of Map() is the display parameter obtained through mapping. x represents the input (i.e., BPM / energy value), inputMin represents the minimum input value, inputMax represents the maximum input value, outputMin represents the minimum output value, and outputMax represents the maximum output value. Clamp() is a numerical truncation / limiting function used to strictly constrain the input value to a specified range.

[0054] Optionally, the client may also smooth the display parameters determined in the above manner. For example, the client may use the following formula to smooth the display parameters: ParamSmooth(t) = ParamSmooth(t - 1) + alpha (ParamTarget(t) - ParamSmooth(t - 1)); Where ParamSmooth(t) represents the smoothing result, ParamSmooth(t - 1) is the previous smoothing result, ParamTarget(t) is the current input parameter, and alpha is the smoothing coefficient.

[0055] Step 406: Display the fog element on the first side of the audio playback element.

[0056] Fog elements are display elements in audio playback interfaces. They are dynamic display elements, or display elements with dynamic effects. Fog elements are used to simulate dynamic fog, and their dynamics are manifested through the movement of the particles that make up the fog element; these particles are the basic building blocks of the fog element. At least one of the display style and movement mode of the fog element is related to the characteristics of the target audio.

[0057] The first side of the audio playback element can be any side surrounding the audio playback element, such as above, below, left, or right. In some embodiments, the client displays the dynamic element at a first distance from the first side of the audio playback element, where the first distance is preset.

[0058] Optionally, the display style of the fog element includes at least one of the following: fog brightness; fog color saturation; fog particle density; fog transparency; and fog diffusion range. Fog brightness refers to the overall brightness of the fog element. Fog color saturation refers to the vividness of the fog element's color. Fog particle density refers to the number of basic constituent units (particles) of the fog element within a unit area. Fog transparency refers to the visibility and transparency of the fog element. Fog diffusion range refers to the size of the area covered by the fog element in space. The movement mode of the fog element includes at least one of the following: fog rising speed; fog turbulence; fog disturbance frequency; fog movement amplitude; and fog diffusion speed. Fog rising speed refers to the speed at which the fog element as a whole or the particles within the fog element move upwards. Fog turbulence refers to the degree of disorder in the particle trajectories within the fog element. Fog disturbance frequency refers to the frequency of fluctuations generated by the fog element. Fog movement amplitude refers to the maximum displacement of particles within the fog element. Fog diffusion speed refers to the rate at which the fog element spreads outwards.

[0059] The following describes the process by which the client determines the display style / motion mode of the fog element: The client acquires an audio segment of the target audio and determines the beats per minute (BPM), loudness, spectral intensity, and rhythm density of the audio segment. Then, based on the loudness, spectral intensity, and rhythm density of the audio segment, the energy value of the audio segment is determined. The process of determining the BPM and energy value of the audio segment can be referred to the relevant content above, and will not be repeated here in this embodiment. After obtaining the BPM and energy value of the audio segment, the client determines the display style and motion mode of the fog element based on the BPM and energy value of the audio segment.

[0060] Optionally, if the BPM of the audio clip is greater than a first threshold, the client determines at least one of the following: fog rise velocity, fog turbulence, and fog disturbance frequency of the fog element based on the BPM of the audio clip; if the BPM of the audio clip is less than or equal to the first threshold, the client determines at least one of the following: fog movement amplitude and fog diffusion velocity of the fog element based on the BPM of the audio clip. The first threshold is preset. If the energy value of the audio clip is greater than a second threshold, the client determines at least one of the following: fog brightness, fog color saturation, and fog particle density of the fog element based on the energy value of the audio clip; if the energy value of the audio clip is less than or equal to the second threshold, the client determines at least one of the following: fog brightness, fog transparency, and fog diffusion range of the fog element based on the energy value of the audio clip. The second threshold is preset.

[0061] In some embodiments, the client determines the display style of the fog element by determining its display parameters, which control the display style of the fog element; the client also determines the movement mode of the fog element by determining its motion parameters, which control the movement mode of the fog element. Each dimension of the fog element's display style (e.g., fog brightness, fog color saturation) corresponds to a display parameter; each dimension of the fog element's movement mode (e.g., fog rise speed, fog turbulence) corresponds to a motion parameter. During the process of determining the fog element's display style, the client maps the BPM and energy value of the audio clip to the corresponding fog element's display parameters according to preset rules; during the process of determining the fog element's movement mode, the client maps the BPM and energy value of the audio clip to the corresponding fog element's motion parameters according to preset rules. The mapping process can be referred to the relevant content above, and will not be repeated here. Optionally, the client may also perform smoothing processing on the display parameters and motion parameters determined in the above manner. The smoothing process can be referred to the relevant content above, and will not be repeated here in the embodiments of this application.

[0062] For example, Figure 5 This is a schematic diagram of a record player element and a fogging element provided in an exemplary embodiment of this application. (See diagram below.) Figure 5 As shown, when playing the first audio segment of the target audio, the client displays the fog element 501 according to the first display style and the first motion mode, and displays the record player element 502 according to the second display style. When playing the second audio segment of the target audio, the client displays the fog element 501 according to the third display style and the second motion mode, and displays the record player element 502 according to the fourth display style.

[0063] In some embodiments, the client obtains its local time, which can also be understood as the system time. The client determines at least one of a target color temperature and a target brightness limit based on the local time, for example, by determining at least one of the target color temperature and the target brightness limit based on a preset rule. Then, the client determines the color temperature of the display elements in the audio playback interface based on the target color temperature, for example, by adjusting the color temperature of the display elements in the audio playback interface according to the target color temperature; and / or, determines the brightness of the display elements in the audio playback interface based on the target brightness limit, for example, by adjusting the brightness of the display elements in the audio playback interface so that it does not exceed the target brightness limit. The display elements for which the client determines the color temperature / brightness in the above manner may include all display elements in the audio playback interface, or may include only some display elements in the audio playback interface.

[0064] In some embodiments, the client obtains the cover image corresponding to the target audio and determines a representative color among the different colors corresponding to the cover image. The representative color, used to represent the different colors in the cover image, can be determined through thumbnail sampling, color clustering, average color calculation, or primary color quantization. The client then determines the colors of the display elements in the audio playback interface based on the representative color. The display elements whose colors are determined by the client in the above manner can include all or some of the display elements in the audio playback interface.

[0065] For example, Figure 6 This is a schematic diagram illustrating the correspondence provided in an exemplary embodiment of this application. For example... Figure 6 As shown, the BPM of the target audio is used to control the fog rising speed, fog turbulence, and flashing frequency of the light-emitting elements (LEDs) in the fog element 601 and the record player element 602. The energy value of the target audio is used to control the fog brightness and fog color saturation of the fog element 601. The main color (representative color) of the cover image corresponding to the target audio is used as the auxiliary color for the light-emitting elements in the fog element 601 and the record player element 602. The system time is used to control the color temperature of the display elements in the audio playback interface.

[0066] It should be noted that this application embodiment mainly uses the example of the client determining the display style and movement mode of the fog element and the display style of the record player element. It is understood that the method provided in this application embodiment can also be implemented collaboratively by the client and the server. For example, the server determines the display style and movement mode of the fog element and the display style of the record player element using the method provided in this application embodiment, and instructs the client accordingly. The client then displays the fog element and the record player element in the corresponding manner based on the server's instructions.

[0067] In some embodiments, when a target segment of a target song is played, the client obtains reference information corresponding to the target segment. The target segment includes at least one segment of the target song that has received more than one instance of likes, more than one instance of comments, and more than one instance of plays. The reference information includes at least one of the lyrics corresponding to the target segment and the comments corresponding to the target segment. The client then extracts keywords from the reference information corresponding to the target segment and controls the fog element to display as a first target shape, which is a shape used to reflect the aforementioned keywords.

[0068] In some embodiments, during the playback of a target song, if the number of times a user account performs interactive operations on the target song exceeds a threshold, the client controls the fog element to display a second target shape. This second target shape reflects the shape corresponding to the most frequently performed interactive operation on the target song. Optionally, the interactive operation includes at least one of a like, a favorite, and a share. The second target shape corresponding to a like operation can be a heart shape, the second target shape corresponding to a favorite operation can be a five-pointed star shape, and the second target shape corresponding to a share operation can be an arrow shape.

[0069] In summary, the method provided in this embodiment displays an audio playback interface and its audio playback elements while playing target audio, and displays dynamic elements for the audio playback elements. Since at least one of the display style and movement mode of the dynamic elements is related to the characteristics of the target audio, it is possible to display different dynamic elements in the audio playback interface when playing different target audio, thereby improving the correlation between the displayed elements in the audio playback interface and the target audio.

[0070] The method provided in this embodiment also offers a concrete visual expression for audio playback by providing a fog element. By finely controlling the fog element across multiple dimensions, the characteristics of different audio elements can be conveyed more delicately and accurately. By determining the display style / movement mode of the fog element based on BPM, loudness, spectral intensity, and rhythm density, the fog element's display can be driven in real-time by the characteristics of the audio being played. By providing a record player element, a visual symbol with a retro aesthetic is provided for audio playback. By finely controlling the record player element across multiple dimensions, the characteristics of different audio elements can be conveyed more delicately and accurately. By determining the display style of the record player element based on BPM, loudness, spectral intensity, and rhythm density, the record player element's display can be driven in real-time by the characteristics of the audio being played. By introducing local time as a control factor for the interface display elements, the audio playback interface display gains time-awareness. By extracting the representative color of the album art to determine the colors of the interface display elements, a high degree of unity between the interface color scheme and the album visuals is achieved.

[0071] The method provided in this embodiment can be used in the audio playback interfaces of smart devices such as mobile phones, tablets, in-vehicle terminals, and TVs to construct a physical music dynamic emotion mapping system. This method analyzes audio data in real time during audio playback on the client side, extracting features such as BPM, loudness, spectral intensity, and rhythm density, and synthesizing them to obtain an energy value. Simultaneously, it reads the local time and extracts a representative color from the cover image. Subsequently, these inputs are mapped to parameters such as fog elements, phonograph base luminous elements, global ambient light, and color temperature in a 3D virtual phonograph scene, so that different songs, different segments, and different playback times present different dynamic fog phonograph atmospheres. For example, the more intense the audio, the brighter, faster, and more turbulent the fog; the quieter the audio, the softer, slower, and smoother the diffusion of the fog; the global color temperature can also smoothly change depending on the time of day; the main color of the cover can participate in the color adjustment of the fog and lighting effects, making the visual atmosphere more consistent with the audio content.

[0072] For example, Figure 7 This is a schematic diagram of a system architecture provided in an exemplary embodiment of this application. Figure 7 As shown, the audio playback unit 701 takes an audio stream as input and outputs the currently playing audio segment, providing audio sampling data to subsequent modules during playback. The real-time audio analysis unit 702 takes an audio segment as input and outputs BPM, loudness, spectral intensity, and rhythm density, used for real-time analysis of music dynamics. The energy value calculation unit 703 takes loudness, spectral intensity, and rhythm density as input and outputs a normalized energy value, used to comprehensively judge the strength, density, and intensity of the current segment. The system time unit 704 takes local time as input and outputs a day / night color temperature factor, used to generate a global color temperature control value based on morning / evening time. The cover color unit 705 takes a cover image as input and outputs one or more primary colors, used as auxiliary input for fog, LED, and background ambient colors. The mapping and smoothing unit 706 takes BPM, energy value, system time, and cover color as input and outputs 3D scene rendering parameters, used to map audio features to parameters such as fog, LED, and ambient light, and perform smoothing processing. The 3D scene rendering unit 707 takes rendering parameters as input and outputs the audio playback interface, which is used to render the virtual phonograph, virtual fog, base LED, cover card and ambient light.

[0073] For example, Figure 8 This is a schematic diagram illustrating the display process of an audio playback interface provided in an exemplary embodiment of this application. For example... Figure 8As shown, in step S1, the client plays the target audio and retrieves the most recent audio segment from the player buffer. In step S2, the audio segment undergoes short-time frame-by-frame processing to calculate loudness, spectral intensity, and rhythm density. BPM is estimated using beat tracking, rhythm peak detection, or equivalent methods. In step S3, loudness, spectral intensity, and rhythm density are normalized and weighted to form an energy value. In step S4, the device system time is read, and the day / night color temperature factor is calculated. Optionally, the cover image is read, and the main cover color is extracted. In step S5, the BPM, energy value, system time, and main cover color are input into a configurable interval mapping function to obtain target scene parameters. In step S6, the target scene parameters are interpolated, averaged, or low-pass filtered to obtain smoothing parameters. In step S7, the smoothing parameters are used to update the 3D virtual fog, turntable base LED, ambient light, and cover ambient color. The current frame is rendered and output to the screen.

[0074] Calculation based on input features: BPM: BPM represents tempo, which can be estimated in real time by the client during playback. The system can perform short-time energy analysis, onset detection, rhythm peak analysis, or beat tracking on the audio to obtain the beat interval within a certain time window and convert it into beats per minute. To avoid frequent BPM fluctuations, a moving average or confidence filtering can be applied to the BPM results of consecutive windows. BPM can be a stable value for the entire song or it can be dynamically updated according to the currently playing segment. For example, when the tempo intensifies after the song enters the chorus, the BPM or rhythm response value increases, and the fog movement and LED flashing will also be enhanced.

[0075] Energy value: The energy value is obtained by combining loudness, spectral intensity, and rhythm density. The energy value can be normalized to the range of 0 to 1 using the following formula: Energy(t) = w1 LoudnessNorm(t) + w2 SpectrumNorm(t) + w3 RhythmDensityNorm(t).

[0076] LoudnessNorm(t) represents normalized loudness, which can be obtained from RMS, short-time volume envelope, or LUFS-like metrics. SpectrumNorm(t) represents normalized spectral intensity, which can be obtained from the frequency band energy after FFT or multi-band weighted energy. RhythmDensityNorm(t) represents normalized rhythm density, which can be obtained from the number of rhythm peaks or onsets per unit time. w1, w2, and w3 are configurable weights that can be adjusted based on product experience. Using energy values, the system does not need to hard-code songs into categories such as DJ, instrumental, Chinese, or Western music; instead, it naturally reflects the strength and intensity of the current music segment through real-time audio characteristics.

[0077] Regarding system time: The system reads the device's local time and divides the day into daytime, nighttime, and transitional intervals. Instead of directly triggering abrupt changes, the system time generates a continuous color temperature factor to control global ambient light, fog color, and LED color shift. For example, the color temperature from 06:00 to 08:00 exhibits a smooth transition from cool to warm colors; from 08:00 to 18:00, it exhibits warm colors or natural light colors; from 18:00 to 22:00, it exhibits a smooth transition from warm to cool colors; and from 22:00 to 06:00, it exhibits cool colors and low brightness.

[0078] Regarding the main color of the cover: The system can extract the primary color from the cover image as an auxiliary color input. This can be achieved through thumbnail sampling, color clustering, average color calculation, or primary color quantization. The primary cover color is not a required input, but it can be used to enhance the consistency between the visual style and the song cover. For example, if the primary cover color is bluish, the base color of the fog can be cooler; if the primary cover color is reddish and has a high energy value, the LED and fog can increase the proportion of warm colors and color saturation.

[0079] For parameter mapping: Parameter mapping is used to convert input features into 3D virtual scene parameters. Mapping can be linear, piecewise, curve-based, or lookup table-based. For easier subsequent parameter tuning, the configurable interval mapping function described earlier can be used.

[0080] For the implementation of the fog element: Fog elements can be implemented using particle systems, volumetric fog, semi-transparent textured particles, noise field perturbations, or shaders, without being limited to a specific graphics engine. An exemplary implementation is as follows: 1. Set a fog emission area near the record player element's turntable or base. 2. Each fog particle includes position, velocity, lifespan, transparency, size, color, and luminous intensity. 3. BPM controls the particle's rise speed, turbulence, and perturbation frequency. 4. Energy values ​​control the particle's density, brightness, color saturation, transparency, and diffusion range. 5. The cover's main color provides the fog's base color, and the system's time color temperature factor globally adjusts the base color. 6. A smoothing module interpolates the above parameters to prevent sudden changes in the fog. This implementation makes the fog appear as a materialized effect of "music rising, spreading, emitting light, and changing" from a record player.

[0081] Implementation of the phonograph dock: The LEDs (light-emitting elements) on the turntable base are light-emitting rings or strips on a 3D virtual turntable, and can be independently driven by audio-related parameters. For example, BPM affects the flashing frequency or breathing cycle, meaning the faster the tempo, the faster the LED flashes. Energy value affects brightness, luminous radius, and halo intensity, meaning the higher the energy, the brighter the LED and the stronger the halo. The cover's primary color affects the base or secondary luminous color, ensuring the LED color matches the song cover visually. System time affects color temperature shift and nighttime brightness limits, resulting in reduced glare at night and a natural transition between morning and evening.

[0082] For global color temperature switching: The system time drives the global color temperature, but it does not switch abruptly at fixed times. Color temperature changes are achieved through the following smoothing function: TimeFactor = SmoothStep(startTime, endTime, currentSystemTime); SceneCCT = Mix(nightCCT, dayCCT, TimeFactor).

[0083] Wherein, TimeFactor is the normalized position of the current time within the transition interval, SmoothStep is the smooth transition function, nightCCT is the nighttime color temperature parameter, dayCCT is the daytime color temperature parameter, and SceneCCT is the global color temperature used in the current 3D scene. The system can apply SceneCCT to ambient light, fog emission color, background light, and LED color, allowing the same song to present different atmospheres in the morning, daytime, evening, and night.

[0084] The following provides an exemplary description of the scenario performance of the method provided in the embodiments of this application: For quiet, slow songs: When the BPM and energy level are low, the system reduces the fog's rising speed, turbulence, and brightness to improve the smoothness of fog diffusion. The turntable base LED flashes in a slow, breathing pattern. If the system time is nighttime, the global ambient light smoothly transitions to cooler colors and lower brightness. The interface appears as fog slowly rising from the virtual turntable, gently diffusing, creating an overall quiet and ethereal atmosphere.

[0085] For upbeat, fast-paced songs: When the BPM and energy level are high, the system increases the fog's rising speed, turbulence, disturbance frequency, luminous brightness, and particle density. The record player's base LED flashes rapidly according to the BPM; the higher the energy level, the stronger the LED halo. If the album cover's main color is warm, the fog and LEDs can blend towards a highly saturated warm color.

[0086] For the same song played at different times: when the same song is played in the morning, the system time module outputs a color temperature factor that is more daytime-oriented, making the overall scene brighter and warmer; when played at night, the system outputs a color temperature factor that is more nighttime-oriented, making the overall scene cooler and darker. Because the color temperature changes are smoothed, the interface will not suddenly change color.

[0087] This embodiment includes at least the following beneficial effects: The system obtains BPM and energy values ​​through real-time audio analysis on the client side, day / night color temperature factors through system time, and auxiliary colors of the song through the main cover color. Then, through a configurable interval mapping function and parameter smoothing mechanism, these inputs are converted into a three-dimensional virtual fog effect on the screen, along with changes in ambient light and color temperature. The result is that the audio playback interface is no longer just a static cover or abstract spectrum, but presents a physical three-dimensional fog turntable scene that dynamically changes with the music rhythm, energy, time, and cover color.

[0088] It should be noted that this application may display prompt interfaces, pop-ups, or output voice prompts before and during the collection of user data. These prompt interfaces, pop-ups, or voice prompts are used to inform the user that their data is being collected. This ensures that the application only begins the steps for collecting user data after receiving confirmation from the user regarding the prompt interface or pop-up; otherwise (i.e., without user confirmation), the steps for collecting user data end, meaning no user data is collected. In other words, all user data collected in this application is collected with the user's consent and authorization, and the collection, use, and processing of related user data must comply with the relevant laws, regulations, and standards of the relevant countries and regions.

[0089] It should be noted that the order of the method steps provided in the embodiments of this application can be appropriately adjusted, and the steps can also be added or removed as appropriate. Any method variations that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application, and therefore will not be elaborated further.

[0090] Figure 9 This is a schematic diagram of the structure of a display device for an audio playback interface provided in an exemplary embodiment of this application. Figure 9 As shown, the device includes: Display module 901 is used to display the audio playback interface, which is used to play the target audio. The display module 901 is also used to display audio playback elements in the audio playback interface, the audio playback elements being used to present the effect of the target audio being played; The display module 901 is also used to display dynamic elements on the first side of the audio playback element, wherein at least one of the display style and movement mode of the dynamic elements is related to the characteristics of the target audio.

[0091] In an optional design, the display module 901 is used for: A fog element is displayed on the first side of the audio playback element; The fog element is a display element used to simulate dynamic fog.

[0092] In an optional design, the display style of the fog element includes at least one of the following: fog brightness; fog color saturation; fog particle density; fog transparency; fog diffusion range; The movement modes of the fog elements include at least one of the following: fog rising speed; fog turbulence; fog disturbance frequency; fog movement amplitude; fog diffusion speed.

[0093] In an optional design, such as Figure 10 As shown, the device further includes: Acquisition module 902 is used to acquire audio segments of the target audio; The determination module 903 is used to determine the number of beats per minute (BPM), loudness, spectral intensity, and rhythm density of the audio segment; The determining module 903 is further configured to determine the energy value of the audio segment based on the loudness, spectral intensity, and rhythm density of the audio segment; The determining module 903 is further configured to determine the display style and movement mode of the fog element based on the BPM and energy value of the audio segment.

[0094] In an optional design, the determining module 903 is used for: If the BPM of the audio segment is greater than a first threshold, at least one of the following: fog rise velocity, fog turbulence, and fog disturbance frequency of the fog element is determined based on the BPM of the audio segment. If the BPM of the audio segment is less than or equal to the first threshold, at least one of the fog movement amplitude and fog diffusion speed of the fog element is determined based on the BPM of the audio segment. If the energy value of the audio segment is greater than the second threshold, at least one of the following is determined based on the energy value of the audio segment: fog brightness, fog color saturation, and fog particle density. If the energy value of the audio segment is less than or equal to the second threshold, at least one of the following is determined based on the energy value of the audio segment: fog brightness, fog transparency, and fog diffusion range of the fog element.

[0095] In an optional design, the display module 901 is used for: Display a record player element in the audio playback interface; The record player element is a display element used to simulate a record player playing the target audio, and the display style of the record player element is related to the characteristics of the target audio.

[0096] In an optional design, the phonograph element includes a light-emitting element, and the display style of the phonograph element includes at least one of the following: The flickering frequency of the luminescent element; the breathing cycle of the luminescent element; the brightness of the luminescent element; the luminescent radius of the luminescent element; and the halo intensity of the luminescent element.

[0097] In an optional design, such as Figure 10 As shown, the device further includes: Acquisition module 902 is used to acquire audio segments of the target audio; The determination module 903 is used to determine the BPM, loudness, spectral intensity, and rhythm density of the audio segment; The determining module 903 is further configured to determine the energy value of the audio segment based on the loudness, spectral intensity, and rhythm density of the audio segment; The determining module 903 is further configured to determine the display style of the record player element based on the BPM and energy value of the audio segment.

[0098] In an optional design, the determining module 903 is used for: Based on the BPM of the audio segment, determine at least one of the flashing frequency of the light-emitting element of the record player element and the breathing cycle of the light-emitting element; Based on the energy value of the audio segment, determine at least one of the following: the brightness of the light-emitting element of the record player element, the light-emitting radius of the light-emitting element, and the halo intensity of the light-emitting element.

[0099] In an optional design, such as Figure 10 As shown, the device further includes: Module 902 is used to obtain the local time; The determining module 903 is used to determine at least one of the target color temperature and the target brightness upper limit based on the local time; The determining module 903 is further configured to determine the color temperature of the display elements in the audio playback interface based on the target color temperature, and / or determine the brightness of the display elements in the audio playback interface based on the target brightness upper limit.

[0100] In an optional design, such as Figure 10 As shown, the device further includes: The acquisition module 902 is used to acquire the cover image corresponding to the target audio. The determining module 903 is used to determine the representative color among the different colors corresponding to the cover image; The determining module 903 is further configured to determine the color of the display elements in the audio playback interface based on the representative color.

[0101] It should be noted that the audio playback interface display device provided in the above embodiments is only an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the audio playback interface display device and the audio playback interface display method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0102] Embodiments of this application also provide a computer device, which includes a processor and a memory. The memory stores at least one instruction, at least one program, code set, or instruction set. The at least one instruction, at least one program, code set, or instruction set is loaded and executed by the processor to implement the audio playback interface display method provided in the above-described method embodiments.

[0103] In some embodiments, the computer device described above is a terminal. For example, Figure 11 This is a schematic diagram of the structure of a terminal provided in an exemplary embodiment of this application.

[0104] Typically, terminal 1100 includes a processor 1101 and a memory 1102.

[0105] Processor 1101 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 1101 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). Processor 1101 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 1101 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 1101 may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0106] The memory 1102 may include one or more computer-readable storage media, which may be non-transitory. The memory 1102 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 1102 is used to store at least one instruction, which is executed by the processor 1101 to implement the audio playback interface display method provided in the method embodiments of this application.

[0107] In some embodiments, the terminal 1100 may also optionally include a peripheral device interface 1103 and at least one peripheral device. The processor 1101, memory 1102, and peripheral device interface 1103 can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface 1103 via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 1104, a display screen 1105, a camera assembly 1106, an audio circuit 1107, and a power supply 1108.

[0108] Peripheral device interface 1103 can be used to connect at least one I / O (Input / Output) related peripheral device to processor 1101 and memory 1102. In some embodiments, processor 1101, memory 1102 and peripheral device interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of processor 1101, memory 1102 and peripheral device interface 1103 can be implemented on separate chips or circuit boards, and this application embodiment does not limit this.

[0109] The radio frequency (RF) circuit 1104 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The RF circuit 1104 communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 1104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals back into electrical signals. Optionally, the RF circuit 1104 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit 1104 can communicate with other terminals via at least one wireless communication protocol. This wireless communication protocol includes, but is not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit 1104 may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0110] Display screen 1105 is used to display a UI (User Interface). This UI may include graphics, text, icons, videos, and any combination thereof. When display screen 1105 is a touch display screen, it also has the ability to collect touch signals on or above its surface. These touch signals can be input as control signals to processor 1101 for processing. In this case, display screen 1105 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 1105, which serves as the front panel of terminal 1100; in other embodiments, there may be at least two display screens, respectively disposed on different surfaces of terminal 1100 or in a folded design; in still other embodiments, display screen 1105 may be a flexible display screen, disposed on a curved or folded surface of terminal 1100. Furthermore, display screen 1105 may also be configured as a non-rectangular, irregular shape, i.e., a non-rectangular screen. The display screen 1105 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0111] The camera assembly 1106 is used to acquire images or videos. Optionally, the camera assembly 1106 includes a front-facing camera and a rear-facing camera. Typically, the front-facing camera is located on the front panel of the terminal 1100, and the rear-facing camera is located on the back of the terminal. In some embodiments, there are at least two rear-facing cameras, which are any one of a main camera, a depth-sensing camera, a wide-angle camera, and a telephoto camera, to achieve background blurring by fusion of the main camera and the depth-sensing camera, panoramic shooting by fusion of the main camera and the wide-angle camera, VR (Virtual Reality) shooting, or other fusion shooting functions. In some embodiments, the camera assembly 1106 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cool light flash, which can be used for light compensation at different color temperatures.

[0112] The audio circuit 1107 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, converting the sound waves into electrical signals that are input to the processor 1101 for processing, or input to the radio frequency circuit 1104 for voice communication. For stereo sound acquisition or noise reduction purposes, multiple microphones may be used, each positioned at a different location on the terminal 1100. The microphone may also be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 1101 or the radio frequency circuit 1104 into sound waves. The speaker may be a conventional diaphragm speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can convert electrical signals not only into audible sound waves but also into inaudible sound waves for purposes such as distance measurement. In some embodiments, the audio circuit 1107 may also include a headphone jack.

[0113] Power supply 1108 is used to power the various components in terminal 1100. Power supply 1108 can be AC ​​power, DC power, a disposable battery, or a rechargeable battery. When power supply 1108 includes a rechargeable battery, the rechargeable battery can be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged via a wired line, and a wireless rechargeable battery is a battery that is charged via a wireless coil. The rechargeable battery can also be used to support fast charging technology.

[0114] In some embodiments, the terminal 1100 further includes one or more sensors 1109. The one or more sensors 1109 include, but are not limited to: an acceleration sensor 1110, a gyroscope sensor 1111, a pressure sensor 1112, an optical sensor 1113, and a proximity sensor 1114.

[0115] Accelerometer 1110 can detect the magnitude of acceleration along the three axes of a coordinate system established with terminal 1100. For example, accelerometer 1110 can be used to detect the components of gravitational acceleration along the three axes. Processor 1101 can control touchscreen 1105 to display the user interface in landscape or portrait view based on the gravitational acceleration signal acquired by accelerometer 1110. Accelerometer 1110 can also be used for games or for acquiring user motion data.

[0116] The gyroscope sensor 1111 can detect the orientation and rotation angle of the terminal 1100. The gyroscope sensor 1111 can work in conjunction with the accelerometer sensor 1110 to collect the user's 3D movements on the terminal 1100. Based on the data collected by the gyroscope sensor 1111, the processor 1101 can perform the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0117] The pressure sensor 1112 can be disposed on the side bezel of the terminal 1100 and / or on the lower layer of the touch display screen 1105. When the pressure sensor 1112 is disposed on the side bezel of the terminal 1100, it can detect the user's grip signal on the terminal 1100, and the processor 1101 can perform left / right hand recognition or quick operation based on the grip signal collected by the pressure sensor 1112. When the pressure sensor 1112 is disposed on the lower layer of the touch display screen 1105, the processor 1101 can control the operable controls on the UI interface based on the user's pressure operation on the touch display screen 1105. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

[0118] Optical sensor 1113 is used to collect ambient light intensity. In one embodiment, processor 1101 can control the display brightness of touch screen 1105 based on the ambient light intensity collected by optical sensor 1113. Specifically, when the ambient light intensity is high, the display brightness of touch screen 1105 is increased; when the ambient light intensity is low, the display brightness of touch screen 1105 is decreased. In another embodiment, processor 1101 can also dynamically adjust the shooting parameters of camera assembly 1106 based on the ambient light intensity collected by optical sensor 1113.

[0119] The proximity sensor 1114, also known as a distance sensor, is typically located on the front panel of the terminal 1100. The proximity sensor 1114 is used to detect the distance between the user and the front of the terminal 1100. In one embodiment, when the proximity sensor 1114 detects that the distance between the user and the front of the terminal 1100 is gradually decreasing, the processor 1101 controls the touchscreen display 1105 to switch from a screen-on state to a screen-off state; when the proximity sensor 1114 detects that the distance between the user and the front of the terminal 1100 is gradually increasing, the processor 1101 controls the touchscreen display 1105 to switch from a screen-off state to a screen-on state.

[0120] Those skilled in the art will understand that Figure 11 The structure shown does not constitute a limitation on terminal 1100 and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0121] This application also provides a computer-readable storage medium storing at least one instruction, at least one program, code set, or instruction set. When the at least one instruction, at least one program, code set, or instruction set is loaded and executed by the processor of a computer device, the method for displaying the audio playback interface provided in the above-described method embodiments is implemented.

[0122] This application also provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the audio playback interface display method provided in the above-described method embodiments.

[0123] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0124] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent switching, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for displaying an audio playback interface, characterized in that, The method includes: The audio playback interface is displayed, and the audio playback interface is used to play the target audio; The audio playback interface displays an audio playback element, which is used to present the effect of the target audio being played. A dynamic element is displayed on the first side of the audio playback element, and at least one of the display style and movement mode of the dynamic element is related to the characteristics of the target audio.

2. The method according to claim 1, characterized in that, The display of dynamic elements on the first side of the audio playback element includes: A fog element is displayed on the first side of the audio playback element; The fog element is a display element used to simulate dynamic fog.

3. The method according to claim 2, characterized in that, The display style of the fog element includes at least one of the following: fog brightness; fog color saturation; fog particle density; fog transparency; fog diffusion range; The movement modes of the fog elements include at least one of the following: fog rising speed; fog turbulence; fog disturbance frequency; fog movement amplitude; fog diffusion speed.

4. The method according to claim 2, characterized in that, The method further includes: Obtain the audio segment of the target audio; Determine the beats per minute (BPM), loudness, spectral intensity, and rhythm density of the audio segment; The energy value of the audio segment is determined based on its loudness, spectral intensity, and rhythm density. The display style and movement mode of the fog element are determined based on the BPM and energy value of the audio segment.

5. The method according to claim 4, characterized in that, The step of determining the display style and movement mode of the fog element based on the BPM and energy value of the audio segment includes: If the BPM of the audio segment is greater than a first threshold, at least one of the following: fog rise velocity, fog turbulence, and fog disturbance frequency of the fog element is determined based on the BPM of the audio segment. If the BPM of the audio segment is less than or equal to the first threshold, at least one of the fog movement amplitude and fog diffusion speed of the fog element is determined based on the BPM of the audio segment. If the energy value of the audio segment is greater than the second threshold, at least one of the following is determined based on the energy value of the audio segment: fog brightness, fog color saturation, and fog particle density. If the energy value of the audio segment is less than or equal to the second threshold, at least one of the following is determined based on the energy value of the audio segment: fog brightness, fog transparency, and fog diffusion range of the fog element.

6. The method according to any one of claims 1 to 5, characterized in that, The display of audio playback elements in the audio playback interface includes: Display a record player element in the audio playback interface; The record player element is a display element used to simulate a record player playing the target audio, and the display style of the record player element is related to the characteristics of the target audio.

7. The method according to claim 6, characterized in that, The record player element includes a light-emitting element, and the display style of the record player element includes at least one of the following: The flickering frequency of the luminescent element; the breathing cycle of the luminescent element; the brightness of the luminescent element; the luminescent radius of the luminescent element; and the halo intensity of the luminescent element.

8. The method according to claim 6, characterized in that, The method further includes: Obtain the audio segment of the target audio; Determine the BPM, loudness, spectral intensity, and rhythm density of the audio segment; The energy value of the audio segment is determined based on its loudness, spectral intensity, and rhythm density. The display style of the record player element is determined based on the BPM and energy value of the audio segment.

9. The method according to claim 8, characterized in that, The step of determining the display style of the turntable element based on the BPM and energy value of the audio segment includes: Based on the BPM of the audio segment, determine at least one of the flashing frequency of the light-emitting element of the record player element and the breathing cycle of the light-emitting element; Based on the energy value of the audio segment, determine at least one of the following: the brightness of the light-emitting element of the record player element, the light-emitting radius of the light-emitting element, and the halo intensity of the light-emitting element.

10. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Get local time; Determine at least one of the target color temperature and target brightness upper limit based on the local time; The color temperature of the display elements in the audio playback interface is determined based on the target color temperature, and / or the brightness of the display elements in the audio playback interface is determined based on the target brightness upper limit.

11. The method according to any one of claims 1 to 5, characterized in that, The method further includes: Obtain the cover image corresponding to the target audio; Determine the representative color among the different colors corresponding to the cover image; The color of the display elements in the audio playback interface is determined based on the representative color.

12. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing at least one program, which is loaded and executed by the processor to implement the method for displaying an audio playback interface as described in any one of claims 1 to 11.

13. A computer-readable storage medium, characterized in that, The readable storage medium stores at least one program, which is loaded and executed by a processor to implement the method for displaying an audio playback interface as described in any one of claims 1 to 11.

14. A computer program product, characterized in that, The computer program product includes computer instructions stored in a computer-readable storage medium, a processor of a computer device reading the computer instructions from the computer-readable storage medium, and the processor executing the computer instructions to cause the computer device to perform the method for displaying an audio playback interface as described in any one of claims 1 to 11.

Images