Playing interface processing method and device, program product and electronic equipment

Abstract

The invention provides a playing interface processing method and device, a program product and electronic equipment, and relates to the technical field of computers. The method comprises the following steps: displaying a playing interface of first music; presenting a light effect in the playing interface; the light effect comprises at least one of a first light effect and a second light effect; the first light effect is a light effect matched with the first music; the second light effect is a light effect generated by taking at least one interface element in the playing interface as a virtual light source. The visual effect of the music playing interface is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology. More specifically, the embodiments of the present disclosure relate to a playback interface processing method, a playback interface processing device, a computer program product and an electronic device. Background Art

[0002] This section is intended to provide a background or context for the technical solutions stated in the claims, and the contents described herein are not admitted to be prior art by virtue of being included in this section.

[0003] With the development of computers and electronic devices, more and more users use music software to listen to digital music. In music software, the corresponding playback interface is displayed when playing music. The content in the playback interface usually includes basic information of the music and playback control buttons, so that users can understand the music information and perform control operations such as switching songs. Summary of the invention

[0004] However, the visual effects of the current playback interface are relatively monotonous, making it difficult to provide users with a diverse or immersive music experience.

[0005] In view of the above problems, embodiments of the present disclosure provide a playback interface processing method, a playback interface processing device, a computer program product, and an electronic device.

[0006] According to a first aspect of the present disclosure, a playback interface processing method is provided, the method comprising: displaying a playback interface of a first music; presenting a lighting effect in the playback interface; the lighting effect comprising at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect matching the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

[0007] In one embodiment, presenting the lighting effect in the playback interface includes: determining a first lighting parameter based on the first music; and presenting the first lighting effect in the playback interface according to the first lighting parameter.

[0008] In one embodiment, the first lighting parameter includes a first lighting transparency; and determining the first lighting parameter according to the first music includes: determining a current first lighting transparency according to a current sound amplitude of the first music.

[0009] In one embodiment, the current first light transparency is determined based on the current sound amplitude of the first music, including: if the current sound amplitude is greater than the average amplitude of the first music, downward adjustment is made based on the first preset transparency to obtain the current first light transparency; if the current sound amplitude is less than the average amplitude of the first music, upward adjustment is made based on the first preset transparency to obtain the current first light transparency.

[0010] In one embodiment, the first lighting parameter includes a first light primary color; and determining the first lighting parameter according to the first music includes at least one of the following steps: determining the first light primary color according to a current sound frequency of the first music; and determining the first light primary color according to an associated image of the first music.

[0011] In one embodiment, determining the first light primary color according to the current sound frequency of the first music includes: determining a first target hue according to a numerical range of the current sound frequency; and determining the first light primary color based on the first target hue.

[0012] In one embodiment, determining the first target hue according to the numerical range of the current sound frequency includes: if the current sound frequency is less than 50 Hz, determining the first target hue to be red; if the current sound frequency is in the range of 50 Hz to 100 Hz, determining the first target hue to be orange; if the current sound frequency is in the range of 100 Hz to 500 Hz, determining the first target hue to be yellow; if the current sound frequency is in the range of 500 Hz to 2000 Hz, determining the first target hue to be green; if the current sound frequency is in the range of 2000 Hz to 200000 Hz, determining the first target hue to be blue; if the current sound frequency is greater than 20000 Hz, determining the first target hue to be purple.

[0013] In one embodiment, determining the first primary color of the light based on the associated image of the first music includes: determining a first representative color and a second representative color from the associated image; the first representative color is the color that appears most frequently in the associated image, and the second representative color is the color within a preset color value range that appears most frequently in the associated image; adjusting the brightness of the second representative color according to the brightness of the first representative color, and adjusting the saturation of the second representative color to a preset value, to obtain the first primary color of the light.

[0014] In one embodiment, the first lighting effect includes an atmosphere lighting effect; presenting the first lighting effect in the playback interface according to the first lighting parameter includes: presenting a first light spot in the playback interface according to the first lighting parameter to form the atmosphere lighting effect.

[0015] In one embodiment, presenting the lighting effect in the playback interface includes: using at least one interface element in the playback interface as a virtual light source; and presenting a second lighting effect generated by the virtual light source in the playback interface.

[0016] In one embodiment, the at least one interface element includes a play progress bar; the play progress bar is used to indicate the play progress of the first music.

[0017] In one embodiment, a progress indicator is provided on the playback progress bar, and the position of the progress indicator on the playback progress bar indicates the current playback progress of the first music; the at least one interface element includes the progress indicator; and the second lighting effect generated by the virtual light source is presented in the playback interface, including: during the playback of the first music, controlling the second lighting effect to change following the movement of the progress indicator.

[0018] In one embodiment, presenting the lighting effect in the playback interface further includes: determining a second lighting parameter based on the first music; presenting the second lighting effect generated by the virtual light source in the playback interface includes: presenting the second lighting effect generated by the virtual light source in the playback interface according to the second lighting parameter.

[0019] In one embodiment, the second lighting parameter includes a second light primary color; and determining the second lighting parameter based on the first music includes at least one of the following steps: determining the second light primary color based on a current sound frequency of the first music; and determining the second light primary color based on an associated image of the first music.

[0020] In one embodiment, determining the second light primary color based on the associated image of the first music includes: determining a second representative color from the associated image; the second representative color is a color within a preset color value range that appears most frequently in the associated image; if the brightness of the second representative color reaches a first brightness threshold, the second representative color is used as the second light primary color; if the brightness of the second representative color does not reach the first brightness threshold, the brightness of the second representative color is adjusted to the first brightness threshold to obtain the second light primary color.

[0021] In one embodiment, the second lighting parameter includes a second lighting type; and determining the second lighting parameter based on the first music includes: determining the second lighting type based on the music type of the first music.

[0022] In one embodiment, determining the second light type according to the music type of the first music includes: if the music type of the first music is pop music, determining the second light type is a diffuser light; if the music type of the first music is rock music, determining the second light type is a laser light; if the music type of the first music is folk music, determining the second light type is a spotlight; if the music type of the first music is light music, determining the second light type is a neon light.

[0023] In one embodiment, presenting the lighting effect in the playback interface includes: presenting the first lighting effect in the playback interface during the entire playback of the first music; and presenting the second lighting effect in the playback interface during the playback of a preset segment in the first music.

[0024] In one embodiment, the playback interface includes a first area and a second area, and the first area and the second area are divided by a playback progress bar; presenting the lighting effect in the playback interface includes: presenting the lighting effect in the first area.

[0025] In one embodiment, the method further includes: determining a target background according to the first music; and displaying the target background in the playback interface.

[0026] In one implementation, determining the target background according to the first music includes: determining a background main color according to the first music, and determining the target background based on the background main color.

[0027] In one embodiment, determining the background main color according to the first music includes at least one of the following steps: determining the background main color according to the current sound frequency of the first music; determining the background main color according to the associated image of the first music.

[0028] In one embodiment, determining the background main color based on the associated image of the first music includes: determining a second representative color from the associated image; the second representative color is a color within a preset color value range that appears most frequently in the associated image; if the brightness of the second representative color is greater than a second brightness threshold, adjusting the brightness of the second representative color to the second brightness threshold to obtain the background main color; if the brightness of the second representative color is less than a third brightness threshold, adjusting the brightness of the second representative color to the third brightness threshold to obtain the background main color; the third brightness threshold is less than the second brightness threshold; if the brightness of the second representative color is between the second brightness threshold and the third brightness threshold, using the second representative color as the background main color.

[0029] In one embodiment, the method further includes: presenting other visual effects other than the lighting effect in the playback interface; the other visual effects include at least one of a smoke effect and a particle effect.

[0030] In one embodiment, presenting other visual effects other than the lighting effect in the playback interface includes: determining visual effect parameters based on the first music; the visual effect parameters include at least one of smoke density, smoke movement speed, and particle quantity; and presenting the other visual effects in the playback interface according to the visual effect parameters.

[0031] In one embodiment, determining the visual effect parameters based on the first music includes: determining the current visual effect parameters based on the current sound amplitude of the first music.

[0032] According to a second aspect of the present disclosure, a playback interface processing device is provided, the device comprising: a playback interface display module, configured to display a playback interface of a first music; a lighting effect processing module, configured to present lighting effects in the playback interface; the lighting effects comprise at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect matching the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

[0033] According to a third aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method of the first aspect and possible implementation methods thereof are implemented.

[0034] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the method of the above-mentioned first aspect and its possible implementation methods by executing the executable instructions.

[0035] The technical solution disclosed in this disclosure has the following technical effects:

[0036] The lighting effect is presented in the playback interface of the first music, including at least one of the first lighting effect and the second lighting effect. The first lighting effect matches the first music, and the second lighting effect is closely integrated with the interface elements in the playback interface. In this way, a variety of lighting effects of the playback interface are achieved, and the problem of the relatively monotonous visual effect of the playback interface is improved. In addition, the first lighting effect enhances the user's sense of immersion, and the second lighting effect enhances the overall visual effect and interactivity of the playback interface, thereby improving the user's audio-visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 A schematic diagram showing a system architecture in an embodiment of the present disclosure.

[0038] Figure 2 A flowchart of a playback interface processing method in an embodiment of the present disclosure is shown.

[0039] Figure 3 A schematic diagram showing the sound amplitude of a first music in an embodiment of the present disclosure.

[0040] Figure 4 A schematic diagram showing the first light transparency corresponding to different sound amplitudes in an embodiment of the present disclosure.

[0041] Figure 5 A schematic diagram of extracting a first representative color and a second representative color in an embodiment of the present disclosure is shown.

[0042] Figure 6 A schematic diagram showing an embodiment of the present disclosure in which a progress indicator is used as a virtual light source to emit a second lighting effect.

[0043] Figure 7 Schematic diagram showing different lighting types in embodiments of the present disclosure.

[0044] Figure 8 A comparison diagram showing different effects in the embodiments of the present disclosure.

[0045] Fig. 9 A schematic structural diagram of a playback interface processing device in an embodiment of the present disclosure is shown.

[0046] Fig.10A schematic structural diagram of an electronic device in an embodiment of the present disclosure is shown.

[0047] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts. DETAILED DESCRIPTION

[0048] The following is a detailed description of the principles and spirit of the present disclosure with reference to several representative embodiments of the present disclosure. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present disclosure, and are not intended to limit the scope of the present disclosure in any way. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

[0049] The embodiments of the present disclosure may be implemented as a system, device, apparatus, method or computer program product. Therefore, the present disclosure may be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software. SUMMARY OF THE INVENTION

[0051] In the related art, in music playing software, the display content of the playing interface is relatively fixed, resulting in a relatively monotonous visual effect, which affects the user experience.

[0052] In view of the above, the present disclosure provides a playback interface processing method, a playback interface processing device, a computer program product and an electronic device. A lighting effect is presented in the playback interface of a first music, including at least one of a first lighting effect and a second lighting effect. The first lighting effect matches the first music, and the second lighting effect is closely integrated with the interface elements in the playback interface. In this way, a variety of playback interface lighting effects are achieved, which improves the problem that the visual effect of the playback interface is relatively monotonous. In addition, the first lighting effect enhances the user's sense of immersion, and the second lighting effect enhances the overall visual effect and interactivity of the playback interface, thereby improving the user's audio-visual experience.

[0053] After introducing the basic principles of the present disclosure, various non-limiting embodiments of the present disclosure are described in detail below.

[0054] Application Scenario Overview

[0055] It should be noted that the following application scenarios are only shown to facilitate understanding of the spirit and principles of the present disclosure, and the embodiments of the present disclosure are not limited in this regard and can be applied to any applicable scenarios.

[0056] The embodiments of the present disclosure can be used in scenarios such as music apps (Applications), music websites, etc., to present lighting effects in the playback interface, thereby enhancing the visual effects of the playback interface.

[0057] Figure 1 The system architecture of the operating environment of the embodiment of the present disclosure is shown. The system architecture may include a terminal device 110 and a server 120. The terminal device 110 may be a mobile phone, a personal computer, a tablet computer, a smart wearable device, etc., and has an audio function. It can run audio-related programs, such as a music app, a music website, etc., to play the first music or other music. In addition, the terminal device 110 has a display function and can display a playback interface. The server 120 is a background for providing music-related services, and may be a server or a cluster formed by multiple servers. In one embodiment, the server 120 may include a first service system and a second service system, the first service system providing music services, and the second service system providing visual effect services for the playback interface, such as providing data processing services for lighting effects. The terminal device 110 and the server 120 may be connected via a wired or wireless communication link to achieve information interaction.

[0058] The playback interface processing method in the embodiments of the present disclosure may be executed by the terminal device 110 or the server 120 alone, or may be executed by the terminal device 110 and the server 120 together.

[0059] In one embodiment, the terminal device 110 may independently execute the playback interface processing method without setting the server 120. For example, the terminal device 110 may run a music app in a stand-alone environment, display the playback interface of the first music, and render and present the lighting effect.

[0060] Exemplary Methods

[0061] The following is an exemplary description of the playback interface processing method in the embodiment of the present disclosure. Figure 2 The process of the playback interface processing method is shown, which may include steps S210 and S220. Figure 2 Provide detailed instructions for each step.

[0062] In step S210, the playback interface of the first music is displayed.

[0063] The first music may be currently played music, such as music selected by the user, or current music played in a playlist selected by the user in a play order. When the first music is played, a play interface of the first music may be displayed.

[0064] In step S220, a lighting effect is presented in the playback interface; the lighting effect includes at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect matching the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

[0065] Among them, the first lighting effect can match one or more aspects of the first music. The characteristics of the first music include but are not limited to: auditory characteristics, such as the sound amplitude, sound frequency, timbre characteristics, rhythm characteristics, music type, and style characteristics of the first music; visual characteristics, such as image characteristics of the associated image of the first music, and the associated image may include the album image, poster image, etc. of the first music; semantic characteristics, such as the semantic characteristics of the text such as the title and lyrics of the first music. The first lighting effect is adaptive to the characteristics of the first music, thereby realizing a diversified and personalized first lighting effect. It improves the problem of monotonous visual effects of the playback interface when playing different music. And enhances the user's sense of immersion.

[0066] In one embodiment, the first lighting effect can match the sound amplitude of the first music, and the color, intensity, direction, etc. of the light change synchronously with the sound amplitude of the first music, so that the first lighting effect adapts to the rhythm change of the first music. The user's visual experience of watching the first lighting effect and the auditory experience of listening to the first music are well combined, thereby improving the audio-visual experience.

[0067] The first music playback interface is provided with interface elements. The interface elements include, but are not limited to: controls, such as a playback progress bar, a progress indicator on the playback progress bar, a play / pause control, a previous track jump control, a next track jump control, etc.; text information, such as a song title, album name, artist name, lyrics, etc.; other visual elements, such as records, images, etc. At least one of the interface elements is used as a virtual light source, and the second light effect is emitted by the virtual light source. For example, the progress indicator is used as a virtual light source to emit the second light effect, and the progress indicator looks like a stage light combined with the second light effect. In this way, in the user's visual experience, the second light effect is embedded in the playback interface, as if it is a part of the playback interface itself, which enhances the overall visual effect and interactivity of the playback interface.

[0068] In the implementation manner of the present disclosure, the first lighting effect and the second lighting effect may be presented in the playback interface, or only the first lighting effect or the second lighting effect may be presented.

[0069] In one implementation, presenting the lighting effect in the playback interface may include the following steps:

[0070] Determine a first lighting parameter according to the first music;

[0071] The first lighting effect is presented in the playback interface according to the first lighting parameter.

[0072] The first lighting parameters refer to parameters related to the first lighting effect, which may include but are not limited to: first light transparency, first light brightness, first light primary color, first light intensity, first light type, etc. A correspondence between the characteristics of the music and the first lighting parameters may be established in advance. When the first music is played, the corresponding first lighting parameters are determined according to the characteristics of the first music, thereby presenting the corresponding first lighting effect.

[0073] In one embodiment, the first lighting parameter includes a first lighting transparency. The step of determining the first lighting parameter according to the first music may include:

[0074] According to the current sound amplitude of the first music, the current transparency of the first light is determined.

[0075] During the playing of the first music, the sound amplitude generally changes in real time. According to the current sound amplitude of the first music, the current transparency of the first light is determined. Exemplarily, a numerical correspondence between the sound amplitude and the first light transparency can be preset, and based on the correspondence, the current first light transparency corresponding to the current sound amplitude is calculated in real time. Then, the transparency of the first light effect is adjusted in real time according to the current first light transparency, so that the first light effect changes synchronously with the change of the sound amplitude. This enhances the user's audio-visual experience.

[0076] In one embodiment, the step of determining the current transparency of the first light according to the current sound amplitude of the first music may include:

[0077] If the current sound amplitude is greater than the average amplitude of the first music, the first preset transparency is adjusted downward to obtain the current first light transparency;

[0078] If the current sound amplitude is smaller than the average amplitude of the first music, the first preset transparency is adjusted upward to obtain the current first light transparency.

[0079] The average amplitude of the first music refers to the average value of the sound amplitude of the entire first music. The first preset transparency is a preset default value of the first light transparency, such as 0.5. In one embodiment, the first preset transparency may be the first light transparency corresponding to the average amplitude of the first music.

[0080] Figure 3A schematic diagram of the sound amplitude of the first music is shown. It should be noted that the vibration of the sound has different directions, and the amplitude in the figure is positive and negative to represent two directions. The embodiment of the present disclosure may not consider the difference in different directions, so the amplitude can be converted into an absolute value for calculation. The integral value of the amplitude can be calculated and divided by the duration to obtain the average amplitude of the first music.

[0081] The transparency of the first light can be negatively correlated with the current sound amplitude, that is, the larger the current sound amplitude is, the lower the transparency of the first light is, and the more obvious the first light effect is. For example, the first preset transparency is 0.5, and the average amplitude is regarded as a 50% amplitude level. If the current sound amplitude is greater than the average amplitude of the first music, the first preset transparency is lowered by 0.1 for every 10% excess of the average amplitude, that is, when the current sound amplitude reaches 60% amplitude level, the current first light transparency is 0.4, when the current sound amplitude reaches 70% amplitude level, the current first light transparency is 0.3, and when the current sound amplitude reaches 100% amplitude level, the current first light transparency is 0. On the contrary, if the current sound amplitude is less than the average amplitude of the first music, the first preset transparency will be increased by 0.1 for every 10% below the average amplitude. That is, when the current sound amplitude reaches 40% amplitude level, the current first light transparency is 0.6; when the current sound amplitude reaches 30% amplitude level, the current first light transparency is 0.7; when the current sound amplitude reaches 0 amplitude level, the current first light transparency is 1 (the maximum value of transparency can be 1, indicating complete transparency).

[0082] Figure 4 A schematic diagram showing the first light transparency corresponding to different sound amplitudes. If the current sound amplitude reaches the 50% amplitude level (i.e., the average amplitude level), the corresponding first light transparency is 0.5. If the current sound amplitude reaches the 60% amplitude level, the corresponding first light transparency is 0.4. If the current sound amplitude reaches the 70% amplitude level, the corresponding first light transparency is 0.3. If the current sound amplitude reaches the 80% amplitude level, the corresponding first light transparency is 0.2. If the current sound amplitude reaches the 90% amplitude level, the corresponding first light transparency is 0.1. If the current sound amplitude reaches the 100% amplitude level, the corresponding first light transparency is 0. As the first light transparency gradually decreases, the first light effect becomes more and more obvious.

[0083] In one embodiment, the first light parameter includes the first light brightness. The current first light brightness can be determined according to the current sound amplitude of the first music. If the current sound amplitude is greater than the average amplitude of the first music, the brightness is adjusted upward based on the first preset brightness to obtain the current first light brightness; if the current sound amplitude is less than the average amplitude of the first music, the brightness is adjusted downward based on the first preset brightness to obtain the current first light brightness. For example, the first preset brightness is 50 (assuming the brightness range is 0-100), and the average amplitude is regarded as a 50% amplitude level. If the current sound amplitude is greater than the average amplitude of the first music, the first preset brightness is adjusted upward by 10 for every 10% excess of the average amplitude, that is, when the current sound amplitude reaches the 60% amplitude level, the current first light brightness is 60, when the current sound amplitude reaches the 70% amplitude level, the current first light brightness is 70, and when the current sound amplitude reaches the 100% amplitude level, the current first light brightness is 100. On the contrary, if the current sound amplitude is less than the average amplitude of the first music, the first preset brightness will be reduced by 10 for every 10% below the average amplitude. That is, when the current sound amplitude reaches 40% amplitude level, the current first light brightness is 40; when the current sound amplitude reaches 30% amplitude level, the current first light brightness is 30; when the current sound amplitude reaches 0 amplitude level, the current first light brightness is 0.

[0084] In one embodiment, the first lighting parameter includes a first lighting primary color. The lighting primary color refers to the main color or hue in the lighting effect. For example, the first lighting effect may include only one color, which is the first lighting primary color. Alternatively, the first lighting effect may include multiple colors, which may be similar to the first lighting primary color. The above-mentioned determination of the first lighting parameter according to the first music may include at least one of the following steps:

[0085] ① According to the current sound frequency of the first music, determine the primary color of the first light.

[0086] Generally, the higher the sound frequency, the higher the pitch, and the lower the sound frequency, the lower the pitch. The primary colors corresponding to different sound frequencies can be predetermined, such as the hue of the primary color gradually increases, or the saturation gradually increases, or the brightness gradually increases as the sound frequency increases from low to high. According to the current sound frequency of the first music, the current primary color of the first light is determined. In this way, the sound frequency is embodied in a concrete way through the primary color of the first light.

[0087] In one embodiment, the step of determining the primary color of the first light according to the current sound frequency of the first music may include:

[0088] Determine the first target hue according to the numerical range of the current sound frequency;

[0089] A first light primary color is determined based on the first target hue.

[0090] The first target hue refers to the color range of the primary color of the first light. A correspondence between different sound frequency value intervals and different hues can be set. Based on the correspondence, the hue corresponding to the value interval of the current sound frequency is used as the first target hue. In one embodiment, the step of determining the first target hue according to the value interval of the current sound frequency may include:

[0091] If the current sound frequency is less than 50 Hz, the first target hue is determined to be red;

[0092] If the current sound frequency is in the range of 50 Hz to 100 Hz, the first target hue is determined to be orange;

[0093] If the current sound frequency is in the range of 100 Hz to 500 Hz, the first target hue is determined to be yellow;

[0094] If the current sound frequency is in the range of 500 Hz to 2000 Hz, the first target hue is determined to be green;

[0095] If the current sound frequency is in the range of 2000Hz to 200000Hz, the first target hue is determined to be blue;

[0096] If the current sound frequency is greater than 20000 Hz, the first target hue is determined to be purple.

[0097] Among them, red, orange, yellow, green, blue, and purple are different colors in visible light, and their light frequencies gradually increase. According to the magnitude relationship of the light frequencies of these six colors, the corresponding relationship with the numerical range of the sound frequency is set. In this way, the relative magnitude relationship between the light frequency and the sound frequency corresponding to the first target hue determined according to the current sound frequency is consistent. The matching between the visual characteristics of the first lighting effect and the auditory characteristics of the first music is improved.

[0098] It should be understood that the above-mentioned numerical range and the first target hue are merely exemplary, and the above-mentioned numerical range and its corresponding hue may be adjusted according to specific needs.

[0099] When the first target hue is determined, the first light primary color may be determined within the first target hue, for example, a color may be randomly selected within the first target hue as the first light primary color, or a central color within the first target hue may be used as the first light primary color, and so on.

[0100] ② Determine the primary color of the first light based on the associated image of the first music.

[0101] The associated image may include an album image, a poster image, etc. of the first music, such as an image displayed in the playback interface of the first music. The primary color of the first light may be determined according to the color in the associated image, so that the primary color of the first light matches the color feature of the associated image, so that the entire playback interface is more visually harmonious, further improving the visual effect.

[0102] In one embodiment, the step of determining the primary color of the first light according to the associated image of the first music may include:

[0103] Determine a first representative color and a second representative color from the associated image; the first representative color is the color that appears most frequently in the associated image, and the second representative color is the color that appears most frequently in the associated image and is within a preset color value range;

[0104] The brightness of the second representative color is adjusted according to the brightness of the first representative color, and the saturation of the second representative color is adjusted to a preset value to obtain the first light main color.

[0105] Among them, the number of occurrences of each color in the associated image (i.e., the number of pixels of each color) can be counted, and the color that appears most often is used as the first representative color to represent the most common color in the associated image. The number of occurrences of each color in the preset color value range in the associated image is counted, and the color that appears most often is used as the second representative color. The preset color value range can be the color value range of the foreground part in the associated image or the artificially set color value range, excluding the influence of large areas of background and other areas that may exist in the associated image. For example, in the HSL (H represents hue, S represents saturation, and L represents brightness) color mode, the preset color value range can be a color value range in which S is at a higher level (such as above 150) and L is at a moderate level (such as the full range of L is 0 to 100, and the moderate level range can be 50 to 90). The second representative color counted based on the preset color value range can represent the most vivid color in the associated image. Figure 5 A schematic diagram showing the first representative color and the second representative color extracted from different associated images is shown. It can be seen that the first representative color may be the background color, and the second representative color is usually the foreground color.

[0106] When the first representative color and the second representative color are determined, the brightness of the second representative color can be adjusted according to the brightness of the first representative color, and the saturation of the second representative color can be adjusted to a preset value. For example, if the brightness of the first representative color is less than or equal to 40, the brightness of the second representative color is adjusted to 50, and if the brightness of the first representative color is greater than 40, the brightness of the second representative color is adjusted to 30. And the saturation of the second representative color is adjusted to 60. The adjusted second representative color is the primary color of the first light. In this way, the primary color of the first light can better match the first representative color, and the visual effect of the combination of the two is better.

[0107] In one embodiment, when an associated image of the first music is obtained, the primary color of the first light is determined according to the associated image. When an associated image of the first music is not obtained, the primary color of the first light is determined according to the current sound frequency of the first music.

[0108] The above specifically describes how to determine the first light parameters according to the first music from the aspects of first light transparency, first light brightness, first light primary color, etc. It should be understood that other types of first light parameters, such as first light intensity, etc., can also be determined according to the first music.

[0109] In one embodiment, the first lighting effect includes an atmosphere lighting effect. The step of presenting the first lighting effect in the playback interface according to the first lighting parameter may include:

[0110] A first light spot is presented in the playback interface according to the first light parameter to form an ambient light effect.

[0111] The first light spot is an atmosphere light spot with a preset shape and a preset size, as shown in the above Figure 4 As shown, it can be a circular or elliptical light spot spreading around the central image, indicating the ambient lighting effect of light shining on the surface of the object.

[0112] In one embodiment, in response to a change in the playing progress of the first music, the current first light parameters (such as the current first light transparency, the first light primary color, etc.) are determined according to the current characteristics of the first music after the progress change (such as the current sound amplitude, the current sound frequency, etc.), and the corresponding first light effect is presented. That is, when the playing progress of the first music changes, the transparency, color, etc. of the first light effect change synchronously.

[0113] In one embodiment, when the user drags the progress indicator on the playback progress bar to adjust the playback progress, the playback progress of the first music does not actually change during the dragging process. When the user operation ends (such as releasing the hand), the operation takes effect and the playback progress of the first music changes. At this time, the current first lighting parameters are determined based on the current characteristics of the first music after the progress change, and the corresponding first lighting effect is presented.

[0114] In one implementation, the step of presenting the lighting effect in the playback interface may include:

[0115] Using at least one interface element in the playback interface as a virtual light source;

[0116] A second lighting effect generated by the virtual light source is presented in the playback interface.

[0117] Wherein, when at least one interface element is determined as a virtual light source, a second lighting effect with a starting point located at the interface element may be rendered to present a visual experience of the second lighting effect being emitted by the interface element.

[0118] In one embodiment, the at least one interface element may include a play progress bar, which is used to indicate the play progress of the first music, and may be in the form of a timeline. A light effect may be rendered for the play progress bar, and the starting point of the second light effect may be located on the play progress bar. In this way, in terms of visual perception, the play progress bar is like a light bar, which emits the second light effect. This makes the entire play interface look like a stage scene, increasing the user's immersive feeling.

[0119] In one embodiment, a progress indicator is provided on the play progress bar, and the position of the progress indicator on the play progress bar indicates the current play progress of the first music. For example, the progress indicator can be a ball, a square, an arrow or other graphics on the play progress bar, and as the first music is played, the progress indicator gradually moves to the right on the play progress bar. In addition, the user can drag the progress indicator to adjust the play progress. The at least one interface element may include a progress indicator. That is, the progress indicator can be used as a virtual light source to present a picture of a second light effect emitted by the progress indicator. A luminous effect can be rendered for the progress indicator, and the starting point of the rendering of the second light effect is located at the progress indicator. In this way, in terms of visual perception, the progress indicator is like a lamp, which emits a second light effect. Further enhance the stage presence of the entire play interface.

[0120] In one implementation, the step of presenting the second lighting effect generated by the virtual light source in the playback interface may include:

[0121] During the playing of the first music, the second lighting effect is controlled to change along with the movement of the progress indicator.

[0122] As the first music is played, the position of the progress mark on the play progress bar moves, such as gradually moving to the right. Since the progress mark is a virtual light source for the second lighting effect, the starting point of the second lighting effect can be controlled to always be located on the progress mark, so that the second lighting effect changes with the movement of the progress mark, such as position change, direction change, etc.

[0123] Figure 6 A schematic diagram of using the progress indicator as a virtual light source to emit the second light effect is shown. As the first music is played, the progress indicator moves to the right, controlling the second light effect to move synchronously. This achieves a strong stage performance in the playback interface.

[0124] In one embodiment, the step of presenting the lighting effect in the playback interface may further include: determining the second lighting parameter according to the first music. Correspondingly, the step of presenting the second lighting effect generated by the virtual light source in the playback interface may include: presenting the second lighting effect generated by the virtual light source in the playback interface according to the second lighting parameter.

[0125] Among them, the second light parameter refers to the relevant parameters of the second light effect, which may include but not limited to: second light transparency, second light brightness, second light main color, second light intensity, second light type, etc. The corresponding relationship between the characteristics of the music and the second light parameter can be established in advance. When playing the first music, the corresponding second light parameter is determined according to the characteristics of the first music, and then the corresponding second light effect is presented. In this way, the second light effect matches the first music, so that the visual experience of the user watching the second light effect and the auditory experience of listening to the first music are better combined, the user's sense of immersion is increased, and a diversified and personalized second light effect can be achieved.

[0126] In one embodiment, the second lighting parameter includes a second lighting primary color. The second lighting primary color refers to the main color or hue in the second lighting effect. Determining the second lighting parameter according to the first music may include at least one of the following steps:

[0127] ③Determine the main color of the second light according to the current sound frequency of the first music.

[0128] The above-mentioned scheme content for determining the primary color of the first light according to the current sound frequency of the first music can be referred to. In one embodiment, the second target hue is determined according to the numerical range of the current sound frequency. For example, if the current sound frequency is less than 50Hz, the second target hue is determined to be red; if the current sound frequency is in the range of 50Hz to 100Hz, the second target hue is determined to be orange; if the current sound frequency is in the range of 100Hz to 500Hz, the second target hue is determined to be yellow; if the current sound frequency is in the range of 500Hz to 2000Hz, the second target hue is determined to be green; if the current sound frequency is in the range of 2000Hz to 200000Hz, the second target hue is determined to be blue; if the current sound frequency is greater than 20000Hz, the second target hue is determined to be purple. The primary color of the second light is determined based on the second target hue. For example, a random color or a central color within the second target hue can be used as the primary color of the second light.

[0129] ④ Determine the main color of the second light based on the associated image of the first music.

[0130] The second light main color can be determined according to the color in the associated image, so that the second light main color matches the color characteristics of the associated image, so that the entire playback interface is more harmonious visually, further improving the visual effect.

[0131] In one embodiment, the step of determining the second light primary color according to the associated image of the first music may include:

[0132] Determine a second representative color from the associated image; the second representative color is a color within a preset color value range that appears most frequently in the associated image;

[0133] If the brightness of the second representative color reaches the first brightness threshold, the second representative color is used as the second light primary color;

[0134] If the brightness of the second representative color does not reach the first brightness threshold, the brightness of the second representative color is adjusted to the first brightness threshold to obtain the second main color of the light.

[0135] The first brightness threshold can be determined based on experience or specific circumstances, such as 95. If the brightness of the second representative color reaches 95, there is no need to adjust the second representative color, and the second representative color is directly used as the second light primary color. If the brightness of the second representative color is less than 95, the brightness of the second representative color can be adjusted to 95 to obtain the second light primary color. This ensures that the second light primary color has a higher brightness and enhances the expressiveness of the second light effect.

[0136] In one embodiment, when an associated image of the first music is obtained, the second light primary color is determined according to the associated image. When an associated image of the first music is not obtained, the second light primary color is determined according to the current sound frequency of the first music.

[0137] In one embodiment, the second lighting parameter includes a second lighting type. The step of determining the second lighting parameter according to the first music may include:

[0138] The second lighting type is determined according to the music type of the first music.

[0139] The music type of the first music reflects the characteristics of the first music, such as the style, rhythm, and emotion. The second lighting type is determined according to the music type of the first music, and the corresponding type of second lighting effect is presented, so that the second lighting effect is adapted to the music type of the first music. Increase the expressiveness of the picture. Reference Figure 7For example, if the music type of the first music is pop music, the second light type is determined to be a diffuse light. If the music type of the first music is rock music, the second light type is determined to be a laser light. If the music type of the first music is metal or punk music, the second light type is determined to be a laser light (which can be regarded as a type of laser light, or the laser light and the laser light can be regarded as two different light types). If the music type of the first music is folk music, the second light type is determined to be a spotlight, and the spotlight effect can be achieved by rendering the second light spot. If the music type of the first music is light music, the second light type is determined to be a neon light, and the neon light effect can be achieved by rendering the third light spot.

[0140] The first lighting effect and the second lighting effect are described above. During the playing of the first music, different time periods can be set according to requirements to present different lighting effects.

[0141] In one implementation, presenting a lighting effect in a playback interface may include:

[0142] During the entire playing process of the first music, the first lighting effect is presented in the playing interface;

[0143] During the playback of a preset segment in the first music, a second lighting effect is presented in the playback interface.

[0144] The entire playing process of the first music may refer to the entire time range of the playing progress bar of the first music, or may refer to the time range in which music exists (excluding the time range without music that may exist at the beginning and end of the playing progress bar). During the playing process of the first music, the first lighting effect may be always presented to render a stage live atmosphere of the playing interface.

[0145] The preset segment can be determined according to specific needs, such as the chorus segment of the first music. In this way, when the chorus part of the first music is played, the second lighting effect is presented to enhance the stage live dynamics of the playback interface.

[0146] In one embodiment, the playback interface includes a first area and a second area, and the first area and the second area are separated by a playback progress bar. For example, the playback progress bar is located in the middle and lower part of the playback interface, the playback interface area above the playback progress bar is the first area, and the playback interface area below the playback progress bar is the second area. The area of ​​the first area is larger than the second area. The step of presenting the lighting effect in the playback interface may include:

[0147] Present lighting effects in the first area.

[0148] Generally, the controls in the playback interface (such as the play / pause control, the previous track jump control, the next track jump control, etc.) are mostly located in the second area, and the lighting effects are only presented in the first area, and not in the second area, so as to avoid the lighting effects affecting the display state of the controls and interfering with the user's operation of the controls. In addition, since the stage scene usually includes a stage part and an auditorium part, the stage part can be simulated in the first area, the auditorium part can be simulated in the second area, and the lighting effects can be presented in the first area, so as to better simulate the actual stage effects and increase the visual expressiveness of the playback interface.

[0149] In one implementation, the playback interface processing method may further include the following steps:

[0150] Determine the target background based on the first music;

[0151] Display the target background in the playback interface.

[0152] That is, the target background displayed in the playback interface can match the first music, thus more fully realizing a personalized and diversified playback interface and improving the visual effect.

[0153] In one implementation, the step of determining the target background according to the first music may include:

[0154] A background main color is determined according to the first music, and a target background is determined based on the background main color.

[0155] The background main color refers to the main color or hue in the background. A color matching the first music can be determined as the background main color. Then, the target background is determined based on the background main color. For example, the target background can be a solid color background, a gradient color background, a pattern background, etc. based on the background main color.

[0156] In one implementation, determining the background main color according to the first music may include at least one of the following steps:

[0157] ⑤ Determine the main background color according to the current sound frequency of the first music.

[0158] The above-mentioned scheme content for determining the primary color of the first light or the primary color of the second light according to the current sound frequency of the first music can be referred to. In one embodiment, the third target hue is determined according to the numerical range of the current sound frequency. For example, if the current sound frequency is less than 50Hz, the third target hue is determined to be red; if the current sound frequency is in the range of 50Hz to 100Hz, the third target hue is determined to be orange; if the current sound frequency is in the range of 100Hz to 500Hz, the third target hue is determined to be yellow; if the current sound frequency is in the range of 500Hz to 2000Hz, the third target hue is determined to be green; if the current sound frequency is in the range of 2000Hz to 200000Hz, the third target hue is determined to be blue; if the current sound frequency is greater than 20000Hz, the third target hue is determined to be purple. The background primary color is determined based on the third target hue. For example, a random color or a central color within the third target hue can be used as the background primary color.

[0159] ⑥ Determine the main background color based on the associated image of the first music.

[0160] The main background color can be determined according to the color in the associated image, so that the main background color matches the color characteristics of the associated image, so that the entire playback interface is more harmonious visually, further improving the visual effect.

[0161] In one implementation, the step of determining the background main color according to the associated image of the first music may include:

[0162] Determine a second representative color from the associated image; the second representative color is a color within a preset color value range that appears most frequently in the associated image;

[0163] If the brightness of the second representative color is greater than the second brightness threshold, the brightness of the second representative color is adjusted to the second brightness threshold to obtain the background main color;

[0164] If the brightness of the second representative color is less than the third brightness threshold, the brightness of the second representative color is adjusted to the third brightness threshold to obtain the background main color; the third brightness threshold is less than the second brightness threshold;

[0165] If the brightness of the second representative color is between the second brightness threshold and the third brightness threshold, the second representative color is used as the background main color.

[0166] Among them, the second brightness threshold and the third brightness threshold can be determined based on experience or specific circumstances, such as the second brightness threshold is 15 and the third brightness threshold is 12. If the brightness of the second representative color is greater than 15, the brightness of the second representative color is adjusted to 15 to obtain the background main color. If the brightness of the second representative color is less than 12, the brightness of the second representative color is adjusted to 12 to obtain the background main color. If the brightness of the second representative color is between 12 and 15, the second representative color is directly used as the background main color. This ensures that the background main color and the second representative color have the same hue and saturation, and the two are visually similar in color. And it ensures that the brightness of the background main color is within an appropriate range to avoid the background being too bright or too dark.

[0167] In one embodiment, when the associated image of the first music is acquired, the background main color is determined according to the associated image. When the associated image of the first music is not acquired, the background main color is determined according to the current sound frequency of the first music.

[0168] In one implementation, the playback interface processing method may further include:

[0169] Other visual effects besides lighting effects are presented in the playback interface; other visual effects include at least one of smoke effects and particle effects.

[0170] That is, in addition to lighting effects, other visual effects can be added to further enhance the visual expressiveness of the playback interface.

[0171] In one embodiment, the step of presenting other visual effects besides lighting effects in the playback interface may include:

[0172] Determining a visual effect parameter according to the first music; the visual effect parameter includes at least one of smoke density, smoke movement speed, and particle quantity;

[0173] Other visual effects are presented in the playback interface according to the visual effect parameters.

[0174] In this regard, other visual effects can be matched with the first music, such as changing according to changes in the rhythm of the first music, etc., to further enhance the visual effect.

[0175] In one implementation, the step of determining the visual effect parameter according to the first music may include:

[0176] Determine current visual effect parameters based on the current sound amplitude of the first music.

[0177] Exemplarily, if the current sound amplitude is greater than the average amplitude of the first music, the preset visual effect parameters are adjusted upward to obtain the current visual effect parameters; if the current sound amplitude is less than the average amplitude of the first music, the preset visual effect parameters are adjusted downward to obtain the current visual effect parameters.

[0178] For example, the preset smoke density is 1. Every time the current sound amplitude exceeds the average amplitude by 10%, the preset smoke density is increased by 0.1 to obtain the current smoke density. Every time it is lower than the average amplitude by 10%, the preset smoke density is reduced by 0.1 to obtain the current smoke density. The preset smoke movement speed is 1. Every time the current sound amplitude exceeds the average amplitude by 10%, the preset smoke movement speed is increased by 0.1 to obtain the current smoke movement speed. Every time it is lower than the average amplitude by 10%, the preset smoke movement speed is reduced by 0.1 to obtain the current smoke movement speed. The preset number of particles is 1. Every time the current sound amplitude exceeds the average amplitude by 10%, the preset number of particles is increased by 0.1 to obtain the current number of particles. Every time it is lower than the average amplitude by 10%, the preset number of particles is reduced by 0.1 to obtain the current number of particles.

[0179] Figure 8 The schematic diagrams show that no light effect and other visual effects are displayed, only the first light effect is displayed, the first light effect plus smoke effect is displayed, and the first light effect, smoke effect and particle effect are displayed. It can be seen that as the display effects increase, the visual expression becomes stronger and stronger.

[0180] In one embodiment, in response to switching from the first music to other music, or pausing the playing of the first music, one or more of the above-mentioned first lighting parameter, second lighting parameter, and other effect parameters can be adjusted to a preset value (such as a first preset transparency, a preset visual effect parameter), and a corresponding effect is presented. For example, when switching music or pausing the playing of music, the first light transparency is adjusted to 0.5, the smoke density, smoke movement speed, and the number of particles are all adjusted to 1, and the corresponding first light effect, smoke effect, and particle effect are presented. After switching to other music, one or more of the first lighting parameter, second lighting parameter, and other effect parameters can be further controlled according to the real-time characteristics of the other music (such as sound amplitude, sound frequency, etc.). For details, please refer to the solution content of determining the first lighting parameter, the second lighting parameter, and other effect parameters according to the first music. Thereby, personalized lighting effects or other effects are presented for different music.

[0181] Exemplary Devices

[0182] The following is a description of the playback interface processing device in the embodiment of the present disclosure. Fig. 9As shown, the playback interface processing device 900 may include the following modules:

[0183] The playing interface display module 910 is configured to display the playing interface of the first music;

[0184] The lighting effect processing module 920 is configured to present lighting effects in the playback interface; the lighting effects include at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect matching the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

[0185] In one embodiment, presenting the lighting effect in the playback interface includes: determining a first lighting parameter based on the first music; and presenting the first lighting effect in the playback interface according to the first lighting parameter.

[0186] In one embodiment, the first lighting parameter includes a first lighting transparency; and determining the first lighting parameter according to the first music includes: determining a current first lighting transparency according to a current sound amplitude of the first music.

[0187] In one embodiment, the current first light transparency is determined based on the current sound amplitude of the first music, including: if the current sound amplitude is greater than the average amplitude of the first music, downward adjustment is made based on the first preset transparency to obtain the current first light transparency; if the current sound amplitude is less than the average amplitude of the first music, upward adjustment is made based on the first preset transparency to obtain the current first light transparency.

[0188] In one embodiment, the first lighting parameter includes a first light primary color; and determining the first lighting parameter according to the first music includes at least one of the following steps: determining the first light primary color according to a current sound frequency of the first music; and determining the first light primary color according to an associated image of the first music.

[0189] In one embodiment, determining the first light primary color according to the current sound frequency of the first music includes: determining a first target hue according to a numerical range of the current sound frequency; and determining the first light primary color based on the first target hue.

[0190] In one embodiment, determining the first target hue according to the numerical range of the current sound frequency includes: if the current sound frequency is less than 50 Hz, determining the first target hue to be red; if the current sound frequency is in the range of 50 Hz to 100 Hz, determining the first target hue to be orange; if the current sound frequency is in the range of 100 Hz to 500 Hz, determining the first target hue to be yellow; if the current sound frequency is in the range of 500 Hz to 2000 Hz, determining the first target hue to be green; if the current sound frequency is in the range of 2000 Hz to 200000 Hz, determining the first target hue to be blue; if the current sound frequency is greater than 20000 Hz, determining the first target hue to be purple.

[0191] In one embodiment, determining the first primary color of the light based on the associated image of the first music includes: determining a first representative color and a second representative color from the associated image; the first representative color is the color that appears most frequently in the associated image, and the second representative color is the color within a preset color value range that appears most frequently in the associated image; adjusting the brightness of the second representative color according to the brightness of the first representative color, and adjusting the saturation of the second representative color to a preset value, to obtain the first primary color of the light.

[0192] In one embodiment, the first lighting effect includes an atmosphere lighting effect; presenting the first lighting effect in the playback interface according to the first lighting parameter includes: presenting a first light spot in the playback interface according to the first lighting parameter to form the atmosphere lighting effect.

[0193] In one embodiment, presenting the lighting effect in the playback interface includes: using at least one interface element in the playback interface as a virtual light source; and presenting a second lighting effect generated by the virtual light source in the playback interface.

[0194] In one embodiment, the at least one interface element includes a play progress bar; the play progress bar is used to indicate the play progress of the first music.

[0195] In one embodiment, a progress indicator is provided on the playback progress bar, and the position of the progress indicator on the playback progress bar indicates the current playback progress of the first music; the at least one interface element includes the progress indicator; and the second lighting effect generated by the virtual light source is presented in the playback interface, including: during the playback of the first music, controlling the second lighting effect to change following the movement of the progress indicator.

[0196] In one embodiment, presenting the lighting effect in the playback interface further includes: determining a second lighting parameter based on the first music; presenting the second lighting effect generated by the virtual light source in the playback interface includes: presenting the second lighting effect generated by the virtual light source in the playback interface according to the second lighting parameter.

[0197] In one embodiment, the second lighting parameter includes a second light primary color; and determining the second lighting parameter based on the first music includes at least one of the following steps: determining the second light primary color based on a current sound frequency of the first music; and determining the second light primary color based on an associated image of the first music.

[0198] In one embodiment, determining the second light primary color based on the associated image of the first music includes: determining a second representative color from the associated image; the second representative color is a color within a preset color value range that appears most frequently in the associated image; if the brightness of the second representative color reaches a first brightness threshold, the second representative color is used as the second light primary color; if the brightness of the second representative color does not reach the first brightness threshold, the brightness of the second representative color is adjusted to the first brightness threshold to obtain the second light primary color.

[0199] In one embodiment, the second lighting parameter includes a second lighting type; and determining the second lighting parameter based on the first music includes: determining the second lighting type based on the music type of the first music.

[0200] In one embodiment, determining the second light type according to the music type of the first music includes: if the music type of the first music is pop music, determining the second light type is a diffuser light; if the music type of the first music is rock music, determining the second light type is a laser light; if the music type of the first music is folk music, determining the second light type is a spotlight; if the music type of the first music is light music, determining the second light type is a neon light.

[0201] In one embodiment, presenting the lighting effect in the playback interface includes: presenting the first lighting effect in the playback interface during the entire playback of the first music; and presenting the second lighting effect in the playback interface during the playback of a preset segment in the first music.

[0202] In one embodiment, the playback interface includes a first area and a second area, and the first area and the second area are divided by a playback progress bar; presenting the lighting effect in the playback interface includes: presenting the lighting effect in the first area.

[0203] In one embodiment, the device further includes a background processing module configured to: determine a target background according to the first music; and display the target background in the playback interface.

[0204] In one implementation, determining the target background according to the first music includes: determining a background main color according to the first music, and determining the target background based on the background main color.

[0205] In one embodiment, determining the background main color according to the first music includes at least one of the following steps: determining the background main color according to the current sound frequency of the first music; determining the background main color according to the associated image of the first music.

[0206] In one embodiment, determining the background main color based on the associated image of the first music includes: determining a second representative color from the associated image; the second representative color is a color within a preset color value range that appears most frequently in the associated image; if the brightness of the second representative color is greater than a second brightness threshold, adjusting the brightness of the second representative color to the second brightness threshold to obtain the background main color; if the brightness of the second representative color is less than a third brightness threshold, adjusting the brightness of the second representative color to the third brightness threshold to obtain the background main color; the third brightness threshold is less than the second brightness threshold; if the brightness of the second representative color is between the second brightness threshold and the third brightness threshold, using the second representative color as the background main color.

[0207] In one embodiment, the device further includes an other effect processing module configured to: present other visual effects other than the lighting effect in the playback interface; the other visual effects include at least one of smoke effect and particle effect.

[0208] In one embodiment, presenting other visual effects other than the lighting effect in the playback interface includes: determining visual effect parameters based on the first music; the visual effect parameters include at least one of smoke density, smoke movement speed, and particle quantity; and presenting the other visual effects in the playback interface according to the visual effect parameters.

[0209] In one embodiment, determining the visual effect parameters based on the first music includes: determining the current visual effect parameters based on the current sound amplitude of the first music.

[0210] The above modules can be program modules or hardware modules.

[0211] In addition, other specific details of the embodiments of the present disclosure have been described in detail in the embodiments of the above method and will not be repeated here.

[0212] Exemplary Program Products

[0213] The computer program product in the embodiment of the present disclosure is described below. The computer program product includes a computer program, and when the computer program is executed by a processor, the above method of the present disclosure is implemented.

[0214] In one embodiment, the computer program product may be a tangible product, such as a computer-readable storage medium storing a computer program. The readable storage medium may be based on electrical, magnetic, optical, electromagnetic, infrared, and other signals, including but not limited to: random access memory (RAM), read-only memory (ROM), magnetic tape, floppy disk, flash memory (Flash), mechanical hard disk (HDD), solid state drive (SSD), and the like. Exemplarily, the computer program product may be a non-volatile storage medium storing a computer program, such as a read-only memory, a NAND flash memory (Nand Flash), and the like.

[0215] In one embodiment, the computer program product may be an intangible product. For example, the computer program product may be a virtual digital product, such as an executable file or installation package containing a computer program.

[0216] The code of the computer program can be written in one or more programming languages. Programming languages ​​include, but are not limited to, C, Java, C++, etc. The program code can be executed entirely on the user computing device, or partially on the user computing device, or as a separate software package, or partially on the user computing device and partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, such as a local area network (LAN), a wide area network (WAN), etc., or can be connected to an external computing device (e.g., an Internet connection provided by an operator).

[0217] Computer programs can be carried or transmitted through electrical, magnetic, optical, electromagnetic, infrared and other signals. Electronic devices can convert signals carrying computer programs into digital signals to run the computer programs. When a computer program is running on an electronic device, its code is used to enable the electronic device to execute (more specifically, it can enable the processor of the electronic device to execute) the method steps of various embodiments of the present disclosure, for example: step S210, displaying the playback interface of the first music. In step S220, a lighting effect is presented in the playback interface; the lighting effect includes at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect that matches the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

[0218] The above steps are implemented by a computer program, and a lighting effect is presented in the playback interface of the first music, including at least one of the first lighting effect and the second lighting effect. The first lighting effect matches the first music, and the second lighting effect is closely integrated with the interface elements in the playback interface. In this way, a variety of playback interface lighting effects are achieved, and the problem of relatively monotonous visual effects of the playback interface is improved. In addition, the first lighting effect enhances the user's sense of immersion, and the second lighting effect enhances the overall visual effect and interactivity of the playback interface, thereby improving the user's audio-visual experience.

[0219] Exemplary Electronic Devices

[0220] The electronic device in the embodiment of the present disclosure is described below. The electronic device includes a processor and a memory, and the memory is used to store executable instructions of the processor. The processor is configured to execute the above method of the present disclosure by executing the executable instructions.

[0221] refer to Fig.10 An electronic device according to an embodiment of the present disclosure is exemplified. Fig.10 The electronic device 1000 shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0222] like Fig.10 As shown, the electronic device 1000 is presented in the form of a general computing device. The components of the electronic device 1000 may include, but are not limited to: a processor 1010, a memory 1020, a bus 1030 connecting different system components (including the memory 1020 and the processor 1010), an I / O (input / output) interface 1040, a network adapter 1050, a display 1060, and an audio unit 1070.

[0223] The memory 1020 stores program codes, which can be executed by the processor 1010, so that the processor 1010 executes the method steps of the embodiment of the present disclosure. For example, the processor 1010 can execute the following steps: Step S210, display the playback interface of the first music. In step S220, present a lighting effect in the playback interface; the lighting effect includes at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect that matches the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

[0224] By executing the above steps by the processor 1010, a lighting effect is presented in the playback interface of the first music, including at least one of the first lighting effect and the second lighting effect. The first lighting effect matches the first music, and the second lighting effect is closely integrated with the interface elements in the playback interface. In this way, a variety of lighting effects of the playback interface are achieved, and the problem of the relatively monotonous visual effect of the playback interface is improved. In addition, the first lighting effect enhances the user's sense of immersion, and the second lighting effect enhances the overall visual effect and interactivity of the playback interface, thereby improving the user's audio-visual experience.

[0225] The memory 1020 may include a volatile memory, such as a random access memory (RAM) 1021 and / or a cache unit 1022, and may also include a non-volatile memory, such as a read-only memory (ROM) 1023. The memory 1020 may also include one or more program modules 1024, such program modules 1024 include but are not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or a combination thereof may include the implementation of a network environment. For example, the program module 1024 may include each module in the above-mentioned device.

[0226] Processor 1010 may include processing units such as AP (Application Processor), modem processor, GPU (Graphics Processing Unit), ISP (Image Signal Processor), controller, encoder, decoder, DSP (Digital Signal Processor), baseband processor and / or NPU (Neural-Network Processing Unit).

[0227] The bus 1030 is used to connect different parts of the electronic device 1000 and may include a data bus, an address bus, a control bus, and the like.

[0228] The electronic device 1000 may also communicate with one or more external devices 1100 (eg, a keyboard, a pointing device, a Bluetooth device, etc.), and such communication may be performed through the I / O interface 1040 .

[0229] The electronic device 1000 can also communicate with one or more networks through the network adapter 1050. For example, the network adapter 1050 can provide mobile communication solutions such as 3G / 4G / 5G, or provide wireless communication solutions such as wireless LAN, Bluetooth, near field communication, etc. The network adapter 1050 can communicate with other modules of the electronic device 1000 through the bus 1030.

[0230] The display 1060 is used to display a graphical user interface, such as a playback interface.

[0231] The audio unit 1070 is used to play audio, such as playing the first music, etc. It can also be used to receive audio signals.

[0232] Although not shown in the figure, other hardware and / or software modules may be set in the electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID (Redundant Arrays of Independent Disks) systems, tape drives, and data backup storage systems.

[0233] It should be noted that, although several modules or submodules of the device are mentioned in the above detailed description, such division is merely exemplary and not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more units / modules described above can be embodied in one unit / module. Conversely, the features and functions of one unit / module described above can be further divided into multiple units / modules to be embodied.

[0234] In addition, although the operations of the disclosed method are described in a specific order in the drawings, this does not require or imply that the operations must be performed in this specific order, or that all the operations shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps.

[0235] Although the spirit and principle of the present disclosure have been described with reference to several specific embodiments, it should be understood that the present disclosure is not limited to the disclosed specific embodiments, and the division of various aspects does not mean that the features in these aspects cannot be combined to benefit, and such division is only for the convenience of expression. The present disclosure is intended to cover various modifications and equivalent arrangements included in the spirit and scope of the attached claims.

Claims

1. A playback interface processing method, characterized in that: The method comprises: Display the playback interface of the first music; A lighting effect is presented in the playback interface; the lighting effect includes at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect matching the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

2. The method according to claim 1, characterized in that The presenting of the lighting effect in the playback interface includes: Determine a first lighting parameter according to the first music; The first lighting effect is presented in the playback interface according to the first lighting parameter.

3. The method according to claim 2, characterized in that The first lighting parameter includes a first lighting transparency; and determining the first lighting parameter according to the first music includes: The current first light transparency is determined according to the current sound amplitude of the first music.

4. The method according to claim 3, characterized in that The determining the current transparency of the first light according to the current sound amplitude of the first music includes: If the current sound amplitude is greater than the average amplitude of the first music, the first preset transparency is adjusted downward to obtain the current first light transparency; If the current sound amplitude is smaller than the average amplitude of the first music, the first preset transparency is adjusted upward to obtain the current first light transparency.

5. The method according to claim 2, characterized in that: The first lighting parameter includes a first lighting primary color; and determining the first lighting parameter according to the first music includes at least one of the following steps: Determining the primary color of the first light according to the current sound frequency of the first music; The first main color of the light is determined according to the associated image of the first music.

6. The method according to claim 5, characterized in that The determining the first light primary color according to the current sound frequency of the first music includes: Determining a first target hue according to the numerical interval of the current sound frequency; The first light primary color is determined based on the first target hue.

7. The method according to claim 6, characterized in that The determining of the first target hue according to the numerical interval of the current sound frequency includes: If the current sound frequency is less than 50 Hz, determining that the first target hue is red; If the current sound frequency is in the range of 50 Hz to 100 Hz, determining that the first target hue is orange; If the current sound frequency is in the range of 100 Hz to 500 Hz, the first target hue is determined to be yellow; If the current sound frequency is in the range of 500 Hz to 2000 Hz, the first target hue is determined to be green; If the current sound frequency is in the range of 2000 Hz to 200000 Hz, the first target hue is determined to be blue; If the current sound frequency is greater than 20000 Hz, the first target hue is determined to be purple.

8. A playback interface processing device, characterized in that: The device comprises: A playing interface display module, configured to display a playing interface of the first music; The lighting effect processing module is configured to present lighting effects in the playback interface; the lighting effects include at least one of a first lighting effect and a second lighting effect; the first lighting effect is a lighting effect matching the first music; the second lighting effect is a lighting effect generated by using at least one interface element in the playback interface as a virtual light source.

9. A computer program product having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

10. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to perform the method of any one of claims 1 to 7 by executing the executable instructions.

Images