Display method and device with special effects, electronic device and computer-readable medium

Description

CROSS-REFERENCE TO RELATED APPLICATION

[0001] The present application claims a priority to Chinese Patent Application No. 202011126426.3, titled "METHOD, APPARATUS, ELECTRONIC DEVICE, AND COMPUTER-READABLE MEDIUM FOR DISPLAYING EFFECTS", filed on October 20, 2020.FIELD

[0002] The present disclosure relates to the technical field of effect display. Specifically, the present disclosure relates to a method, an apparatus, an electronic device, and a computer-readable medium for displaying effects.BACKGROUND

[0003] A lot of music player software on the market now has a function of displaying effects when playing music, allowing users to enjoy visual effects while listening to music, thereby enhancing user experience.

[0004] In the existing effect display, the variability of effects is not strong. The animation elements of the effects are all fixed templates. The effects are also displayed according to a specific rhythm, which makes the effects appear relatively dull when being displayed, and cannot give users more visual experience in the process of listening to music, resulting poor user experience.

[0005] It can be seen that in the existing effect display technology, the effect elements are relatively fixed, and the variability of the effect display is not strong, resulting in poor user experience, so there is a need for improvement. CN107967706A discloses a method and a device for processing multimedia data and a computer readable storage medium. The method includes the following steps: acquiring video data to be processed, wherein the video data includes audio data with rhythm change; extracting rhythm change information of audio data included in the video data, wherein the rhythm change information includes at least one group of mutually corresponding rhythm change time points and rhythm change intensity; and carrying out animation effect processing on the video picture of the video data according to the rhythm change information of the audio data included in the video data to obtain the processed video data. US20190335229A1 discloses a video data generation method, a computer device, and a storage medium. The method includes obtaining, by processing circuitry of an apparatus, tempo information from audio data that is inserted in a target video; determining, by the processing circuitry, a plurality of target tempo points in the tempo information according to video effect time description information included in a video effect description file, the video effect description file including video effect data that is used to adjust one or more video frames of an original video; obtaining, by the processing circuitry, the one or more video frames from the original video according to the plurality of target tempo points; adjusting, by the processing circuitry, the one or more video frames with the video effect data included in the video effect description file; and generating, by the processing circuitry, the target video including the adjusted one or more video frames and the audio data. US20080055469A1 discloses a technique for generating a scenario for a music-and-image-synchronized motion picture. The method includes the steps of: extracting characteristics of music; extracting structure of the music on the basis of the extracted characteristics of the music and dividing the music into multiple components on the basis of the result of the extraction; analyzing the characteristics of images; associating the music and the images with each other according to the characteristics corresponding to the components of the music and the characteristics of the images; and generating a motion picture scenario that enables the associated music and images to be synchronously reproduced.SUMMARY

[0006] The purpose of the present disclosure is to at least solve one of the above technical defects, especially the technical defects of the effect elements being relatively fixed, and the variability of the effect display being not strong in the existing effect display technology, which leads to poor user experience. In the first aspect, an effect video generation and display method is provided, applied to an electronic device and including: obtaining a video or image of a user; obtaining musical features of music played in an effect display interface, wherein the musical features include beats of the music and accented beats of the music; and fusing the video or image of the user with effects to form an effect video, displaying the effect video through the effect display interface, wherein the effects played on the effect display interface at a start point of at least one beat of the music are fused with the video or image of the user, and a content displayed on the effect display interface is zoomed out or zoomed in at a start point of each of at least one accented beat of the music and fused, and a content displayed on the effect display interface is not zoomed out or zoomed in at a start point of beats of the music other than the accented beats of the music and is fused, durations of the effects being durations of beats corresponding to the effects.

[0007] In the second aspect, an effect video generation and display apparatus is provided, including: a video or image obtaining module configured to obtain a video or image of a user; a musical feature obtaining module configured to obtain musical features of music played in an effect display interface, wherein the musical features include beats of the music and accented beats of the music; an effect video fusing module configured to fuse the video or image of the user with effects to form an effect video, and an effect video display module configured to display the effect video through the effect display interface, wherein the effects played on the effect display interface at a start point of at least one beat of the music are fused with the video or image of the user, and a content displayed on the effect display interface is zoomed out or zoomed in at a start point of each of at least one accented beat of the music and fused, and a content displayed on the effect display interface is not zoomed out or zoomed in at a start point of beats of the music other than the accented beats of the music and is fused, durations of the effects being durations of beats corresponding to the effects.

[0008] In the third aspect, an electronic device is provided, including: a processor; and a memory having at least one instruction, at least one segment program, a code set, or an instruction set stored thereon. The at least one instruction, the at least one segment program, the code set, or the instruction set is loaded and executed by the processor to implement the above effect display method.

[0009] In the fourth aspect, a computer-readable storage medium is provided, the computer-readable storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the above effect display method.

[0010] In the embodiments of the present disclosure, by obtaining musical features of music, and displaying, on the effect display interface, effects generated based on the musical features, the change of the effect display is related to the musical features, the effect display is more diverse, and the effects are combined with the musical features, which increases the user's immersive experience.BRIEF DESCRIPTION OF DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings that need to be used in the description of the embodiments of the present disclosure will be briefly introduced below. FIG. 1 is a schematic flowchart of an effect display method provided by an embodiment of the present disclosure; FIG. 2 is a schematic diagram of an effect display interface provided by an embodiment of the present disclosure; FIG. 3 is a schematic diagram of adding effects at start points of beats provided by an embodiment of the present disclosure; FIG. 4 is a schematic diagram of adding effects at start points of accented beats provided by an embodiment of the present disclosure; FIG. 5 is a schematic diagram of a zooming-in display provided by an embodiment of the disclosure; FIG. 6 is a schematic diagram of a zooming-out display provided by an embodiment of the present disclosure; FIG. 7 is a schematic diagram of composition of effects provided by an embodiment of the present disclosure; FIG. 8 is a schematic flowchart of a method for displaying a video or image of a user provided by an embodiment of the present disclosure; FIG. 9 is a schematic diagram of an effect display for displaying a video or image of a user provided by an embodiment of the present disclosure; FIG. 10 is a schematic diagram of an effect display apparatus provided by an embodiment of the present disclosure; and FIG. 11 is a structural schematic diagram of an electronic device provided by an embodiment of the disclosure.

[0012] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent in conjunction with the accompanying drawings and with reference to the following specific implementations. Throughout the drawings, the same or similar reference numerals indicate the same or similar elements. It should be understood that the drawings are schematic and the components and elements are not necessarily drawn to scale.DESCRIPTION OF EMBODIMENTS

[0013] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. Although some embodiments of the present disclosure are illustrated in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided for a more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are only configured for exemplary purposes, and are not configured to limit the protection scope of the present disclosure.

[0014] It should be understood that the various steps recorded in method implementations of the present disclosure may be executed in a different order, and / or executed in parallel. In addition, method implementations may include additional steps and / or omit to perform the illustrated steps. The scope of the present disclosure is not limited in this respect.

[0015] The term "including" and its variants as used herein are open-ended including, that is, "including but not limited to"; the term "based on" is "at least in part based on"; the term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments." Related definitions of other terms will be given in the following description.

[0016] It should be noted that the concepts of "first" and "second" mentioned in the present disclosure are only configured to distinguish apparatuses, modules or units, and are not configured to limit these apparatuses, modules or units to be different apparatuses, modules or units, and are not configured to limit the order or interdependence of the functions performed by these apparatuses, modules or units.

[0017] It should be noted that the definition with "a" or "a plurality of" mentioned in the present disclosure is illustrative and not restrictive. Those skilled in the art should understand that unless the context clearly indicates otherwise, it should be understood as "a or a plurality of".

[0018] The names of messages or information exchanged between a plurality of apparatuses in the implementations of the present disclosure are only configured for illustrative purposes, and are not configured to limit the scope of these messages or information.

[0019] The method, apparatus, electronic device, and computer-readable medium for displaying effects provided by the disclosure are intended to solve the above technical problems in the related art.

[0020] The technical solutions of the present disclosure and how the technical solutions of the present disclosure solve the above technical problems will be described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present disclosure will be described below in conjunction with the accompanying drawings.

[0021] An embodiment of the present disclosure provides an effect display method, which is applied to a user terminal. The user terminal may be a device capable of playing multimedia files, such as a mobile phone, a tablet computer, or a smart watch, etc. As illustrated in FIG. 1, the method includes: step S101, obtaining musical features of music played in an effect display interface; and step S102, displaying effects on the effect display interface based on the musical features.

[0022] The effect display method provided by the embodiment of the present disclosure can be an APP (Application), or a functional module in the APP, which is configured to display effects on the effect display interface according to the musical features of the played music. The change of the effect display is related to the musical features, the effect display is more diverse, and the effects is combined with the musical features to increase the user's immersive experience.

[0023] In the embodiment of the present disclosure, the musical features refer to rhythm features of the music, such as beats, accented beat points of the music, the amplitude of the beats, and the duration of the beats, etc., wherein the accented beat points are start points of the beats whose tones are higher than a preset threshold.

[0024] In the embodiment of the present disclosure, the effect display interface is a user interface configured to display effects, and may be the interface displayed when the user opens the APP or the effect display module function in the APP. The effect display interface can be opened to play pre-configured or user-selected music, and obtain musical features of the music; optionally, when obtaining the musical features of the music, the original audio data can be obtained by decoding by the player, and the original audio data can be decoded to obtain the musical features of the audio data; optionally, when processing the original audio data, a pre-configured effect analysis SDK (Software Development Kit) can be used to analyze the original audio data to obtain the musical features in the original audio data, such as music beats, accented beat points, the amplitude of beats, the duration of beats, etc..

[0025] In an embodiment of the present disclosure, the effects can be an animation element, e.g., one animation element or a combination of a plurality of animation elements being displayed on the effect display interface, or a change in the color of the effect display interface, e.g., a change of the colors of the effect display interface according to musical features, or zooming of the effect display interface, etc. Of course, the above plurality of categories can also be combined for display.

[0026] In the embodiments of the present disclosure, when displayed on the effect display interface according to musical features, the above effects can be randomly combined to ensure the diversity of the effects.

[0027] For the embodiments of the present disclosure, for convenience of description, a specific embodiment is taken as an example. As illustrated in FIG. 2, the user opens the effect display interface 201 through the APP, the effect display interface 201 has the effects 202 displayed therein, music can be played in the effect display interface 201, and the music may be pre-configured or user-selected; optionally, the operation of opening the effect display interface 201 can be receiving an operation of selecting to play music by the user, based on which operation, the effect display interface is opened, the user-selected music is played, the musical features of the music are extracted, and the effects are displayed on the effect display interface based on the musical features. Wherein, the musical features can be beats, accented beat points, amplitudes of the beats, and durations of the beats, etc. Based on the musical features, pre-configured animation elements, color changes, and the zooming of the interface are randomly combined to form the effects for display.

[0028] In the embodiment of the present disclosure, by obtaining the musical features of music, and generating effects based on the musical features for display on the effect display interface, the change of the effect display is related to the musical features, and by randomly combining the effects, the effect display is more diverse, and combining the effects with the musical features increases the user's immersive experience.

[0029] The embodiment of the present disclosure provides a possible implementation manner. In this implementation manner, the musical features include beats of the music, and said displaying the effects on the effect display interface based on the musical features includes: playing the effects at a start point of each of at least one beat of the music.

[0030] In the embodiment of the present disclosure, the musical features include the beats of the music, and displaying the effects on the effect display interface based on the musical features may include starting to play the effects at the start point of each of at least one beat.

[0031] For the embodiments of the present disclosure, for convenience of description, a specific embodiment is taken as an example. In an audio diagram of certain music as illustrated in FIG. 3, the features of the music include the start points A, B, and C of the beats; optionally, when being displayed based on the musical features, the effects can start to be played at the start point of the beats. Optionally, as illustrated in FIG. 3, effects 1 start to be played at the start point A of the beats, effects 2 start to be played at the start point B of the beats, and effects 3 start to be played at the start point C of the beats. Optionally, the effects 1, effects 2, and effects 3 may be pre-configured animation effects or randomly-generated animation effects, such as appearance of a preset light spot, or appearance of a random combination of a plurality of light spots. The durations of the effects 1, effects 2, and effects 3 may be preset time, or may be durations of the corresponding beats.

[0032] In the embodiments of the present disclosure, by playing effects at the start point of the music beats, the appearance of the effects corresponds to the start point of the beats, so that the rhythm is strong, the user experience is good. A variety of random combinations can be selected for the effects, and thus the effects are diverse.

[0033] The embodiment of the present disclosure provides a possible implementation manner. In this implementation manner, the musical features include start points of accented beats, and the method further includes: zooming out or zooming in on a content displayed on the effect display interface at the start point of each of at least one accented beat of the music.

[0034] In the embodiment of the present disclosure, the musical features include start points of accented beats of the music. Displaying the effects on the effect display interface according to the musical features may include zooming out or zooming in on the effect display interface at the start point of each of at least one accented beat of the music.

[0035] For the embodiments of the present disclosure, for convenience of description, a specific embodiment is taken as an example. In an audio diagram of certain music as illustrated in FIG. 4, the features of the music include start points D, E of accented beats; optionally, displaying the effects based on the musical features includes zooming out and zooming in on the effect display interface at the start points of the accented beats. As an embodiment of the present disclosure, as illustrated in FIG. 4, when the music is played to the start point D of the accented beat, zooming in is performed on the effect display interface for display. Optionally, as illustrated in FIG. 5, when zooming in is performed on a picture in the effect display interface for display, an excess area 502 outside a screen area 501 is not displayed, and an effect display area 503 within the screen area is displayed. As another embodiment of the present disclosure, when the music is played to a final start point E, zooming out is performed on the effect display interface for display; optionally, as illustrated in FIG. 6, zooming out is performed on an effect picture 602 in the effect display interface 601 for display. Optionally, display time of the zooming in or zooming out of the effect display interface may be preset, or may be related to the durations of the accented beats.

[0036] The embodiment of the present disclosure, by zooming in or zooming out on the effect display interface based on the start points of the accented beats of the music, gives the user a strong visual impact, thereby providing better user experience.

[0037] An embodiment of the present disclosure provides a possible implementation manner. In this implementation manner, the musical features include tones of the accented beats, and the method further includes: adjusting an amplitude of the zooming in or zooming out of the content displayed on the effect display interface based on the tone of each of the at least one accented beat.

[0038] In the embodiment of the present disclosure, the musical features may be tones of the accented beats, and said displaying the effects on the effect display interface based on the musical features may include adjusting an amplitude of the zooming in or zooming out on the effect display interface based on the tone of each of at least one accented beat.

[0039] For the embodiments of the present disclosure, for convenience of description, the above specific embodiment is taken as an example. The tone of an accented beat of music may be an average tone of the accented beat. Zooming out or zooming on the effect display interface at the start point of the accented beat may include adjusting an amplitude of the zooming in or zooming out of the effect display interface based on the level of the average tone; optionally, the amplitude of the zooming in or zooming out on the effect display interface increases as the average tone rises; and the amplitude of the zooming in or zooming out on the effect display interface decreases as the average tone drops.

[0040] In the embodiment of the present disclosure, by adjusting the amplitude of the zooming in or zooming out on the effect display interface based on the tone of the accented beat, the display of the effects is associated to the musical features, and the user's visual and auditory feelings are combined, thereby providing better experience.

[0041] The embodiment of the present disclosure provides a possible implementation manner. In this implementation manner, the effects include at least one animation element layer and one color change layer, and the at least one animation element layer and the color change layer are fused by color filtering or superimposition.

[0042] In an embodiment of the present disclosure, the effects may include at least one animation element layer and one color change layer, each animation element layer may include one or more animation elements, and colors in the color change layer can be changed according to preset rules.

[0043] For the embodiments of the present disclosure, for convenience of description, a specific embodiment is taken as an example. As illustrated in FIG. 7, when the effects are constructed, the effects include one animation element layer 701 and one color change layer 702. Optionally, the animation element layer can include one or more animation light spots 703. The colors in the color change layer can change over time; optionally, the colors in the color change layer can change over time according to a preset color spectrum (e.g., changing repeatedly). As an embodiment of the present disclosure, displaying the effects may include fusing the one animation layer and the one color change layer by color filtering or superimposition, for display. Optionally, a plurality of animation element layers may be included. Optionally, the animation light spots in the animation element layer can be randomly combined, and the color spectrum in the color change layer can also be randomly generated.

[0044] The effects of the embodiment of the present disclosure includes an animation element layer and a color change layer, and through the random combination of a plurality of effect elements, the effect styles are diversified.

[0045] The embodiment of the present disclosure provides a possible implementation manner. In this implementation manner, the musical features include beats of the music, and said displaying the effects on the effect display interface based on the musical features includes: playing the effects at start points of the beats of the music, where for two adjacent beats, the at least one animation element layer of the effects corresponding to one beat is different from the at least one animation element layer of the effects corresponding to the other beat.

[0046] In the embodiment of the present disclosure, playing the effects includes playing the effects at the start point of each of the beats, optionally, for every two consecutive beats, the effects played at the start point of one beat are different from the effects played at the start point of the other beat, and optionally, the animation element layer corresponding to the effects played at the start point of one beat is different from the animation element layer corresponding to the effects played at the start point of the other beat.

[0047] For the embodiments of the present disclosure, for convenience of description, a specific embodiment is taken as an example. When the music is being played, the animation element layer in the effects for the start point of the first beat of the music can be animation light spot 1; the animation element layer in the effects at the start point of the second beat can be light spot animation 2; the animation element in the effect elements at the start point of the third beat can be a combination of light spot animation 3 and light spot animation 4, optionally, a combination of a random quantity of random light spot animations.

[0048] In the embodiment of the present disclosure, by adjusting the difference of the animation element layer in the effects, it is ensured that the effects displayed in the effect display interface change with the change of the music, and the randomness of the light spot animations in the animation element layer ensures the randomness of the effects.

[0049] As illustrated in FIG. 8, the method further includes: step S801, obtaining a video or an image of a user; step S802, fusing the video or image of the user with the effects to form an effect video; and step S803, displaying the effect video through the effect display interface.

[0050] In the embodiment of the present disclosure, when playing music, the user can choose to display the selected video or image on the effect display interface, and combine the selected video or image with the effects for display.

[0051] For the embodiments of the present disclosure, for convenience of description, a specific embodiment is taken as an example. As illustrated in FIG. 9, the display content of the effect display interface includes a video image layer 901, a color change layer 902, and an animation element layer 903, where the video image layer includes the video or image selected by the user. Displaying effects includes fusing the video image layer, the color change layer, and the animation element layer in a superimposition or color-filtering manner, and playing the fused video or image. Optionally, displaying the effects may include extracting musical features when the music is being played, generating the effects based on the musical features, and superimposing the effects on the user video or image for real-time display.

[0052] In the embodiment of the present disclosure, by obtaining the user video or image, and combining the user video or image with the effects for display, the user can add effects to the video or image selected by herself or himself, and the effects are associated to the rhythm of the music, thereby increasing user experience.

[0053] In the embodiment of the present disclosure, by obtaining the musical features of the music, and generating the effects based on the musical features on the effects display interface for display, the change of the display of the effects is related to the musical features, the display of the effects is more diverse, and the effects are combined with the musical features, thereby increasing the user's immersive experience.

[0054] The embodiment of the present disclosure provides an effect display apparatus. As illustrated in FIG. 10, the effect display apparatus 100 includes a musical feature obtaining module 110 and an effect displaying module 120.

[0055] The musical feature obtaining module 110 is configured to obtain musical features of music played in an effect display interface.

[0056] The effect displaying module 120 is configured to display effects on the effect display interface based on the musical features.

[0057] In the present invention, the musical features include beats of the music, and when displaying the effects on the effect display interface based on the musical features, the effect displaying module 120 can be configured to play the effects at a start point of each of at least one beat of the music.

[0058] The musical features include start points of accented beats, and the effect display apparatus can also be configured to zoom out or zoom in on a content displayed on the effect display interface at a start point of each of at least one accented beat.

[0059] Optionally, the musical features include tones of the accented beats, and the effect displaying module 120 can be further configured to adjust an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

[0060] Optionally, the effects include at least one animation element layer and one color change layer, and the at least one animation element layer and the color change layer are fused by superimposition or color filtering.

[0061] Optionally, the musical features include beats of the music, and when displaying the effects on the effect display interface based on the musical features, the effect displaying module 120 can be configured to play the effects at the start points of the beats of the music, where for two adjacent beats, the at least one animation element layer of the effects corresponding to one beat is different from the at least one animation element layer of the effects corresponding to the other beat.

[0062] The effect display module 120 is also configured to obtain a video or an image of a user, fuse the video or image of the user with the effects to form an effect video, and display the effect video through the effect display interface.

[0063] The effect display apparatus of the embodiment of the present disclosure can execute the method illustrated in the foregoing embodiment of the present disclosure, and its implementation principle is similar, and will not be repeated here.

[0064] Reference is now made to FIG. 11, which is a structural schematic diagram of an electronic device 1100 adapted to implement the embodiments of the present disclosure. The terminal device according to the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a laptop computer, a digital broadcast receiver, a Personal Digital Assistant (PDA), a tablet computer or PAD, a Portable Multimedia Player (PMP), or a vehicle-mounted terminal (e.g., a vehicle-mounted navigation terminal), or a fixed terminal such as a digital TV, a desktop computer, etc. The electronic device illustrated in FIG. 11 is exemplary only, and should not be construed as limiting the function and scope of use of the embodiments of the present disclosure.

[0065] The electronic device includes a memory and a processor, where the processor here may be referred to as the processing unit 1101 below, and the memory may include at least one of a read-only memory (ROM) 1102, a random access memory (RAM) 1103, and a storage unit 1108 below, as illustrated in detail below:

[0066] As illustrated in FIG. 11, the electronic device 1100 may include a processing unit (such as a central processing unit, a graphics processing unit, etc.) 1101, which may perform various appropriate actions and processes in accordance with programs stored in a Read Only Memory (ROM) 1102 or loaded from a storage unit 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the electronic device 1100 may also be stored. The processing unit 1101, the ROM 1102, and the RAM 1103 are connected to each other through a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0067] Generally, the following units may be connected to the I / O interface 1105: an input unit 1106 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output unit 1107 including, for example, a Liquid Crystal Display (LCD), a speaker, an oscillator, etc.; a storage unit 1108 including, for example, a magnetic tape or a hard disk, etc.; and a communication unit 1109. The communication unit 1109 may allow the electronic device 1100 to perform wireless or wired communication with other devices for data exchange. Although FIG. 11 illustrates the electronic device 1100 having various apparatuses, it can be appreciated that it is not necessary to implement or provide all the illustrated apparatuses. Alternatively, more or fewer apparatuses may be implemented or provided.

[0068] In particular, according to the embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer readable medium. The computer program includes program codes for implementing the method illustrated in any of the flowcharts. In these embodiments, the computer program may be downloaded and installed from a network through the communication unit 1109, or installed from the storage unit 1108, or installed from the ROM 1102. When the computer program is executed by the processing unit 1101, the above functions defined in the methods according to the embodiments of the present disclosure are performed.

[0069] It is to be noted that the above computer-readable medium in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination thereof. The computer-readable storage medium may be, but not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer-readable storage medium may include, but not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM) or a flash memory, an optical fiber, a Compact Disc Read-Only Memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination thereof. In the present disclosure, the computer-readable storage medium may be any tangible medium including or storing programs, which may be used by or used with an instruction execution system, apparatus, or device. However, in the present disclosure, the computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier that carries computer-readable program codes. Such propagated data signal may be in various forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination thereof. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium, which may transmit, propagate, or transfer programs used by or used with an instruction execution system, apparatus or device. The program codes contained on the computer-readable medium may be transmitted via any appropriate medium, including but not limited to electric cable, optical cable, Radio Frequency (RF), etc., or any suitable combination thereof.

[0070] In some embodiments, the client and server can communicate with any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (for example, communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (for example, the Internet), and end-to-end networks (for example, ad hoc end-to-end networks), as well as any networks currently known or developed in the future.

[0071] The above computer-readable medium may be included in the above electronic device; or may be standalone without being assembled into the electronic device.

[0072] The above computer-readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: obtain musical features of music played in an effect display interface, and display effects on the effect display interface based on the musical features.

[0073] The computer program code used to perform the operations of this disclosure can be written in one or more programming languages or a combination thereof. The above programming languages include but are not limited to object-oriented programming languages such as Java, Smalltalk, C++, and include conventional procedural programming languages such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).

[0074] The flowcharts and block diagrams in the drawings illustrate the possible implementations of the system architecture, functions, and operations of the system, method, and computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, a program segment, or a part of code, and the module, the program segment, or the part of code contains one or more executable instructions for implementing the specified logic function. It should also be noted that, in some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two blocks illustrated in succession can actually be executed substantially in parallel, and they can sometimes be executed in a reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and the combination of the blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or operations or can be implemented by a combination of dedicated hardware and computer instructions.

[0075] The modules or units involved in the embodiments described in the present disclosure can be implemented in software or hardware.

[0076] The functions described herein above may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that can be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Product (ASSP), System on Chip (SOC), Complex Programmable Logic Device (CPLD), etc.

[0077] In the context of the present disclosure, a machine-readable medium may be a tangible medium including or storing programs, which may be used by or used with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may be, but not limited to an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More specific examples of the machine-readable storage media may include an electrical connection having one or more wires, a portable computer disk, a hard disk, a Random Access Memory (RAM), a Read Only Memory (ROM), an Erasable Programmable Read Only Memory (EPROM or a flash memory), an optical fiber, a Compact Disc Read-Only Memory (CD-ROM), an optical memory device, a magnetic memory device, or any suitable combination thereof.

[0078] According to one or more embodiments provided in the present disclosure, an effect display method is provided, the method including: obtaining musical features of music played in an effect display interface; and displaying effects on the effect display interface based on the musical features.

[0079] In the present invention, the musical features include beats of the music, and said displaying the effects on the effect display interface based on the musical features includes playing the effects at a start point of each of at least one beat of the music.

[0080] The musical features include start points of accented beats, and the method further includes zooming out or zooming in on a content displayed on the effect display interface at a start point of each of at least one accented beat of the music.

[0081] Optionally, the musical features include tones of the accented beats, and the method further includes adjusting an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

[0082] Optionally, the effects include at least one animation element layer and one color change layer, and the at least one animation element layer and the color change layer are fused by superimposition or color filtering.

[0083] Optionally, the musical features include beats of the music, and said displaying the effects on the effect display interface based on the musical features includes playing the effects at start points of the beats of the music, where for two adjacent beats, the animation element layer of the effects corresponding to one beat of the two adjacent beats is different from the animation element layer of the effects corresponding to the other beat of the two adjacent beats.

[0084] Optionally, the method further includes obtaining a video or an image of a user, fusing the video or image of the user with the effects to form an effect video; and displaying the effect video through the effect display interface.

[0085] According to one or more embodiments provided in the present disclosure, an effect display apparatus is provided, the effect display apparatus including: a musical feature obtaining module configured to obtain musical features of music played in an effect display interface; and an effect displaying module configured to display effects on the effect display interface based on the musical features.

[0086] In the present invention, the musical features include beats of the music, and when displaying the effects on the effect display interface based on the musical features, the effect displaying module can be configured to play the effects at a start point of each of at least one beat of the music.

[0087] The musical features include start points of accented beats, and the effect displaying module is further configured to zoom out or zoom in on a content displayed on the effect display interface at a start point of each of at least one accented beat of the music.

[0088] Optionally, the musical features include tones of the accented beats, and the effect displaying module can be further configured to adjust an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

[0089] Optionally, the effects include at least one animation element layer and one color change layer, and the at least one animation element layer and the color change layer are fused by superimposition or color filtering.

[0090] Optionally, the musical features include beats of the music, and when displaying the effects on the effect display interface based on the musical features, the effect displaying module can be configured to play the effects at start points of the beats of the music, where for two adjacent beats, the at least one animation element layer of the effects corresponding to one beat of the two adjacent beats is different from the at least one animation element layer of the effects corresponding to the other beat of the two adjacent beats

[0091] The effect display apparatus is further configured to obtain a video or an image of a user, fuse the video or image of the user with the effects to form an effect video; and display the effect video through the effect display interface.

[0092] According to one or more embodiments provided in the present disclosure, an electronic device is provided, the electronic device including: a processor; and a memory having at least one instruction, at least one segment program, a code set, or an instruction set stored thereon, where the at least one instruction, the at least one segment program, the code set, or the instruction set is loaded and executed by the processor to implement the above effect display method.

[0093] According to one or more embodiments provided in the present disclosure, a computer-readable medium is provided, the computer-readable medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the above effect display method.

[0094] The above description is only preferred embodiments of the present disclosure and an explanation of the applied technical principles. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical without departing from the above disclosed concept, e.g., technical solutions formed by mutually replacement of the above features and the technical features disclosed in the present disclosure (but not limited to) with similar functions.

[0095] In addition, although the operations are depicted in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented in a plurality of embodiments individually or in any suitable sub-combination.

[0096] Although the subject matter has been described in language specific to structural features and / or logical actions of the method, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely exemplary forms of implementing the claims.

Claims

1. An effect video generation and display method, applied to an electronic device, comprising: obtaining (S801) a video or image of a user; obtaining (S101) musical features of music played in an effect display interface, wherein the musical features comprise beats of the music and accented beats of the music; fusing (S802) the video or image of the user with effects to form an effect video, and displaying the effect video through the effect display interface, wherein the effects played on the effect display interface at a start point of at least one beat of the music are fused with the video or image of the user, and a content displayed on the effect display interface is zoomed out or zoomed in at a start point of each of at least one accented beat of the music and fused, and a content displayed on the effect display interface is not zoomed out or zoomed in at a start point of beats of the music other than the accented beats of the music and is fused, durations of the effects being durations of beats corresponding to the effects.

2. The effect video generation and display method according to claim 1, wherein the musical features comprise tones of the accented beats, and the method further comprises: adjusting an amplitude of the zooming in or zooming out on the content displayed on the effect display interface based on a tone of each of the at least one accented beat.

3. The effect video generation and display method according to claim 1, wherein the effects comprise at least one animation element layer and one color change layer, and the at least one animation element layer and the color change layer are fused by superimposition or color filtering.

4. The effect video generation and display method according to claim 3, wherein the musical features comprise beats of the music, and said displaying the effects on the effect display interface based on the musical features comprises: playing the effects at start points of the beats of the music, wherein for two adjacent beats of the beats, the at least one animation element layer of the effects corresponding to one beat of the two adjacent beats is different from the at least one animation element layer of the effects corresponding to the other beat of the two adjacent beats.

5. An effect video generation and display apparatus (100), comprising: a video or image obtaining module configured to obtain a video or image of a user; a musical feature obtaining module (110) configured to obtain musical features of music played in an effect display interface, wherein the musical features comprise beats of the music and accented beats of the music; an effect video fusing module configured to fuse the video or image of the user with effects to form an effect video, and an effect video display module configured to display the effect video through the effect display interface, wherein the effects played on the effect display interface at a start point of at least one beat of the music are fused with the video or image of the user, and a content displayed on the effect display interface is zoomed out or zoomed in at a start point of each of at least one accented beat of the music and fused, and a content displayed on the effect display interface is not zoomed out or zoomed in at a start point of beats of the music other than the accented beats of the music and is fused, durations of the effects being durations of beats corresponding to the effects.

6. An electronic device (1100), comprising: a processor (1101); and a memory (1108) having at least one instruction, at least one program, a code set, or an instruction set stored thereon, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor (1101) to implement the effect display method according to any one of claims 1 to 4.

7. A computer-readable medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the effect display method according to any one of claims 1 to 4.