Song playing method, device, storage medium, and program product

Abstract

The application relates to a song playing method and device, a storage medium and a program product, and relates to the technical field of audio and video playing. The method comprises the following steps: in a playing interface of a song, a virtual plant matched with a semantic theme of the song is displayed; in a playing process of the song, with the change of a music feature of the song, a motion effect and / or a display effect of the virtual plant are dynamically adjusted; and in response to an interactive operation on the virtual plant, a feedback motion effect corresponding to the interactive operation generated based on the virtual plant is displayed. According to the method, different virtual plants can be displayed according to the semantic theme of the played song, so that the emotion and artistic conception of the song can be intuitively conveyed; and in the playing process of the song, the motion effect or the display effect of the virtual plant can be changed according to the music feature of the song, so that the linkage logic between the song content and the visual element (such as the virtual plant) can be enhanced.

Description

Technical Field

[0001] This application relates to the field of audio and video playback technology, and in particular to a song playback method, device, storage medium, and program product. Background Technology

[0002] When a media player plays audio, it displays relevant information about the audio on the playback interface, involving various interaction methods and visualization techniques. However, in these technologies, the player only supports switching between fixed skins and static background images, and the interface element parameters are fixed and cannot dynamically change with the playback content. There is no linkage logic between music content and visual elements.

[0003] The above solution has obvious limitations: it lacks end-to-end mapping technology between song semantics and visual elements, cannot generate concrete and content-matched virtual visual subjects, and there is a gap in content and visual matching technology. Summary of the Invention

[0004] This application provides a song playback method, device, storage medium, and program product. The technical solution is as follows: According to one aspect of the embodiments of this application, a song playback method is provided, the method comprising: The song's playback interface displays virtual plants that match the song's semantic theme; During the playback of the song, the motion effects and / or display effects of the virtual plants are dynamically adjusted according to the changes in the musical characteristics of the song; In response to interactive actions performed on the virtual plant, a feedback animation corresponding to the interactive action generated by the virtual plant is displayed.

[0005] According to one aspect of the embodiments of this application, a song playback device is provided, the device comprising: The interface display module is used to display virtual plants that match the semantic theme of the song in the song playback interface; An effects adjustment module is used to dynamically adjust the motion effects and / or display effects of the virtual plants as the musical characteristics of the song change during its playback. An animation display module is used to respond to interactive operations on the virtual plant and display feedback animations corresponding to the interactive operations generated by the virtual plant.

[0006] According to one aspect of the embodiments of this application, a computer device is provided, the computer device including a processor and a memory, the memory storing a computer program, the computer program being invoked and executed by the processor to enable the computer device to implement the above-described song playback method.

[0007] According to one aspect of the embodiments of this application, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, the computer program being invoked and executed by a processor to implement the above-described song playback method.

[0008] According to one aspect of the embodiments of this application, a computer program product is provided, the computer program product including computer instructions, which are executed by a processor to implement the above-described song playback method.

[0009] The technical solutions provided in this application embodiment may have the following beneficial effects: Based on the semantic theme of the song being played, different virtual plants can be displayed, thus intuitively conveying the emotions and artistic conception of the song; and during the playback of the song, the movement or display effects of the virtual plants will change accordingly with the musical characteristics of the song, which can enhance the linkage logic between the song content and visual elements (such as virtual plants). Attached Figure Description

[0010] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0011] Figure 1 This is a schematic diagram of the implementation environment of a solution provided in one embodiment of this application; Figure 2 This is a flowchart of a song playback method provided in one embodiment of this application; Figure 3 This is a schematic diagram of a song playback interface provided in one embodiment of this application; Figure 4 This is a schematic diagram of a song playback interface provided in another embodiment of this application; Figure 5 This is a schematic diagram of a virtual plant style selection interface provided in one embodiment of this application; Figure 6 This is a block diagram of a song playback device provided in one embodiment of this application; Figure 7 This is a schematic diagram of the structure of a computer device provided in one embodiment of this application. Detailed Implementation

[0012] To make the objectives, technical solutions, and advantages of this application clearer, the embodiments of this application will be described in further detail below with reference to the accompanying drawings.

[0013] It should be noted that the terms "first," "second," etc., used in this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0014] To further illustrate the technical solutions provided in the embodiments of this application, a detailed description is provided below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiments of this application provide method operation steps as shown in the following embodiments or drawings, more or fewer operation steps may be included in the method based on conventional or non-inventive effort. For steps that do not logically have a necessary causal relationship, the execution order of these steps is not limited to the execution order provided in the embodiments of this application. In actual processing or when the control device executes the method, it may be executed sequentially or in parallel according to the method shown in the embodiments or drawings.

[0015] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0016] Figure 1 A schematic diagram of an implementation environment provided by an embodiment of this application is shown. This implementation environment can be implemented as an application system. Figure 1 As shown, the implementation environment of this solution may include: terminal device 10 and server 20.

[0017] In some embodiments, the terminal device 10 may be an electronic device such as a mobile phone, tablet computer, personal computer (PC), wearable device, virtual reality (VR) device, augmented reality (AR) device, or in-vehicle device; this application does not limit this. The terminal device 10 may run a client of a target application (such as a music player application). Optionally, the target application may be an application that needs to be downloaded and installed, or it may be in the form of a web page or an app; this application does not limit this.

[0018] In some embodiments, the target application is a multimedia playback application, which has the function of playing multimedia data. For example, the target application has the function of playing audio. Or, the target application has the function of playing video. Or, the target application has the function of playing both audio and video. Or, the target application has the function of displaying text. The target application may also be at least one of the following: a music playback application, a video playback application, a radio playback application, an audio reading application, a screen reader application, etc., and may also be other types of applications, which are not limited in this application embodiment.

[0019] Server 20 is used to provide background services for clients of the target application running on terminal device 10. For example, server 20 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDN), and big data and artificial intelligence platforms, but is not limited to these.

[0020] Terminal device 10 and server 20 can communicate with each other via a network. This network can be a wired network or a wireless network.

[0021] Optionally, the aforementioned wireless or wired networks use standard communication technologies and / or protocols. The network is typically the Internet, but can also be any network, including but not limited to Local Area Networks (LANs), Metropolitan Area Networks (MANs), Wide Area Networks (WANs), mobile, wired or wireless networks, private networks, or any combination of virtual private networks. In some embodiments, technologies and / or formats including Hyper Text Markup Language (HTML), Extensible Markup Language (XML), etc., are used to represent data exchanged over the network. Furthermore, conventional encryption technologies such as Secure Socket Layer (SSL), Transport Layer Security (TLS), Virtual Private Networks (VPNs), and Internet Protocol Security (IPsec) can be used to encrypt all or some links. In other embodiments, customized and / or dedicated data communication technologies can be used to replace or supplement the aforementioned data communication technologies.

[0022] In related technologies, mainstream music player interface interaction and visualization technologies can be mainly divided into four categories: (1) Static theme replacement technology: The player only supports switching between fixed skins and static background images. The interface element parameters are fixed and cannot change dynamically with the playback content. There is no linkage logic between music content and visual elements.

[0023] (2) Basic particle dynamic effects technology: Some players have built-in fixed particles, flowing light and dynamic background animations, but the animation logic is to play in a loop frame, which is not related to the semantics, rhythm and theme of the song, and does not have the content-driven adaptive capability.

[0024] (3) Simple click interaction technology: A few players support simple special effects feedback triggered by clicking the screen, but the feedback logic is simple and fixed, without layered touch judgment and differentiated particle feedback. It belongs to pre-rendered animation and does not have real-time physical simulation capabilities.

[0025] (4) Music pet raising technology: Music pets of related players can accumulate growth value based on listening time to upgrade their pets. However, it has obvious technical shortcomings: the pet's form is completely fixed and cannot change with the song content; there is no artificial intelligence (AI) semantic generation to create a concrete theme image; the interaction method is simple and there is no particle physical feedback; there is no scene customization generation system.

[0026] In summary, none of the related technologies can simultaneously achieve a complete technical loop of AI semantic matching to generate plant morphology, dynamic song adaptation, real-time layered touch interaction, quantitative growth iteration, and multi-mode scene generation.

[0027] From a technical perspective, the aforementioned technologies suffer from the following five core technical flaws: (1) Lack of end-to-end mapping technology between song semantics and visual elements. Related technologies can only achieve fuzzy style matching, and cannot accurately identify song themes, images, and emotions through semantic analysis. They cannot generate concrete, content-matched virtual visual subjects, resulting in a gap in content-visual matching technology.

[0028] (2) Lack of a dynamic parameter adaptive mechanism driven by music features. In related technologies, dynamic effects are fixed loop animations, and no dynamic mapping model has been established between song rhythm, emotion, style and visual particle parameters, so the visual effects cannot be iterated in real time with the content being played.

[0029] (3) Lack of sophisticated touch physical interaction technology. Among the related technologies, the click feedback is a pre-rendered static frame animation, without particle collision layer detection or touch position / force differentiation response mechanism, resulting in poor real-time interaction and physical realism.

[0030] (4) Lack of visual progressive growth rendering technology. Among related technologies, the music development system only accumulates numerical values ​​and lacks rendering logic for smooth transition of particle forms and multi-stage form iteration. The growth process lacks visual coherence and has weak technical incentive.

[0031] (5) Scene generation technology is singular and fixed. Among related technologies, the player only supports fixed template switching and lacks multi-mode scene construction technology that integrates user-defined parameter editing and AI intelligent generation, resulting in insufficient personalized adaptation capabilities.

[0032] Please refer to Figure 2 The diagram illustrates a flowchart of a song playback method according to an embodiment of this application. The execution entity for each step of the method is a terminal device; for example, the terminal device could be... Figure 1 The terminal device 10 in the illustrated implementation environment can also be a client of the target application. The method may include at least one of the following steps (210-230): Step 210: Display virtual plants that match the semantic theme of the song on the song's playback interface.

[0033] In some embodiments, a song can refer to a musical work with lyrics. A song combines multiple elements such as melody, harmony, rhythm, and vocals (lyrics) to express a specific emotion or theme through the lyrics.

[0034] Optionally, each song has a corresponding playback interface, which includes text information related to the song, such as the song title, author (e.g., singer), and text (e.g., lyrics). Optionally, the playback interface may also include image information related to the song, such as the song cover, the author's photo, or a virtual record. Optionally, the playback interface may also include various interface controls, such as a playback progress bar, play / pause controls, previous / next track controls, playback mode controls, favorites controls, download controls, and share controls; this application does not limit the scope of these controls.

[0035] For example, Figure 3 A schematic diagram of a song playback interface provided in one embodiment of this application is shown. Figure 3 As shown, the song playback interface includes the song title, artist, share control 301, first display area 302, text (such as one-line lyrics, two-line lyrics), sound effect control 303 (such as Viper sound effect), listen together control 304, comment control 305, favorite control 306, more information control 307, playback progress bar 308, playback mode control 309, previous track control 310, play or pause control 311 (such as play control), next track control 312, playlist control 313, etc. The first display area 302 can be used to display virtual plants that match the semantic theme of the song. It should be understood that the first display area can be understood as the display area for virtual plants. The listen together control 304 is used for listening to the same song with other users. The sound effect control is used to control the playback sound effects of the song. The comment control 305 allows users to express their thoughts and comments on the song. The favorite control 306 allows users to favorite songs. The playback progress bar 308 is used to display the playback progress of the song and can also display the total duration of the song. The playback mode control 309 is used to control the playback mode of a song, including single loop, sequential playback, and shuffle playback. The playlist control 313 is used to control opening or closing the playlist, which includes the currently playing song and other songs to be played.

[0036] In some embodiments, the display of the playback interface can be triggered in one or more of the following ways: physical control triggering, touch operation, voice control, event triggering, time triggering, and other methods are also possible, which are not limited in this application. Physical control triggering refers to triggering the target application to display the song playback interface through physical controls. In some embodiments, the physical controls come from one or more of the following: mouse, keyboard, gamepad, touchpad, remote control, headphones, and other physical controls are also possible, which are not limited in this application. For example, a user can display the playback interface of a specified song by clicking on the song name.

[0037] In some embodiments, displaying virtual plants that match the semantic theme of a song in the song playback interface includes: displaying virtual plants that match the semantic theme of a song in the song playback interface when a first condition is met; wherein the first condition includes one or more of the following: detecting a selection operation on a preset mode, detecting a click operation on a preset button, detecting a preset scene, detecting a preset voice, or detecting a preset gesture.

[0038] For example, upon detecting a selection of a preset mode, virtual plants matching the semantic theme of the song are displayed on the song's playback interface. Specifically, the preset mode is a mode for displaying virtual plants, such as the Starlight Flower Path mode. For instance, if the user selects the Starlight Flower Path mode, virtual plants matching the semantic theme of the song are displayed on the song's playback interface.

[0039] For example, upon detecting a click on a preset button, a virtual plant matching the semantic theme of the song is displayed on the song's playback interface. Specifically, a preset button exists on the song's playback interface; by clicking the preset button, the user can display a virtual plant matching the semantic theme of the song on the playback interface.

[0040] For example, when a preset scene is detected, virtual plants matching the semantic theme of the song are displayed on the song playback interface. Specifically, by combining a light sensor and Global Positioning System (GPS) / Bluetooth, when determining whether the user is in a car (in-vehicle mode), a quiet environment, or other similar scenarios, the system automatically recommends or directs the user to a song playback interface displaying virtual plants. Optionally, the preset scene can also be other scenes, and this application does not limit this.

[0041] For example, upon detecting a preset voice, a virtual plant matching the semantic theme of the song is displayed on the song's playback interface. Specifically, this is triggered when the user utters a preset keyword or phrase, such as "Please open the music garden" or "I want to see flowers." Optionally, the preset voice can also take other forms, which are not limited in this application.

[0042] For example, upon detecting a preset gesture, a virtual plant matching the semantic theme of the song is displayed on the song's playback interface. Optionally, the preset gesture refers to a user-defined hand movement with a specific spatiotemporal pattern. Examples include one or more of the following actions: tapping a beat, snapping fingers, a specific gesture sequence (e.g., raising the index finger and drawing a circle), or bringing hands together and then separating them. Optionally, the preset gesture may also include other forms, which are not limited in this application.

[0043] In the embodiments of this application, by meeting certain conditions (first condition), virtual plants that match the semantic theme of the song can be displayed in the song playback interface. Users can choose whether to enter the playback interface displaying virtual plants according to their own wishes, respecting the user's wishes and avoiding the potential decline in user experience due to forced entry.

[0044] In some embodiments, displaying virtual plants that match the semantic theme of a song in the song's playback interface includes: displaying virtual plants that match the semantic theme of a song in particle form in the song's playback interface; wherein the virtual plants are composed of multiple particles. Optionally, each particle can independently control its position, color, and movement trajectory.

[0045] In the embodiments of this application, the virtual plant is a particle-based virtual object that matches the semantic theme of the song. The virtual plant is composed of multiple particles, and its form is related to the semantics and / or theme of the song. For example, if the song has a sunny and inspirational theme, the generated virtual plant could be a sunflower; if the song has a family theme, the generated virtual plant could be a carnation. The virtual plant can include, but is not limited to, virtualized images of plants in nature such as flowers, grass, and trees. Optionally, the virtual plant can include, but is not limited to, the following plant images: plum blossom, apricot blossom, peach blossom, peony, pomegranate blossom, lotus, hollyhock, hosta, orchid, chrysanthemum, hibiscus, camellia, daffodil, hydrangea, rose, etc.

[0046] In some embodiments, virtual plants may include exclusive virtual plant styles co-branded with a specific artist (celebrity), such as daisies. Optionally, co-branded plant styles can be unlocked through payment or by fans checking in, providing artists' fans with exclusive, emotionally resonant virtual items. This application does not limit this.

[0047] In some embodiments, the system may provide paid value-added services for virtual plants, including but not limited to: paying to water and fertilize virtual plants, purchasing decorative accessories (such as butterflies or ornaments) for virtual plants, or triggering hidden Easter egg interactive effects. Paid interactive behaviors can produce beneficial effects, such as accelerating the accumulation of virtual plant growth value or unlocking special dynamic effects.

[0048] Optionally, virtual plants comprise multiple components. In other words, virtual plants are divided into multiple components at the particle level. Optionally, the components of a virtual plant include, but are not limited to, multiple parts such as flowers (petals, stamens), leaves, roots, and stems. It is important to understand that particle form means that each component of a virtual plant (such as petals, leaves, and stems) is composed of a large number of tiny, independently controllable point elements (particles). Virtual plants displayed in particle form can present a soft, dynamic, and deformable visual effect.

[0049] In some embodiments, the display effect of the virtual plant is related to the song's cover art. Optionally, the display effect of the virtual plant includes, but is not limited to, one or more of the following: the color saturation of the virtual plant, the light and shadow intensity of the virtual plant, the hue of the virtual plant, and the color value of the virtual plant. For example, the overall hue and light and shadow color values ​​of the virtual plant dynamically adapt to the main color of the song's cover art (such as orange, white, blue, magic color, etc.), making the playback interface harmonious and unified, and enhancing the user's immersion.

[0050] In the embodiments of this application, through diverse virtual plant images and the structured division of virtual plants at the particle level (such as roots, stems, leaves, and flowers), it is possible to flexibly and independently adjust and differentiate the configuration of at least a part (such as a specific part) or the entire virtual plant, thereby achieving fine-grained adjustment at the part level.

[0051] Specifically, in the song's playback interface, virtual plants that match the song's semantic theme are displayed in particle form, including the following steps: Step 1: Determine the number of particles for the virtual plant based on the performance of the terminal device.

[0052] In some embodiments, the more particles a virtual plant has, the more detailed the image, but the higher the performance requirements of the terminal device. Optionally, based on the performance of the Graphics Processing Unit (GPU), the terminal device can automatically adjust the number of particles for the virtual plant. Specifically, the terminal device can be divided into three levels: high-end, mid-range, and low-end, based on the performance of the GPU. Different levels of terminal devices are adapted to different numbers of particles for the virtual plant. For example, high-end devices (such as those equipped with a chip whose GPU performance meets a first preset threshold) have the most particles (e.g., 800 to 1000). Mid-range devices (such as those equipped with a chip whose GPU performance does not meet the first preset threshold but meets a second preset threshold, where the second preset threshold is less than the first preset threshold) have the second most particles (e.g., 500 to 700). Low-end devices (such as those equipped with a chip whose GPU performance is below the second preset threshold) have the fewest particles (e.g., 200 to 400).

[0053] In the embodiments of this application, by automatically adjusting the number of particles according to the GPU performance of the terminal device, the fineness of the picture and the smoothness of the system operation can be effectively balanced, improving the adaptability of this application solution to terminal devices with different performance levels, and ensuring that all types of devices can smoothly and seamlessly display virtual plants in particle form that match the semantic theme of the song in the song playback interface.

[0054] Step 2: Obtain the particle parameters of the virtual plant from the plant particle resource library; the particle parameters include the particle distribution topology, deformation parameters, and oscillation physical parameters of the virtual plant.

[0055] In some embodiments, the terminal device obtains the particle parameters of the virtual plant from a plant particle resource library. Optionally, the plant particle resource library can be considered a standardized resource file pre-stored locally on the terminal device. The plant particle resource library stores particle parameters for various virtual plants. Each virtual plant corresponds to an independent set of particle parameters. Optionally, the particle parameters include the particle distribution topology, deformation parameters, and oscillation physical parameters of the virtual plant. The particle distribution topology refers to the spatial layout of the particles, used to define the overall outline and structure of the virtual plant. For example, in a sunflower, particles are densely arranged in a disc shape in the stamen area, while particles are sparsely arranged radially in the petal area. The deformation parameters refer to the deformation rules of the particles when subjected to force or control, used to define how the virtual plant generates physical deformation feedback when touched or affected by interaction (e.g., particles diffuse outward after being clicked). The oscillation physical parameters refer to the motion rules of the particles driven by music, used to define the dynamic behavior of the virtual plant. For example, the oscillation amplitude, frequency, damping coefficient, etc., of the particles determine how the virtual plant moves with the rhythm of the song.

[0056] Step 3: Based on the number of particles and particle parameters, render and generate virtual plants in particle form.

[0057] In some embodiments, the terminal device, based on the number of particles obtained in step 1 and the particle parameters obtained in step 2, performs real-time rendering using a lightweight particle rendering engine (such as one built on a Web Graphics Library (WebGL)) to generate virtual plants in particle form. Optionally, the rendering engine loops every frame, dynamically updating the position, color, and trajectory of each particle according to real-time changes in music characteristics and user interaction, thereby presenting a complete, smooth, and interactive particle-based virtual plant on the screen.

[0058] For example, a lightweight particle system is built based on WebGL, and the number of particles is automatically adjusted according to the GPU performance of the terminal device: 800 to 1000 particles for high-end devices, 500 to 700 particles for mid-range devices, and 300 to 400 particles for low-end devices, to ensure a stable frame rate (e.g., greater than or equal to 50fps) output for all models.

[0059] In some embodiments, a hybrid rendering method combining skeletal animation and particle overlay is employed. This solution achieves ultra-high precision plant dynamic effects on high-end devices, while using pure frame animation for lightweight rendering on low-end devices. Through multi-path technology, the solution achieves equivalent visual performance on terminal devices with varying performance levels. Skeletal animation is an advanced animation technique that controls the "skin" by manipulating the "skeleton." Its core principle is: Skeleton – establishing an invisible hierarchical skeletal structure within the virtual plant (e.g., main stem skeleton, branch skeleton, leaf skeleton, petal skeleton). Skinning – "binding" the plant's particle model to the corresponding skeleton. Driving – rotating, translating, and scaling the skeleton to cause the particles on the skin to deform according to physical laws (e.g., the entire plant bends and sways when the wind blows the stem, or petals droop naturally due to gravity). Pure frame animation is a traditional animation technique that simulates motion by rapidly playing a series of pre-rendered static image frames. Pure frame animation is simple to implement, has very low hardware performance requirements, and does not require complex frame-by-frame physical calculations.

[0060] For example, for high-end devices, the system loads a detailed model of a virtual plant. This model includes a skeleton composed of a preset number of bones, for example, 50 bones, specifically including 1 main stem, 10 branches, 20 leaves, and 19 petals. After a song starts playing, the background AI analyzes the song's BPM as 140 (fast tempo) and drives the algorithm to map the high BPM to high-frequency, large-amplitude skeletal rotation parameters. Based on this, the high-end device performs animation rendering: the skeletal layer, where all the preset number of bones (e.g., 50 bones) begin to sway synchronously according to a physical algorithm. The main stem sways left and right, while the branches, leaves, and petals sway independently but in a coordinated manner, creating a realistic feeling of a plant swaying in a strong wind. Particle overlay layer: On top of the skeletal-driven plant, a first layer of special effects particle system is overlaid. For example, 800 to 1000 colorful flashing particles are sprayed outward from the center of the flower and scattered, forming a dazzling visual effect. Ultimately, the virtual plants (such as sunflowers) exhibit dramatic and physically realistic dynamic swaying and deformation effects driven by music, accompanied by dazzling light particle effects, resulting in an extremely gorgeous and smooth visual experience with a stable frame rate (such as 60fps) throughout.

[0061] In the embodiments of this application, virtual plants that match the semantic theme of the song are displayed in the song playback interface in the form of particles. This can achieve accurate and automated matching between the song's semantics and visual imagery, intuitively convey the song's emotions and artistic conception, enhance the dynamic expressiveness of the playback interface, and help enhance the deep linkage between music content and visual elements, thereby improving the user's sensory immersive experience.

[0062] Step 220: During the playback of the song, dynamically adjust the motion effects and / or display effects of the virtual plants as the musical characteristics of the song change.

[0063] The musical characteristics of a song include, but are not limited to, one or more of the following: the rhythm of the song, the style of the song, the number of beats per minute (BPM) of the song, and the spectral characteristics of the song.

[0064] Specifically, BPM is a standard unit for measuring the tempo of a song, representing the number of beats per minute. For example, a slow song has a BPM of approximately 60-80, while a fast-paced song can reach 120-140 or even higher. BPM directly determines the swaying frequency and rhythm of the virtual plants. The higher the BPM, the faster and more dynamic the plants' feedback. For instance, a DJ song with a BPM of 140 will have a very high swaying frequency in its virtual plants, with particles moving rapidly, almost as if "dancing." A ballad with a BPM of 60 will have virtual plants that sway gently and soothingly.

[0065] Specifically, spectral characteristics are used to reflect the timbre and dynamic layers of a song. Variations in high-frequency energy (such as cymbals, high-pitched vocals) and low-frequency energy (such as bass, drum beats) can be used to finely control the detailed effects of virtual plants. For example, when the drum beats (low-frequency energy) in a song are enhanced, the roots or branches of the virtual plant can produce synchronized vibration feedback; when high-frequency energy (such as strings or electronic synthesized sounds) appears, the stamens or leaf edges of the plant can produce particle shimmering or flickering effects.

[0066] Specifically, musical style is a classification label for the artistic style of a song, reflecting its overall characteristics in terms of melody, rhythm, instrumentation, and emotional expression. Different musical styles correspond to different emotional tones, directly affecting the movement and / or display effects of virtual plants. For example, rock music typically has a strong rhythm and intense emotions, thus triggering high light and shadow intensity and high saturation display effects for virtual plants. Folk music is usually softer and more soothing, corresponding to lower light and shadow intensity and warmer color tones for virtual plants.

[0067] Optionally, the motion effects of the virtual plants include, but are not limited to, one or more of the following: the swaying frequency of the virtual plants, the swaying amplitude of the virtual plants, and the rhythm of the virtual plants. The display effects of the virtual plants include, but are not limited to, one or more of the following: the color saturation of the virtual plants, the light and shadow intensity of the virtual plants, the hue of the virtual plants, and the color value of the virtual plants.

[0068] In some embodiments, the movement effect of the virtual plant is dynamically adjusted as the musical characteristics of the song change, including: when the rhythm of the song changes from a first rhythm to a second rhythm, the swaying frequency of the virtual plant is switched from a first frequency to a second frequency; and / or, when the rhythm of the song changes from a second rhythm to a first rhythm, the swaying frequency of the virtual plant is switched from a second frequency to a first frequency; wherein the first rhythm is higher than the second rhythm, and the first frequency is greater than the second frequency.

[0069] For example, when the playing song changes from a slow folk song to a fast rock song, the tempo changes from a first tempo (slow, e.g., 70 BPM) to a second tempo (fast, e.g., 130 BPM). In response to this tempo change, the virtual plant's swaying frequency changes from a first frequency (low frequency, e.g., 1 to 2 sway per second) to a second frequency (high frequency, e.g., 4 to 6 sway per second). The virtual plant's particle system adjusts the trajectory of each particle in real time based on the updated swaying frequency parameters, giving the virtual plant an overall high-frequency, large-amplitude rhythmic effect that matches the fast-paced song. Correspondingly, when the song changes back from the second tempo (fast, e.g., 130 BPM) to the first tempo (slow, e.g., 70 BPM), the virtual plant's swaying frequency changes back from the second frequency (high frequency, e.g., 4 to 6 sway per second) to the first frequency (low frequency, e.g., 1 to 2 sway per second), restoring a gentle, soothing swaying posture.

[0070] Through the above dynamic adjustments, the movement effects of the virtual plants are linked in real time with the rhythmic characteristics of the song, enhancing the synchronicity between the song content and visual elements and improving the user's visual immersion.

[0071] In some embodiments, the display effect of virtual plants is dynamically adjusted as the musical characteristics of the song change, including: when the style of the song changes from a first style to a second style, the light and shadow intensity of the virtual plants is switched from a first intensity to a second intensity; and / or, when the style of the song changes from a second style to a first style, the light and shadow intensity of the virtual plants is switched from a second intensity to a first intensity; wherein the first style and the second style are different, and the first intensity and the second intensity are different.

[0072] For example, when the playing song changes from folk to rock, the song's genre changes from the first genre (folk) to the second genre (rock). In response to this genre change, the lighting intensity of the virtual plant changes from a first intensity (weak light, e.g., a halo radius of 5 pixels and a brightness of 30%) to a second intensity (strong light, e.g., a halo radius of 15 pixels and a brightness of 80%). Simultaneously, the virtual plant's color saturation and hue also adjust accordingly. For instance, in folk music, the virtual plant's hue leans towards warm yellow with a lower color saturation (e.g., 60%); after switching to rock, the hue is adjusted to a more vibrant combination of red and purple, with a significantly increased color saturation (e.g., 90%) to match the high-energy, energetic tone of rock music. The virtual plant's particle rendering engine recalculates the brightness, halo, and color of each particle based on the updated lighting intensity and color parameters, ensuring the virtual plant presents a visual atmosphere that matches the current music genre.

[0073] Through the above dynamic adjustments, the display effect of the virtual plants is deeply linked with the style of the song, enhancing the visual expression of the song's emotions and optimizing the user's sensory experience.

[0074] In the embodiments of this application, a dynamic visual adaptive system driven by song music features is constructed. By establishing a dynamic mapping model between song music features and virtual plant motion effects and / or display effects, the virtual plants can adaptively change in real time with the rhythm and style of the played content. This helps to break through the technical limitations of traditional players' fixed dynamic effects and inability to iterate with content, thereby enhancing the deep linkage effect between song content and visual elements, improving the immersive experience of user listening and visual interaction, and thus realizing real-time intelligent iteration of playback visual effects.

[0075] Step 230: In response to interactive actions on the virtual plant, display feedback animations corresponding to the interactive actions generated by the virtual plant.

[0076] Specifically, in response to interactive operations on virtual plants, feedback animations corresponding to the interactive operations generated by virtual plants are displayed, including: in response to interactive operations on virtual plants, determining the part of the virtual plant that generates feedback animations; and displaying feedback animations corresponding to the parts, with different parts corresponding to different feedback animations.

[0077] In some embodiments, the virtual plant comprises, but is not limited to, multiple parts such as flowers (petals, stamens), leaves, roots, and stems. Furthermore, each part corresponds to an independent particle collision box, enabling the system to determine the specific touch location based on user interaction (such as touch operation) and generate differentiated feedback animations corresponding to that part. The particle collision box is a virtual, invisible detection area (such as a rectangle, circle, or other shape) attached to each part of the virtual plant (flower, leaf, root, stem) to detect whether the user's touch operation "collides" with that part. Further, if a touch point falls within multiple collision box areas simultaneously, the system determines the collision according to a preset priority (such as flower > leaf > stem > root). For example, the particle collision box corresponding to a flower (petals, stamens) is a circular area with a radius of 30 pixels, covering all particles at the top. The particle collision box corresponding to a leaf (leaf) is 20 pixels in shape. A 15-pixel rectangular area covers the leaf particles, slightly below the center. The particle collision box corresponding to the root (root area) has a 15-pixel shape. A 15-pixel rectangular area covers the root particles at the bottom. The particle collision box corresponding to the stem (branch) has a shape of 10 pixels. A rectangular area of ​​50 pixels, whose coverage includes the central branch particles.

[0078] For example, the system divides the virtual plant model into four independent collision boxes: flower, leaf, root, and stem. It monitors the user's touch coordinates (e.g., X and Y coordinates), touch duration, and touch pressure in real time. The system determines the touch area through coordinate intersection and calls the corresponding particle deformation algorithm to achieve differentiated dynamic feedback at different locations, with a response latency of ≤30ms. The particle deformation algorithm is a set of calculation rules used to control the shape, position, and distribution changes of virtual plant particles under external influences (such as user touch, music rhythm, etc.). Different parts are touched, and different deformation algorithms are called to produce different feedback effects (e.g., leaves scattering light spots, or petals shaking and closing). The particle deformation algorithm converts the user's touch input (touch coordinates, touch duration, touch pressure) into particle-level visual feedback.

[0079] Optionally, in response to an interactive operation on the virtual plant, the part of the virtual plant that generates a feedback animation is determined, including: if the interactive operation is a touch operation, determining the touch area based on the coordinate information of the touch operation; and determining the part of the virtual plant that generates a feedback animation based on the touch area. The touch operation can be a gesture initiated by the user using a finger, stylus, or other input device on the virtual plant and sustained for a preset time or distance, including but not limited to clicking, dragging, or moving.

[0080] For example, when a user touches the leaf area of ​​a virtual plant, the system determines that the touched area is a "leaf" through coordinate intersection, and then calls the particle deformation algorithm to generate a particle feedback animation effect of "leaf swaying and scattering light spots". When the user touches the petal area of ​​the virtual plant, the system determines that the touched area is a "petal" and triggers the corresponding feedback animation effect of "petals shaking slightly and closing inward".

[0081] Furthermore, when the interactive operation is a touch operation, the parts of the virtual plant that produce feedback animations can be determined by combining the emotional characteristics of the song and the number of times the user touches the screen, and the state of the virtual plant can be dynamically adjusted.

[0082] For example, while playing an upbeat rock song, a user rapidly taps the leaf area of ​​a virtual plant multiple times. Specifically, this could include the following steps: Step 1, Song Emotion Recognition: The background AI semantic analysis module identifies the emotional characteristics of the currently playing song as "exhilarating and high-pitched" (emotion score: 0.85).

[0083] Step 2, Touch Operation Detection: The system detects that the user's three consecutive touch operations are all applied to the "leaf" area through the layered collision box, and the touch interval is less than 0.5 seconds, which is judged as "high-frequency continuous touch".

[0084] Step 3, Comprehensive Judgment and Dynamic Adjustment: The touch coordinates fall into the "leaf" collision box, and the judgment part is the leaf. The mood value is calculated based on the song's emotional characteristics (excitement → +5 points / touch) and the touch frequency (3 times), resulting in an increase of 5 points / touch × 3 times = 15 points. Feedback animation adjustment: The system superimposes the current song's exciting emotion (high brightness, high saturation) with continuous touches: In addition to the default feedback of "swinging and scattering light spots," the leaf produces an additional particle burning trail effect, with the light spot color gradually changing from green to red. The intensity of the feedback animation (scattering range, particle speed) is increased to 1.5 times the default value.

[0085] Step 4, Status Update: After the mood value is updated, the terminal device will display a message indicating "Mood value +15".

[0086] In the embodiments of this application, by combining the emotions of the song and the frequency of user interaction, the state of the virtual plant is adjusted in a refined and dynamic manner, so that the feedback animation is deeply coupled with the emotions of the song and user behavior, thus enriching the interaction layers.

[0087] In the embodiments of this application, the above-mentioned layered collision detection mechanism can achieve a refined interactive experience with different feedback animations corresponding to different touch points.

[0088] Alternatively, in response to interactive actions on virtual plants, the system can determine the parts of the virtual plant that produce haptic feedback effects. This includes, in the case of voice interaction, determining the parts of the virtual plant that produce haptic feedback effects based on the corresponding voice command. Voice commands can be used to control the shape of the virtual plant and the on / off state of its special effects (whether or not haptic feedback effects are produced).

[0089] In some embodiments, voice commands can directly specify the parts of the virtual plant that require haptic feedback. For example, when a user says the voice command "shake the stem," the system parses the command through a voice recognition module and controls the virtual plant's stem to produce a shaking haptic feedback effect of a predetermined amplitude (e.g., 3°). When the user says the voice command "turn the stamen red," the system responds to the command by controlling the particle color gradient of the virtual plant's stamen to switch to red, thereby changing the display effect of the virtual plant.

[0090] In some embodiments, voice commands may only indicate the desired feedback animation, without specifying the part of the virtual plant to produce the feedback animation. In this case, optionally, the system may control the overall shape of the virtual plant to produce the feedback animation. For example, when the user says the voice command "shake it," the system controls all parts of the virtual plant (including petals, stamens, leaves, roots, and branches) to synchronously produce a shaking feedback animation of a predetermined amplitude.

[0091] Alternatively, the system can intelligently determine the part of the virtual plant to generate the feedback animation based on the user's previous operation history. For example, while playing a song, a user interacts with a virtual plant by saying "grow bigger" via voice command. If, in the user's previous 10 operations, 8 times they requested the flower's stamen to grow bigger, and 2 times they requested the leaves to grow bigger, the system can identify the user's preferred part as the flower's stamen through frequency statistics. When the user subsequently says "grow bigger," the system will intelligently determine that the part generating the feedback animation is the flower's stamen, and execute a feedback animation of the flower's stamen particles spreading and enlarging outwards.

[0092] In the embodiments of this application, the parts of the virtual plant that produce feedback animations are determined through voice interaction, and the feedback animations corresponding to the parts are displayed, thus realizing a multimodal interactive experience without manual operation.

[0093] Alternatively, in response to an interactive operation on a virtual plant, determine the part of the virtual plant that produces a feedback animation, including: if the interactive operation is a device posture adjustment operation, determine the part of the virtual plant that produces a feedback animation based on the tilt direction of the device posture adjustment operation.

[0094] For example, when a user tilts the terminal device to the right, the terminal device's built-in gyroscope or gravity sensor detects this change in posture. In response to this tilt direction, the system determines the parts of the virtual plant that produce feedback animations, including controlling the virtual plant's petals, stamens, leaves, roots, and branches to produce natural swaying or movement feedback in a rightward direction, simulating a physical effect similar to that of a real plant affected by gravity. When the user tilts the terminal device to the left, the system determines the parts of the virtual plant that produce feedback animations, including controlling the virtual plant's leaves, roots, and branches to produce corresponding swaying feedback in a leftward direction.

[0095] In the embodiments of this application, by utilizing the gyroscope or gravity sensor built into the terminal device, multiple parts of the virtual plant can be dynamically swayed with the tilt angle of the terminal device, expanding the interaction methods and enhancing the fun and realism of the operation.

[0096] In the embodiments of this application, in response to interactive operations on virtual plants, feedback animations corresponding to the interactive operations generated by the virtual plants are displayed, enabling refined, differentiated, and low-latency touch interaction technology. Through a layered particle collision box detection algorithm, the limitations of traditional single-click feedback are overcome, achieving multi-position, multi-form physical-level realistic interactive feedback, thus improving the real-time performance and immersive experience of the interaction.

[0097] It should be understood that steps 220 and 230 above can be performed only once. Optionally, the music playback method can perform only steps 210 and 220. This approach only implements the function of the virtual plant dynamically changing with the music features and does not include the function of interactive feedback. Alternatively, the music playback method can perform only steps 210 and 230. This approach only includes the function of interactive feedback and does not include the function of the virtual plant dynamically changing with the music features.

[0098] In some embodiments, the song playback method includes the following steps: semantically encoding the song to obtain its semantic theme; and retrieving virtual plants matching the song's semantic theme from a theme plant mapping knowledge base, wherein the theme plant mapping knowledge base includes the mapping relationship between the song's semantic theme and virtual plants. Semantic encoding of the song may include: semantically encoding the song's lyrics, song tags, and genre information to output the song's theme, emotional tendency, and imagery keywords. For example, the theme plant mapping knowledge base may include "Good Luck - Peony," "Gentle - Hydrangea," and "Passionate - Rose." The theme plant mapping library may also include mappings of other plants to themes, which is not limited in this application.

[0099] For example, a lightweight semantic reasoning model (such as a Bidirectional Encoder Representations from Transformers (BERT) model) is used to semantically encode the song lyrics, song tags, and genre information, outputting the song's theme, emotional tone, and imagery keywords. Then, virtual plants matching the song's semantic theme are retrieved from a theme-based plant mapping knowledge base established on the server.

[0100] In some embodiments, during the process of retrieving virtual plants that match the semantic theme of a song from a theme plant mapping knowledge base, the server can set a confidence threshold (e.g., 70%). If the calculated confidence score is lower than this threshold, the match is considered to have failed, triggering a fallback mechanism. Specifically, the fallback mechanism includes: retrieving virtual plants that match the song's style, and inputting the failed-match samples into the theme plant mapping knowledge base for subsequent iterative annotation, thereby resolving the problem of incomplete semantic recognition coverage. The virtual plants that match the song's style belong to a preset general plant template for different styles, which includes various commonly used plants corresponding to different styles. For example, the virtual plant corresponding to a rock song style is a cactus.

[0101] Furthermore, if the value is below the confidence threshold, a virtual plant corresponding to a preset pattern (such as an art fan pattern or a user-defined plant pattern) can be displayed on the song's playback interface.

[0102] For example, the system uses a lightweight AI semantic model (such as a quantized BERT model) to parse the lyrics of the currently playing song in real time, extracting core natural imagery keywords, such as "small yellow flower." The system queries a pre-defined thematic plant mapping knowledge base to attempt to obtain the virtual plant corresponding to this natural imagery. If the thematic plant mapping knowledge base includes a virtual plant corresponding to "small yellow flower," the match is successful, and the corresponding virtual plant (such as a sunflower) is directly generated and rendered in real time on the playback interface. If the thematic plant mapping knowledge base does not include a virtual plant corresponding to "small yellow flower," the match fails with a confidence level of 0. In this case, the system abandons direct matching based on natural imagery and instead retrieves a corresponding general virtual plant template from a pre-defined general plant template library based on the song's style for rendering and display. For example, if the song's style is "pop," a pre-defined general pop style plant template (such as a cactus) is matched. Furthermore, the system records the unknown sample "small yellow flower" and adds it to the database for subsequent iterative updates and learning of the knowledge base.

[0103] In the embodiments of this application, the technical deficiency of traditional players in being unable to generate concrete imagery of songs is solved by using lightweight AI semantic reasoning and fallback mechanisms. The semantic recognition accuracy is high and the reasoning latency is low, thereby improving the relevance and adaptability of music and visual content.

[0104] In some embodiments, the song playback method includes the following steps: semantically encoding the song to obtain the semantic theme of the song; and using a multimodal large model to generate virtual plants that match the semantic theme of the song.

[0105] For example, by using a multimodal large model (such as Contrastive Language-Image Pre-training (CLIP)), without the need for a pre-set plant mapping library (such as a thematic plant mapping knowledge base), personalized particle virtual plants of arbitrary shapes can be directly generated by calculating the similarity of the textual and image features between the lyrics of a song and the cover image, thus breaking through the limitations of a fixed material library on the shape of virtual plants.

[0106] In some embodiments, users can customize plant parameters and upload them to a library (a new sample file library on a local or cloud basis, used as input for a plant particle resource library or training dataset). Based on the user-customized new sample data, the system performs lightweight incremental training on the AI ​​generation model (such as the BERT model) on the backend server, enabling it to identify and generate plants similar to the user's preferences, thus achieving personalized plant generation iteration.

[0107] Specifically, users can customize or adjust various appearance and physical parameters of virtual plants through a terminal interface to generate personalized plants. Optionally, the range of user-customizable parameters includes at least one or more of the following: appearance parameters, dynamic parameters, and structural parameters. Appearance parameters include one or more of the following: plant type, petal shape, color, size, and texture pattern. Dynamic parameters include one or more of the following: sway amplitude, sway frequency, particle density, and light and shadow intensity. Structural parameters include one or more of the following: plant height, number of leaves, and stamen morphology.

[0108] For example, a user might prefer a "blue-purple gradient rose," but this plant isn't in the system's default plant particle resource library. The user can click the "Create My Plant" button to access the parameter customization interface. Further, the following actions can be taken: Select the base template: Rose; Modify the petal color: change it from the default red to a gradient blue-purple; Adjust the particle distribution topology: increase the particle density in the petal area by 20%; Adjust the deformation parameters: set the diffusion speed of the petals when touched to 1.5 times the default value; Preview the effect: preview the 3D particle morphology of the custom plant in real time. After customization, the user clicks the "Save and Upload" button. The system packages the complete particle parameter set of the custom plant (including the color matrix, topology layout, and deformation rules) into an incremental sample file and uploads it to the cloud server via an encrypted channel. Upon receiving the sample, the cloud server performs the following actions: Adds the sample to the system's plant particle resource library, creates a unique plant category for the user (e.g., "User Identifier_Blue-Purple Rose"), and performs lightweight incremental fine-tuning of the backend multimodal generation model (e.g., CLIP) to prioritize matching the user's preferred style during inference. When a user plays the song again, the system will prioritize matching a virtual plant from the user's personalized plant library. For example, when playing a ballad, the system will automatically generate a blue-purple gradient particle rose instead of the default red rose.

[0109] For example, a user plays song A, and the system defaults to matching a "sunflower." However, the user believes the song should be matched with a "dandelion." The user can replace the default matched plant. For instance, the user long-presses the default matched virtual plant and selects "Change" from the pop-up menu. The system displays a list of candidate plants, and the user selects "dandelion." The system records this correction and generates a feedback sample: {Input features: semantic encoding of song A (summer, breeze, relaxed); User's expected output: dandelion; System default output: sunflower}. This feedback sample is uploaded to the cloud server via an encrypted channel. After receiving the feedback sample, the cloud server adds the sample to the unlabeled queue of the topic plant mapping knowledge base and incrementally fine-tunes the quantized lightweight semantic reasoning model (such as a quantized BERT model), adjusting the weight of the mapping "summer breeze → dandelion." When processing similar semantics subsequently (such as another song describing "summer coolness"), the model has a higher probability of matching "dandelion."

[0110] In the embodiments of this application, by uploading user-defined parameters, the limitations of a fixed material library on plant morphology can be broken, satisfying users' personalized experience. Simultaneously, feedback samples generated through user error correction enable dynamic iteration of the mapping knowledge base, improving the model's ability to understand individual user preferences.

[0111] In some embodiments, virtual plants include different growth levels. Optionally, virtual plants may include a first growth level, a second growth level, and a third growth level. Optionally, different growth levels correspond to different virtual plant sizes. Virtual plants at different growth levels differ in particle detail, number of leaves, petal shape, and lighting effects, with the form progressively upgrading. For example, the first growth level corresponds to a seedling, the second growth level corresponds to a medium-sized plant, and the third growth level corresponds to a mature plant.

[0112] In some embodiments, the growth level of a virtual plant is related to a growth value, which is obtained based on task completion. Optionally, task completion can be determined based on one or more of the following: song playback duration, number of times a song is shared, activation of membership benefits, number of views or duration of compliant advertisements, and effective listening time of the user. Further, the task can be defined by officially published standards.

[0113] In some embodiments, growth points are acquired solely based on the user's effective listening time. This approach simplifies the growth logic, relying solely on the user's playback behavior to upgrade the level, effectively avoiding the risk of rule bypassing that may arise from a diversified task system.

[0114] In some embodiments, when the growth value of a virtual plant meets preset conditions, the virtual plant is controlled to switch from a first growth level to a second growth level; wherein the form of the virtual plant corresponding to the first growth level is different from the form of the virtual plant corresponding to the second growth level.

[0115] For example, Figure 4 A schematic diagram of a song playback interface provided in another embodiment of this application is shown. Figure 4 As shown, Figure 4 In sub-image A, the song playback interface displays the first growth level of the virtual plant 420 (such as a rose). Figure 4 In subgraph B, the song playback interface displays a virtual plant 430 (e.g., a rose) at the second growth level. The size of the virtual plant 420 corresponding to the first growth level is smaller than the size of the virtual plant 430 corresponding to the second growth level.

[0116] In some embodiments, a particle interpolation transition algorithm is designed for a three-stage growth system (first growth level, second growth level, and third growth level). After the growth value reaches the target, a smooth morphological upgrade is completed through particle increment generation, topology fine-tuning, and color gradient, thereby avoiding abrupt transitions.

[0117] For example, when the accumulated growth value from a user's effective listening time, number of shares, and other behaviors reaches a preset threshold (e.g., 1000 growth values ​​are needed to upgrade from a seedling to a mature plant), the terminal device will trigger a morphological iteration of the plant. This iteration can achieve a smooth transition using a particle interpolation transition algorithm. Specifically, it may include the following steps: Step 1: The test meets the standards.

[0118] In some embodiments, the server verifies that the user's growth value has reached 1000 points and notifies the terminal device.

[0119] Step 2, trigger the transition.

[0120] In some embodiments, the terminal device initiates a particle interpolation algorithm. During the transition period (e.g., within 2 seconds): the following steps are completed: Incremental particle generation: The system gradually adds new particles to the existing "seedling" shaped particles until their number reaches the standard of a "medium-sized plant". Topological fine-tuning: The spatial layout of the particles slowly evolves from a compact "seedling" topology to a more expansive "medium-sized plant" topology. Color gradation: The main color tone of the particles gradually transitions from a softer light green to a more vibrant and energetic emerald green.

[0121] Step 3: Complete the iteration.

[0122] In some embodiments, upon completion of the transition, the virtual plant fully manifests as a "medium-sized" plant, with larger leaves, richer petal layers, and higher particle detail. The entire upgrade process exhibits a high degree of visual coherence, avoiding the jarring feeling caused by abrupt transitions.

[0123] Furthermore, when the growth value and mood value of the virtual plant meet the preset conditions, the virtual plant is controlled to switch from the first growth level to the second growth level; wherein, the form of the virtual plant corresponding to the first growth level is different from the form of the virtual plant corresponding to the second growth level.

[0124] For example, the user's virtual plant (sunflower) is at the first growth level (seedling). The user listens to music and interacts frequently for a week. Optionally, the following steps may be included: Step 1: Calculate growth value and mood value.

[0125] For example, a user has earned 1500 growth points through effective listening to music (cumulative 15 hours) and sharing songs (10 times), reaching the preset threshold (1000 points) to upgrade from the first level (seedling) to the second level (middle plant). During this period, whenever the user hears a cheerful song, they will click on the flower stamen area of ​​the plant multiple times, accumulating 300 mood points.

[0126] Step 2: Conduct a two-dimensional assessment of compliance.

[0127] In some embodiments, the server detected a growth value of 1500 points (met the target) and a mood value of 300 points (exceeding the threshold of 200 points for unlocking the plant form). Therefore, the result is: both dimensions meet the target.

[0128] Step 3, form unlocking and transition.

[0129] Furthermore, due to achieving the dual-dimensional targets, the system triggers special upgrade animations. For example, a colorful particle halo appears around the seedling, accompanied by an animation of petals blooming, making the upgrade process more spectacular than achieving a single growth value target. The upgraded medium-sized plant gains an additional exclusive effect: whenever a cheerful song is played, the sunflower's stamen emits a faint golden halo (which can be considered a hidden effect that cannot be triggered by a single-dimensional upgrade).

[0130] Step 4, Mood points are consumed.

[0131] In some embodiments, after upgrading, the mood value is reset to zero and a new round of accumulation begins, which is used to trigger the advancement unlock conditions for the next growth level (medium plant → mature plant).

[0132] In the embodiments of this application, by constructing a dual-dimensional unlocking mechanism of growth value and mood value, on the one hand, users are encouraged to obtain growth value by playing songs regularly over a long period of time, and on the other hand, users are encouraged to obtain mood value by engaging in high-frequency, high-quality, in-depth interactions with virtual plants, thereby significantly enriching the plant's feedback levels and the user's sense of immersion.

[0133] In the embodiments of this application, particle interpolation transition technology is used to realize visual smooth form iteration driven by growth value, which solves the technical shortcomings of related technologies that only change numerical values ​​and do not have visual form iteration. It realizes the full-link technical linkage of user behavior → numerical (growth value) change → visual upgrade, which helps to form a stable positive incentive technical mechanism.

[0134] In some embodiments, the song playback method further includes a virtual plant style selection and unlocking function. Specifically, upon first triggering of the style selection function, a first style selection interface displays at least one candidate virtual plant style option in a pop-up window. For example, Figure 5 A schematic diagram of a virtual plant style selection interface provided in one embodiment of this application is shown. Figure 5 As shown, Figure 5 Sub-figure A shows the interface when a user first clicks or enters a preset mode (such as the Starlight Flower Path mode), which includes a first pop-up window 510. The first pop-up window 510 may include multiple candidate styles (such as Flower Style 1, Flower Style 2, and Flower Style 3). In response to the user's selection of one of the candidate options, the terminal device switches the virtual plant displayed in the currently playing interface to the style corresponding to the selected candidate option. Figure 5 Subgraphs B and C show the interface for users selecting flowers before their first time. Figure 5 As shown in sub-image B, this interface includes a second pop-up window 520. The second pop-up window 520 displays the message "1 flower pattern unlocked" and shows the preset unlocking conditions (e.g., "Listen to music for another 15 days to unlock a new flower"). The second pop-up window 520 includes multiple candidate styles (style 1, style 2, style 3) and their current states: style 1 and style 2 are in a second state (e.g., locked, where the user can only view the appearance but cannot apply it), while style 3 is in a first state (e.g., highlighted and selectable, where the user can select and apply it). Figure 5 As shown in sub-diagram C, this interface includes a third pop-up window 530. The third pop-up window 530 appears after the user unlocks the second pattern. The third pop-up window 530 displays "2 patterns unlocked" and updates the unlocking progress information (e.g., "Current progress 2 / 15"). In the third pop-up window 530, pattern 1 is still in the second state, while pattern 2 and pattern 3 are both in the first state.

[0135] Furthermore, if the preset unlocking conditions are not met (e.g., "listening to music for 15 days within 30 days"), the corresponding candidate virtual plant's style options are in a second state (e.g., grayed out, locked and inoperable), and the user can only view its appearance but cannot apply the style. Conversely, if the preset unlocking conditions are met, the corresponding candidate style options automatically switch from the second state to the first state (e.g., highlighted, unlocked and operable), thus allowing the user to change the virtual plant's style through selection.

[0136] In the embodiments of this application, by providing virtual plant style selection and unlocking functions, users can be guided to participate in preset interactive tasks or music listening behaviors, and obtain different styles of virtual plant appearances based on task completion, thereby enhancing user engagement and usage.

[0137] In some embodiments, the server calculates the user's growth value, which is obtained based on task completion and an anti-cheating mechanism to ensure the authenticity of the growth value.

[0138] For example, to ensure the authenticity and validity of growth values, the backend server incorporates multi-dimensional anti-fraud technology for verification during growth value calculation. Specifically, this includes the following steps: Step 1, behavior trigger.

[0139] In some embodiments, when a user opens the application to play a song, the background begins recording the playback duration.

[0140] Step 2, anti-cheating verification.

[0141] In some embodiments, the server performs the following multiple checks simultaneously, and only if all checks pass is the playback considered valid: 1) Audio valid playback check: Detecting whether the audio data packets are actually sent and decoded, rather than being played silently. 2) Screen status check: Detecting whether the application is running in the foreground, rather than being played in the background. 3) Device fingerprint check: Verifying the unique identifier of the current device to prevent a single user from using scripts to simulate multiple devices for score manipulation. 4) Abnormal behavior risk control: Analyzing whether the playback behavior conforms to normal user patterns (e.g., whether the playback duration is abnormally continuous).

[0142] Step 3: Accumulate growth value.

[0143] In some embodiments, after all verifications pass, the server adds the growth value corresponding to this playback action (e.g., 1 growth point for every 1 minute of effective playback) to the user's account. If the verification fails, no growth value is calculated for this action.

[0144] Step 4, results synchronized.

[0145] In some embodiments, the server sends the updated growth value to the terminal device, and if the target is met, the plant's morphological iteration is triggered.

[0146] In the embodiments of this application, a multi-dimensional anti-cheating mechanism is used to effectively block cheating behaviors such as background listening, script farming, and batch score farming, ensuring the authenticity and validity of growth value data, thereby maintaining the fairness of the plant cultivation system and the stability of the incentive mechanism.

[0147] In some embodiments, in the song playback interface, if a song corresponds to multiple semantic themes simultaneously, the server determines the semantic theme corresponding to the first weight based on the weight of the multiple semantic themes, and displays a virtual plant that matches that semantic theme. The first weight is the largest among the multiple semantic themes.

[0148] For example, song B corresponds to three semantic themes: rain, waves, and sunshine. The server calculates the weight of each of these three semantic themes based on their frequency or number of occurrences in the lyrics of song B. If sunshine has the highest weight, it is determined to be the semantic theme corresponding to the first weight, and a virtual plant (such as a sunflower) matching "sunshine" is displayed on the playback interface.

[0149] In some embodiments, a virtual garden matching the semantic theme of the song is displayed in the song's playback interface. The virtual garden includes multiple virtual plants.

[0150] For example, the terminal device constructs a condition-triggered virtual plant unlocking mechanism based on a specific workflow (such as AI+VibeCoding). The system presets multiple candidate virtual plant styles, each associated with a specific unlocking condition. The unlocking condition can be a quantifiable indicator such as the user's listening time, number of days of listening, or completion of a specific task. For example, the first virtual plant style (such as "blue hydrangea") is associated with the first unlocking condition, and the second virtual plant style (such as "orange rose") is associated with the second unlocking condition. When the user meets at least one of the unlocking conditions, the virtual plant style corresponding to the unlocking condition switches from a locked state to an unlocked state, and the user can apply it to the playback interface, thereby gradually building the user's personalized virtual garden.

[0151] In some embodiments, the system provides the following playback scene construction modes: default template one-click application mode, user manual parameter customization mode (background, hue, layout, particle intensity are adjustable), and AI keyword intelligent generation scene mode.

[0152] In some embodiments, a one-click application mode using a default template is available. Specifically, the system provides one or more pre-set complete garden scene templates (such as "Spring Garden", "Starry Sky Garden", "Underwater Garden", etc.), which users can apply directly with just one click without any manual adjustments.

[0153] In some embodiments, a user-customizable parameter mode is available. Specifically, the system provides a visual parameter editor that allows users to manually adjust various visual parameters of the playback scene to meet personalized needs. Optionally, users can adjust parameters such as the scene's background, color tone, layout, and particle intensity.

[0154] In some embodiments, scene patterns can be intelligently generated using AI keywords. Specifically, the server receives keywords of a song input by the user; based on the keywords, scene materials are generated using an AI model, and these scene materials are used to generate the scene corresponding to the song.

[0155] For example, the server deploys an AI model (such as a lightweight 8-bit integer (INT8) quantization stable diffusion model). This model receives text keywords input by the user (e.g., "magic forest") and, combined with the player's scene constraints (e.g., interface size, color tone limitations), generates adapted garden scene materials. Subsequently, the front end (e.g., the terminal device) uses a super-resolution algorithm to perform image quality restoration on the materials. Furthermore, the system establishes a local caching mechanism for commonly used scene parameters. When the same scene is loaded a second time, it can be read directly from the local cache without triggering cloud inference, thereby reducing response latency.

[0156] Accordingly, this application simultaneously supports the construction and rendering of playback scenes in three modes: fast loading of default template resources, real-time refreshing and rendering of user-defined parameters, and parsing and rendering of scene resources generated through AI inference. The component allows users to preview in real time when switching modes or adjusting parameters, and allows for secondary fine-tuning.

[0157] In the embodiments of this application, by providing multiple playback scene construction modes, it can fully adapt to users' personalized visual needs. Combining the advantages of template reuse, user customization, and AI generation technologies, it solves the technical defects of traditional player scene construction methods being singular and lacking personalization, thereby greatly improving the visual flexibility and user controllability of the playback interface.

[0158] Furthermore, social interactions such as friend interactions, mutual watering assistance, and mutual likes can accelerate the growth of virtual plants and enrich the garden scene.

[0159] For example, the playback interface or application homepage of the terminal device has an entry control for "Close Friends Garden". In response to the user's triggering of the control, the terminal device displays the main interface of Close Friends Garden. Alternatively, through... Figure 4 The garden control 410 shown can also directly access the "Close Friends Garden" interface.

[0160] Optionally, the Close Friends Garden homepage includes one or more of the following social interaction elements: Social Relationship Building Unit: The interface can display interactive controls such as "Connect with others to grow flowers together" or "Invite friends." By triggering these controls, users can invite other users to establish social connections and participate together in the virtual plant cultivation process.

[0161] Social Behavior-Driven Growth Unit: The interface can display growth values ​​calculated based on interactions between friends. For example, in response to a user and a friend performing a collaborative playback action such as "listening to the same song together" or "listening to the same playlist together," the system adds a preset number of growth values ​​to the user (e.g., "+10 growth" or "+20 growth"). These growth values ​​are used to drive the iteration of the virtual plant's growth level.

[0162] Social Leaderboard Unit: The interface can also display a "Close Friends Garden Leaderboard," which is ranked based on the growth value or interaction count of users and their friends (e.g., "User 1's Garden" is ranked 1st). By displaying the leaderboard, users are encouraged to improve their ranking by increasing social interaction, thereby indirectly accelerating the growth of virtual plants.

[0163] Indirect growth representation units: such as Figure 4 As shown, the differences in plant morphology levels resulting from the accumulation of growth values ​​driven by social behavior are visually demonstrated through virtual plants of different sizes (such as roses). The growth values ​​generated by social behavior and those generated by the user's independent local music listening behavior are added together, jointly affecting the morphological iteration of the virtual plants. Optionally, the Close Friends Garden main page may also include other social interaction elements, which are not limited in this application.

[0164] In some embodiments, the system supports users sending virtual bouquets to other users (such as celebrities or friends). Sending flowers has social dissemination attributes, which can expand the ways users interact and enhance the application's dissemination capabilities by satisfying users' (especially fans') desire to share.

[0165] In the embodiments of this application, the above-mentioned social linkage cultivation logic expands the single individual cultivation behavior into a group collaborative growth model based on social relationships, thereby expanding the technical boundaries of the plant cultivation system of this application.

[0166] For example, by blending the AI-generated garden scene with the user's real environment and dynamically adjusting the scene's brightness and texture using an ambient light sensor, the integration of virtual and real scenes can be enhanced.

[0167] For example, a user activates the AR Garden mode in their bedroom at night. The terminal device uses a camera to capture real-world environmental elements such as dim lighting, a desk, and a bed. Simultaneously, the terminal device's ambient light sensor detects the current ambient light data. For instance, it detects an ambient brightness value of 15 lux and a color temperature value of 3000K. Responding to this lighting data, the system generates a corresponding virtual garden scene based on an AI model. For example, it generates a garden scene themed "Firefly Forest": based on the ambient brightness and color temperature data, the system automatically adjusts the garden scene's brightness value to 60% of the default value and automatically changes the color tone from the default cool blue to a warm yellow, blending it with the dim, warm light of the real environment.

[0168] Furthermore, the system adaptively adjusts in real time when ambient lighting conditions change. For example, when a user turns on a cool white desk lamp, the ambient brightness changes to a secondary brightness (e.g., 80 lux), and the color temperature changes to a secondary color temperature (e.g., 5000K). Responding to the updated lighting data, the system adjusts the rendering parameters in the virtual garden scene in real time. For example, it automatically increases the scene's brightness to 90% of the default value and automatically switches the hue to neutral white. Therefore, when a user plays a song, they can see AI-generated virtual plants (e.g., plants emitting a warm yellow glow) seemingly "growing" on a dimly lit desk in the playback interface of their terminal device. The changes in the virtual plants' lighting and shadows naturally and in real-time adjust to changes in the real-world lighting, thereby enhancing the integration and immersion between the virtual scene and the real environment.

[0169] In some embodiments, the system establishes an intelligent scene recommendation algorithm. This algorithm combines season, weather, the genre of the currently playing song, and the user's historical usage habits to automatically match the optimal garden template, achieving fully automatic and seamless scene adaptation. The intelligent scene recommendation algorithm is an algorithm that automatically matches the optimal garden scene template for the user based on multi-dimensional contextual information (season, weather, etc.), achieving "fully automatic and seamless" scene adaptation without requiring manual selection by the user.

[0170] In some embodiments, the system employs a hybrid architecture combining local priority and incremental synchronization. Specifically, all user growth data and custom parameters are first written to the local database (such as SQLite) on the terminal. When the network connection is normal, the system asynchronously synchronizes local incremental data to the cloud server; when the network is disconnected, the system fully caches all operation data locally. When the network connection is restored, the system automatically merges and resolves conflicts according to the timestamp priority of the data, thereby ensuring that user data is not lost or disordered.

[0171] In some embodiments, the system uses encryption algorithms (such as Advanced Encryption Standard with 256-bit key, AES-256) to transmit and store all user behavior data and playback data. User privacy data is anonymized before being synchronized to the cloud. The anonymized data is used only for local function rendering on the terminal and iterative optimization of the backend model, and does not disclose users' personal information.

[0172] In the embodiments of this application, by means of data synchronization and privacy encryption mechanisms, data integrity and consistency can be synchronized across terminals and across network environments while ensuring the privacy and security of user data. This provides a stable, reliable and secure data foundation for the daily cultivation and personalized configuration of virtual plants, while meeting the technical requirements of users for data autonomy and privacy protection.

[0173] In some embodiments, the embodiments of this application can run on mobile terminal devices that meet the minimum hardware configuration requirements (such as Apple Operating System (iOS) 13.0 and above, and Android system 9.0 and above). The terminal device must support multi-touch signal acquisition, GPU hardware-accelerated rendering, local data caching, and bidirectional communication with a server. To ensure high frame rate rendering of the particle system and the stability of the background AI inference module on the front end, the terminal device should have at least 3GB of RAM; this application does not impose a limitation on this.

[0174] In this embodiment, different virtual plants can be displayed based on the semantic theme of the song being played, thereby intuitively conveying the emotions and artistic conception of the song. Furthermore, during song playback, the motion or display effects of the virtual plants will change accordingly with the musical characteristics of the song, enhancing the linkage between the song content and visual elements (such as virtual plants). Additionally, corresponding feedback animations can be displayed for interactive operations, enhancing engagement and user participation.

[0175] The following are embodiments of the apparatus described in this application, which can be used to execute the embodiments of the method described in this application. For details not disclosed in the apparatus embodiments of this application, please refer to the embodiments of the method described in this application.

[0176] Please refer to Figure 6 This diagram illustrates a block diagram of a song playback device according to an embodiment of this application. The device has the functions described above, which can be implemented in hardware or by hardware executing corresponding software. The device can be the terminal device 10 described above, or it can be integrated within the terminal device 10. Figure 6 As shown, the device 600 may include an interface display module 610, an effect adjustment module 620, and a motion effect display module 630.

[0177] The interface display module 610 is used to display virtual plants that match the semantic theme of the song in the song playback interface.

[0178] The effect adjustment module 620 is used to dynamically adjust the motion effect and / or display effect of the virtual plant as the musical characteristics of the song change during the playback of the song.

[0179] The motion effect display module 630 is used to respond to interactive operations on the virtual plant and display feedback motion effects corresponding to the interactive operations generated by the virtual plant.

[0180] In some embodiments, the motion effect display module 630 is further configured to, in response to an interactive operation on the virtual plant, determine the part of the virtual plant that produces a feedback motion effect; and display the feedback motion effect corresponding to the part, with different parts corresponding to different feedback motion effects.

[0181] In some embodiments, the motion effect display module 630 is further configured to, when the interactive operation is a touch operation, determine the touch area of ​​the touch operation based on the coordinate information of the touch operation; determine the part of the virtual plant that generates feedback motion effects based on the touch area; or, when the interactive operation is a voice operation, determine the part of the virtual plant that generates feedback motion effects based on the voice command corresponding to the voice operation; or, when the interactive operation is a device posture adjustment operation, determine the part of the virtual plant that generates feedback motion effects based on the tilt direction of the device posture adjustment operation.

[0182] In some embodiments, the effect adjustment module 620 is further configured to switch the swaying frequency of the virtual plant from the first frequency to the second frequency when the rhythm of the song changes from the first rhythm to the second rhythm; and / or, when the rhythm of the song changes from the second rhythm to the first rhythm, switch the swaying frequency of the virtual plant from the second frequency to the first frequency; wherein the first rhythm is higher than the second rhythm, and the first frequency is greater than the second frequency.

[0183] In some embodiments, the effect adjustment module 620 is further configured to switch the light and shadow intensity of the virtual plant from a first intensity to a second intensity when the style of the song is switched from a first style to a second style; and / or, when the style of the song is switched from a second style to a first style, switch the light and shadow intensity of the virtual plant from a second intensity to a first intensity; wherein the first style is different from the second style, and the first intensity is different from the second intensity.

[0184] In some embodiments, the device further includes a level switching module 640, which controls the virtual plant to switch from a first growth level to a second growth level when the growth value of the virtual plant meets a preset condition; wherein the form of the virtual plant corresponding to the first growth level is different from the form of the virtual plant corresponding to the second growth level.

[0185] In some embodiments, the interface display module 610 is further configured to display virtual plants in the playback interface of the song in particle form that match the semantic theme of the song; wherein the virtual plants are composed of multiple particles.

[0186] In some embodiments, the interface display module 610 is further configured to determine the number of particles of the virtual plant based on the performance of the terminal device; obtain the particle parameters of the virtual plant from the plant particle resource library; wherein the particle parameters include the particle distribution topology, deformation parameters and oscillation physical parameters of the virtual plant; and render and generate the virtual plant with the particle shape based on the number of particles and the particle parameters.

[0187] In some embodiments, the apparatus further includes a plant generation module 650, configured to semantically encode the song to obtain the semantic theme of the song; obtain virtual plants that match the semantic theme of the song from a theme plant mapping knowledge base, the theme plant mapping knowledge base including the mapping relationship between the semantic theme of the song and the virtual plants; or, using a multimodal large model, generate virtual plants that match the semantic theme of the song based on the semantic theme of the song.

[0188] In some embodiments, the interface display module 610 is further configured to display a virtual garden in the playback interface of the song that matches the semantic theme of the song, the virtual garden including a plurality of the virtual plants.

[0189] It should be noted that the apparatus provided in the above embodiments is only illustrated by the division of the above functional modules when implementing its functions. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the content structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process can be found in the method embodiments, which will not be repeated here.

[0190] Please refer to Figure 7 This diagram illustrates a structural block diagram of a computer device 700 provided in one embodiment of this application. The computer device 700 is used to implement the song playback method provided in the above embodiment. The computer device may be... Figure 1 The terminal device 10 in the implementation environment of the scheme shown. Specifically: Typically, computer device 700 includes a processor 710 and a memory 720.

[0191] Processor 710 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. Processor 710 may be implemented using at least one hardware form selected from DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). Processor 710 may also include a main processor and a coprocessor. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, processor 710 may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, processor 710 may also include an AI processor for handling computational operations related to machine learning.

[0192] The memory 720 may include one or more computer-readable storage media, which may be non-transitory. The memory 720 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory 720 is used to store a computer program configured to be executed by one or more processors to implement the above-described song playback method.

[0193] Those skilled in the art will understand that Figure 7 The structure shown does not constitute a limitation on the computer device 700, and may include more or fewer components than shown, or combine certain components, or use different component arrangements.

[0194] This application also provides a computer-readable storage medium storing a computer program for being called and executed by a processor to implement the above-described song playback method. In some embodiments, the computer-readable storage medium may include ROM (Read-Only Memory), RAM (Random-Access Memory), SSD (Solid State Drives), or optical disc, etc. The random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0195] This application also provides a computer program product, which includes computer instructions that are executed by a processor to implement the above-described song playback method.

[0196] It should be noted that the collection and processing of relevant data (such as lyrics) in this application should strictly comply with the requirements of relevant national laws and regulations, obtain the informed consent or separate consent of the personal information subject, and carry out subsequent data use and processing within the scope of laws and regulations and the authorization of the personal information subject.

[0197] It should be understood that "multiple" as used herein refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. Furthermore, the step numbers described herein are merely illustrative of one possible execution order. In some other embodiments, the steps may not be executed in numerical order, such as two steps with different numbers being executed simultaneously, or two steps with different numbers being executed in the reverse order of the illustration. This application does not limit this.

[0198] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method for playing songs, characterized in that, The method includes: The song's playback interface displays virtual plants that match the song's semantic theme; During the playback of the song, the motion effects and / or display effects of the virtual plants are dynamically adjusted according to the changes in the musical characteristics of the song; In response to interactive actions performed on the virtual plant, a feedback animation corresponding to the interactive action generated by the virtual plant is displayed.

2. The method according to claim 1, characterized in that, The response to an interactive operation on the virtual plant, displaying feedback animations corresponding to the interactive operation generated by the virtual plant, includes: In response to interactive operations on the virtual plant, determine the part of the virtual plant that produces a feedback animation; The display shows the feedback animation corresponding to the part, with different parts corresponding to different feedback animations.

3. The method according to claim 2, characterized in that, The method of determining the part of the virtual plant that generates a feedback animation in response to an interactive operation on the virtual plant includes: When the interactive operation is a touch operation, the touch area is determined based on the coordinate information of the touch operation; based on the touch area, the part of the virtual plant that generates the feedback animation effect is determined; or, When the interactive operation is a voice operation, the part of the virtual plant that produces the feedback animation is determined based on the voice command corresponding to the voice operation; or, When the interactive operation is a device posture adjustment operation, the part of the virtual plant that produces the feedback animation is determined based on the tilt direction of the device posture adjustment operation.

4. The method according to any one of claims 1 to 3, characterized in that, The dynamic adjustment of the virtual plant's motion effects in accordance with changes in the musical characteristics of the song includes: When the rhythm of the song changes from a first rhythm to a second rhythm, the swaying frequency of the virtual plant is changed from a first frequency to a second frequency; and / or, When the rhythm of the song changes from the second rhythm to the first rhythm, the swaying frequency of the virtual plant is changed from the second frequency to the first frequency. Wherein, the first rhythm is higher than the second rhythm, and the first frequency is greater than the second frequency.

5. The method according to any one of claims 1 to 4, characterized in that, The method of dynamically adjusting the display effect of the virtual plant in accordance with the changes in the musical characteristics of the song includes: When the song's style changes from the first style to the second style, the light and shadow intensity of the virtual plant is switched from the first intensity to the second intensity; and / or, When the style of the song is switched from the second style to the first style, the light and shadow intensity of the virtual plant is switched from the second intensity to the first intensity. The first musical style is different from the second musical style, and the first intensity is different from the second intensity.

6. The method according to any one of claims 1 to 5, characterized in that, The method further includes: When the growth value of the virtual plant meets the preset conditions, the virtual plant is controlled to switch from the first growth level to the second growth level. The form of the virtual plant corresponding to the first growth level is different from the form of the virtual plant corresponding to the second growth level.

7. The method according to any one of claims 1 to 6, characterized in that, The provision that virtual plants matching the semantic theme of the song are displayed in the song's playback interface includes: In the playback interface of the song, virtual plants that match the semantic theme of the song are displayed in particle form; wherein, the virtual plants are composed of multiple particles.

8. The method according to claim 7, characterized in that, The method further includes: The number of particles in the virtual plant is determined based on the performance of the terminal device. The particle parameters of the virtual plant are obtained from the plant particle resource library; wherein, the particle parameters include the particle distribution topology, deformation parameters, and oscillation physical parameters of the virtual plant. Based on the number of particles and the particle parameters, the virtual plant with the particle shape is rendered and generated.

9. The method according to any one of claims 1 to 8, characterized in that, The method further includes: The song is semantically encoded to obtain its semantic theme; From a thematic plant mapping knowledge base, obtain virtual plants that match the semantic theme of the song; the thematic plant mapping knowledge base includes the mapping relationship between the semantic theme of the song and the virtual plants; or, Using a multimodal large model, virtual plants that match the semantic theme of the song are generated.

10. The method according to any one of claims 1 to 9, characterized in that, The method further includes: The playback interface of the song displays a virtual garden that matches the semantic theme of the song, and the virtual garden includes multiple virtual plants.

11. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing a computer program that is invoked and executed by the processor to enable the computer device to implement the song playback method as described in any one of claims 1 to 10.

12. A computer-readable storage medium storing a computer program for being invoked and executed by a processor to implement the song playback method as described in any one of claims 1 to 10.

13. A computer program product comprising computer instructions that are executed by a processor to implement the song playback method as described in any one of claims 1 to 10.

Images