Multimedia device display method and system

Abstract

A multimedia device display method and system. The method comprises: acquiring an operation instruction for a multimedia device, matching the operation instruction and a preset behavior library, if the matching is successful, calling preset response information associated with an audio file, and if the matching fails, repeatedly acquiring an operation instruction or an alarm prompt for the multimedia device; and loading the audio file on the basis of the preset response information, if the audio file has been loaded, calling a pre-loaded special effect in the preset response information and displaying same, and if the audio file has not been loaded, displaying a standby picture. In the present invention, by receiving and identifying an audio file, sound is associated with a real picture, and the synchronous change of the sound and the picture can be realized, thereby realizing consistency and rhythm in visual expression and improving the audio-visual experience of users.

Description

A multimedia device display method and system

[0001] This application claims priority to Chinese Patent Application No. 202410501120.3, filed on April 24, 2024, entitled "A Multimedia Device Display Method and System", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This invention relates to the field of multimedia control technology, and more specifically, to a multimedia device display method and system. Background Technology

[0003] Users typically choose traditional speakers for audio playback or smart speakers for interactive audio control. However, with the development of smart devices, simply conveying information through sound is no longer sufficient to meet the public's entertainment needs. Users expect more personalized services and increasingly value visual effects. While some speakers can display lyrics or have visual screens that change with the rhythm, their display effects are often rather simplistic, failing to demonstrate the connection between sound and visuals and thus failing to provide users with an immersive music experience.

[0004] Summary of the Invention

[0005] In view of this, the present invention provides a multimedia device display method and system to solve the above problems.

[0006] To address the above technical problems, the present invention provides a multimedia device display method, comprising:

[0007] Obtain operation commands for multimedia devices and match them with a preset behavior library. If the match is successful, call the preset response information associated with the audio file; if the match fails, repeatedly obtain operation commands or alarm prompts for multimedia devices.

[0008] The audio file is loaded based on the preset response information. If the audio file has been loaded, the pre-loaded effects in the preset response information are invoked and displayed; if the audio file has not been loaded, the standby screen is displayed.

[0009] As an optional approach, the preset behavior library includes: several preset operation instructions, each of which is independently loaded with a preset operation category and a preset operation object;

[0010] The operation instructions for multimedia devices are loaded with the target operation category and the target operation object.

[0011] As an optional method, matching includes:

[0012] Receive the target operation instruction for the audio file, and obtain the target operation category and target operation object:

[0013] When the target operation category matches the preset operation category, the operation object is matched. If the target operation object matches the preset operation object, the preset response information associated with the audio file is invoked. If the target object fails to match the preset operation object, the operation instructions for the audio file are requested again or an alarm is displayed.

[0014] As an optional method, matching includes:

[0015] If the target operation category fails to match the preset operation category, request to retrieve the operation instructions for the audio file again or display an alarm.

[0016] As an optional approach, the preset methods for generating response information include:

[0017] Lyrics and melody data are extracted from the metadata location of the audio file. Lyrics data includes characters, number of characters, and character time features, while melody data includes melody spectrum and melody type.

[0018] The lyrics data and melody data are bound to a matching lyrics effect file to form the first effect;

[0019] The melody data is bound to background effects according to the melody type to create a second effect;

[0020] Bind the first and second special effects to generate preset response information.

[0021] As an optional method, the first special effect can be achieved by:

[0022] Obtain the duration of a single character in the audio file; divide the duration of a single character into intervals; perform effect matching based on the segmentation results; bind the matched lyric effects to the lyric data to obtain the first effect.

[0023] As an optional method, effects matching includes:

[0024] Based on the interval segmentation results based on the duration of a single character and the rhythm recognition based on the melody spectrum, any audio file is anchored so that any audio file has multiple anchor tags at its corresponding melody position and / or character position, and special effects are matched based on the positional relationship of the anchor tags.

[0025] As an optional approach, effects matching is based on the positional relationship of anchor tags, including:

[0026] Based on the density of multiple anchor tags and the interval segmentation results of the duration of a single character, effects are matched for the duration of audio files between two adjacent anchor tags, so that any audio file has multiple effects matched on its playback duration axis.

[0027] As an optional method, effects preloaded in the preset response information can be invoked, including:

[0028] Add the effects from the preset information to the effects sequence, and add the audio file to the audio sequence;

[0029] Verify the correspondence between the effect sequence and the audio sequence. If there is a misalignment, regenerate the preset response information. If there is no misalignment, based on the correspondence between the effect sequence and the audio sequence, simultaneously call the preset response information and audio file of the same sequence and add them to the playback queue.

[0030] As an optional method, the display includes:

[0031] After loading the audio file based on one or more preset response information, save one or more preset response information to the playback queue, check whether to use quick effects, and check the queue length based on the effect relationship between any audio file in the playback queue and its next audio file to determine the transition effect.

[0032] Based on the order of the playback queue, the target lyrics to be changed are bound to the corresponding effects for display, and the audio file is played.

[0033] As an optional method, check whether quick effects are used, including:

[0034] Retrieve the duration value of a single character in the audio file and check if it exceeds a preset threshold;

[0035] If it exists, then the endpoint position of the playback duration where the number of characters exceeds the preset threshold within the preset display time will be anchored again, and the fast effects will be rematched.

[0036] As an optional method, secondary anchoring includes:

[0037] Establish the density relationship between characters and time based on the preset display time;

[0038] Traverse the lyrics data along the timeline and mark anchor points at the two endpoints of the interval with the highest density relationship value.

[0039] As an optional approach, in the playback queue, preset response information that is not in the first or second order is processed using an asynchronous thread; and when switching audio files during playback, for audio files that have not finished playing, a transition effect is inserted to convert them after receiving the operation instruction; the start point of the transition effect is located at the breakpoint of the previous song, and the end point is located at the first anchor tag of the next song.

[0040] As an optional method, displaying the target lyrics to be changed overlaid on the corresponding special effects and playing the audio file also includes:

[0041] Anchor tags for receiving audio files;

[0042] After receiving the anchor tag of the audio file, the audio file is loaded and signal feedback is performed. The first reception time and the first transmission time of this feedback are recorded. After loading is completed, the next anchor tag of the audio file is read in the time axis direction, and the second reception time and the second feedback time are recorded again.

[0043] The second receiving time, the second feedback time, and the preset duration of the special effect are matched at the endpoints to determine the playback time of the next special effect data.

[0044] On the other hand, the present invention also provides a multimedia device display system for performing the above-described multimedia device display method, which, as an optional embodiment, includes:

[0045] Multimedia devices are used to receive user-driven audio files and display video feeds.

[0046] The interaction module is used to establish connections with the user's operations and signals;

[0047] The storage module is used to store preset behavior libraries, music libraries, and special effects material libraries;

[0048] The matching module is used for matching special effects and playback.

[0049] The control module is used to control the display elements of the multimedia device during playback, enabling dynamic changes in the image.

[0050] The beneficial effects of this invention are as follows:

[0051] This invention receives and recognizes audio files to associate sound with real-world images, enabling synchronized changes in sound and image, resulting in visual consistency and rhythm, and improving the user's audiovisual experience. Attached Figure Description

[0052] Figure 1 is a schematic flowchart of a multimedia device display method provided in an embodiment of the present invention;

[0053] Figure 2 is a schematic diagram of the structure of the multimedia device display system provided in an embodiment of the present invention;

[0054] Figure 3 is a schematic diagram of the operation instruction matching process provided in an embodiment of the present invention;

[0055] Figure 4 is a schematic diagram of the lyrics effect matching process provided in an embodiment of the present invention;

[0056] Figure 5 is a schematic diagram of the matching process between special effects sequences and audio sequences in the playback queue provided in an embodiment of the present invention. Detailed Implementation

[0057] To enable those skilled in the art to better understand the technical solution of the present invention, the present invention will be further described in detail below with reference to specific embodiments.

[0058] Users typically choose traditional speakers for audio playback or smart speakers for interactive audio control. With the development of smart devices, simply conveying information through sound is no longer sufficient to meet the public's entertainment needs. Users also expect more personalized services and increasingly value the visual effects of products. While some speakers can display lyrics or have visual screens that change with the rhythm, their display effects are often rather simple, failing to demonstrate the connection between sound and image, and thus insufficient to provide users with an immersive music experience. This embodiment adds special effects to the lyrics on the screen to achieve dynamic display, serving as an audiovisual element that combines sound and image to enhance the speaker's appeal and improve user immersion and entertainment experience.

[0059] Please refer to Figure 1. This embodiment provides a multimedia device display method. The multimedia device in this embodiment is a speaker equipped with a display screen. The method includes: acquiring operation commands for the multimedia device and matching them with a preset behavior library; if the match is successful, calling preset response information associated with an audio file; if the match fails, repeatedly acquiring operation commands or alarm prompts for the multimedia device; loading an audio file based on the preset response information; if the audio file is already loaded, calling and displaying pre-loaded effects from the preset response information; if the audio file is not loaded, displaying a standby screen.

[0060] Implementing the above solution in an optional scenario, display control is achieved as follows:

[0061] The multimedia device (a speaker with a screen) first turns on its screen and displays a standby image after powering on. Once the user selects an audio operation command through the client, the multimedia device matches and verifies this command against preset user behavior. If the verification confirms that the user is performing an audio and / or video operation, the audio and video are associated. This association involves applying effects to the lyrics and / or melody of the audio file in preparation for display on the screen. After association, corresponding association data is generated and loaded. Once loaded, according to the transition rules added in advance by the developer, the target lyrics to be changed are bound to the corresponding effects for display, updating the standby screen. This causes the multimedia device's display to gradually transform into a dynamic visual that reflects the rhythm, style, length, and type of the user-selected audio file, providing the user with an immersive audiovisual experience.

[0062] In the above scheme, in response to the acquired audio file operation instructions, the operation instructions are matched with a preset behavior library, including:

[0063] A preset behavior library stores several preset operation commands that can be received, recognized, and executed. Each preset operation command independently loads a preset operation category and a preset operation object. The received operation command is matched against the operation commands in the preset behavior library. The preset behavior library refers to the restrictions placed on the interaction methods between users and multimedia devices by developers or manufacturers when producing multimedia devices or developing client applications (mini-programs, apps, remote controls, etc.) to support them. When a user's interaction command is detected to match a specified command, the program is executed according to the corresponding rules.

[0064] The purpose of the above matching is to make the response of multimedia devices more intelligent and accurate, avoiding unwarranted responses that affect the playback and display of audio and video. Referring to Figure 3, the process involves receiving the user's operation command and reading the operation category and operation object from that command. If the operation category is successfully identified, operation object matching is performed. If the operation object matches successfully, the operation command is executed. If the operation category is successfully identified, operation object matching is performed; if the operation object matching fails, no response is given. If the operation category is not identified, operation object matching is not performed. If the target object fails to match the preset operation object, a request is made to re-acquire the operation command for the audio file, or an alarm is displayed. The alarm display can be a window prompting the user to perform the correct operation or to try again. This embodiment does not limit the alarm display.

[0065] The operation category refers to the user-selected project behavior, and the operation object refers to the user-selected project goal. Considering actual human-computer interaction scenarios, selectable operation categories include: wireless connection operations (such as Bluetooth, Wi-Fi, etc.), device selection operations (using a client to request a connection with a multimedia device), and music selection operations (selecting a song to play); selectable operation objects include: audio files, styles, effects, and backgrounds. This embodiment does not limit the above categories and / or objects, and can be developed and selected according to the implementation purpose. Additionally, the multimedia device can be used as an electronic photo album or frame for static image display, or audio file selection can be omitted, and a white noise mode can be enabled to allow the image to accompany the scene's decibel level and weather conditions.

[0066] To achieve the aforementioned audio-visual association effect, in this embodiment, the preset response information includes: an audio file and a special effect associated with that audio file. The audio file in this embodiment is pre-stored in a music library and accessed by multimedia devices. The audio file is not modified. The audio file type can be common audio formats such as mp3 or flv, or a type agreed upon with the music library service provider. This embodiment does not modify the song copyright. The special effects are pre-developed or downloaded and exist in a material library. This embodiment does not specify the type or style of the special effects; its primary purpose is to provide a method for associating audio and special effects. Specifically, this embodiment is implemented as follows:

[0067] First, a connection is established with the metadata location. The metadata location refers to the virtual service address of a music library and / or a database that matches the processor of a multimedia device. It stores multiple data types of audio files, which may include melody data, lyrics data, basic audio parameters, and other data.

[0068] Retrieve preset response information associated with audio file operations, including: extracting lyrics and melody data from the metadata location of the audio file; lyrics data includes characters, number of characters, and character time features (e.g., character duration based on LRC files). Melody data includes: melody spectrum and melody type.

[0069] The lyrics data and melody data are bound to the matching lyrics effect file to form the first effect; the melody data is bound to the background effect according to the melody type to form the second effect; the first and second effects are bound together to generate the preset response information.

[0070] The binding process described above can be implemented through a special effects module. This module is an application developed to work with multimedia devices. After recognizing the melody and lyrics data, it calls special effects according to corresponding policy rules to associate the audio file data. The effect is that both the lyrics and the song are accompanied by corresponding special effects. The first special effect mentioned above is the lyrics effect, and the second effect is the song effect.

[0071] The aforementioned "melody type" refers to the tags defined by the creator, service provider, or user for the song itself. Examples include common song categories or moods found in the music library, such as fast song, slow song, pop, traditional Chinese style, R&B, rap, jazz, upbeat, and ballad. During matching, these tags are read, and effects are matched according to a preset "melody type - background" approach. For example, a song tagged as a slow song might have background effects like a tranquil forest or a beach in a gentle breeze; a song tagged as rock would have background effects like metal or punk, indicating a fast-paced style. During playback, the song effects form the base, and the lyrics are displayed along with corresponding effects based on the lyrics display rules, achieving a synchronized audio-visual experience with related content.

[0072] Using the above method, song effects can be matched by default based on the melody type, or new corresponding material libraries can be retrieved based on the melody type customized by the user after use to match the effects.

[0073] In this embodiment, the lyrics effects are obtained by recognizing the lyrics text. The lyrics effects refer to the rendering of the lyrics on the screen based on the matching relationship between the data volume and the effects after reading the text from the audio file. Operations such as coloring, enlarging, blurring, filling, or covering are applied to the lyrics display. Different effects are assigned to different paragraphs and parts of the lyrics text according to corresponding rules to enhance the visual experience for the user. The song effects are background effects on the multimedia device's display screen, matched by melody type, and used as the underlying layer for displaying the lyrics effects.

[0074] Specifically, referring to Figure 4, this embodiment, when selecting lyric effects, extracts the number of characters in the lyric data and the duration of the melody spectrum to obtain the duration of a single character in the audio file. Then, it segments the duration of each single character into intervals and performs effect matching based on the segmentation results. That is, it first obtains the duration of the lyrics, the length of the lyrics, the letter ratio of the lyric blocks, the punctuation marks, and the average interval time between multiple lines of lyrics by splitting the lyrics into word or single-word queues to select the effect with the best visual experience. As an optional method, when recognizing the lyric data of an audio file:

[0075] If the system detects that 5 or fewer characters need to be displayed within a unit of time, it is considered short lyrics and a short effect is matched accordingly; if 5-20 characters need to be displayed within a unit of time, it is considered medium lyrics and a medium effect is matched accordingly; if 20-50 characters need to be displayed within a unit of time, it is considered long lyrics and a long effect is matched accordingly; if more than 50 characters need to be displayed within a unit of time, it is considered very long lyrics and a very long / fast effect is matched accordingly. This gives the displayed lyrics text dynamic visual effects such as changes in transparency, texture, position, and color.

[0076] In this embodiment, the effect matching method is as follows: based on the interval segmentation result of the duration of a single character and the rhythm recognition based on the melody spectrum, any audio file is anchored, so that any audio file has multiple anchor tags at its melody position and / or character position; according to the density of anchor tags and the interval segmentation result of the duration of a single character, the duration of the audio file between two adjacent anchor tags is matched with effects, so that any audio file has multiple effects on its playback duration axis.

[0077] It is understandable that a song contains intro, verse, chorus, and bridge sections. In some optional cases, this embodiment marks the start and end points of these different sections to facilitate effect matching. For example, if there are no lyrics in the intro, a smooth effect is used; as the lyrics begin to appear, the background effect changes, and an effect following the lyrics also appears. The above anchor tag marking logic is based on rhythm and changes in song sections. Alternatively, considering that some songs have a fast tempo and require displaying too many characters per unit time, this embodiment also marks characters based on anchor tags to adapt to fast effects per unit time for songs with a large amount of text, achieving a better visual effect. This includes checking whether fast effects are needed, including:

[0078] For audio files where the duration of a single character exceeds a preset threshold, special effects are applied. The endpoints of the playback duration where the number of characters exceeds the preset threshold within a preset display time are anchored again, and fast effects are re-matched. The secondary anchoring refers to establishing a density relationship between characters and time based on the preset display time, traversing the lyrics data along the time axis, marking anchor points at the two endpoints of the interval with the highest density relationship value, and filling the interval with fast effects.

[0079] In this process, establishing the density relationship between characters and time involves creating a coordinate axis with playback time as the horizontal axis and lyrics density as the vertical axis, marking unit intervals on the horizontal axis. Each unit interval represents the duration of a preset frame. Lyrics data within this unit interval is read using LRC format and / or other preset formats. The quantitative relationship between the unit interval and the number of characters in the lyrics data is obtained, resulting in a unit area on the coordinate axis that correlates the horizontal and vertical axes. This unit area changes according to the number of characters. The unit interval is moved along the horizontal axis at preset step sizes, and the change in unit area is recorded after each movement. This continues until either endpoint of the unit interval reaches the playback time endpoint on the horizontal axis. Unit intervals with a preset unit area greater than a preset area are selected, indicating that these intervals contain a large amount of lyrics text and require rapid special effects display. Anchor labels are marked at both endpoints of these intervals for rapid special effects adaptation.

[0080] After obtaining the preset response information using the above method, as shown in Figure 5, this embodiment adds the special effects from the preset response information to the special effects sequence and the audio file to the audio sequence, forming two information buffers. The correspondence between the special effects sequence and the audio sequence is verified. If a misalignment exists, the preset response information is regenerated; if no misalignment exists, the preset response information and audio file of the same sequence are simultaneously called and added to the playback queue according to the correspondence between the special effects sequence and the audio sequence. This achieves audio-visual synchronization.

[0081] In the specific playback process, the multimedia device loads audio files based on one or more preset response messages, saves one or more preset response messages to the playback queue, and checks the queue length based on the effect relationship between any audio file in the playback queue and the next audio file to determine the transition effect. The transition effect can refer to a transition effect, which connects the song effects and lyrics effects of the previous song, and the song effects and lyrics effects of the next song, respectively. Optional transition methods include fade-in, fly-out, and gradual transition. Furthermore, in the playback queue, preset response messages that are not in the first or second order are processed asynchronously to save core processor resources. When switching audio files during playback, for audio files that have not finished playing, a transition effect is inserted for conversion after receiving an operation command. The start point of the transition effect is located at the breakpoint of the previous song, and the end point is located at the first anchor tag of the next song.

[0082] After completing the above effects matching and playback queue preparation, when the multimedia device plays the audio file, it first receives the anchor tag of the audio file; after receiving the anchor tag, it starts loading the audio file and sends signal feedback, recording the first reception time and the first transmission time of this feedback; after loading is completed, it reads the next anchor tag of the audio file according to the timeline direction, and records the second reception time and the second feedback time again; it matches the second reception time, the second feedback time with the preset effect duration to determine the playback time of the next effect data, so as to achieve audio-visual synchronization control and avoid the discontinuity between picture and sound, which would affect the user experience.

[0083] This embodiment receives and recognizes audio files to associate sound with real-world images, enabling synchronized changes in sound and image, resulting in visual consistency and rhythm, and improving the user's audiovisual experience.

[0084] On the other hand, please refer to Figure 2 again. This embodiment also provides a multimedia device display system for executing the above-described multimedia device display method. As an optional approach, it includes: a multimedia device for receiving user-driven audio files and video images; an interaction module for establishing operation and signal connections with the user; a storage module for storing preset behavior libraries, music libraries, and special effects material libraries; a matching module for performing special effects matching and playback matching; and a control module for controlling the display elements of the multimedia device to work during playback, thereby achieving dynamic changes in the image.

[0085] The above are merely preferred embodiments of the present invention. It should be noted that the above preferred embodiments should not be construed as limiting the present invention, and the scope of protection of the present invention should be determined by the scope defined in the claims. Persons skilled in the art will appreciate that improvements and modifications may be made without departing from the spirit and scope of the present invention, and such improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A display method for a multimedia device, characterized in that, include: Obtain operation commands for multimedia devices and match them with a preset behavior library. If the match is successful, call the preset response information associated with the audio file. If the match fails, repeatedly retrieve the operation instructions or alarm prompts for the multimedia device; The audio file is loaded based on the preset response information. If the audio file has been loaded, the pre-loaded special effects in the preset response information are invoked and displayed; if the audio file has not been loaded, a standby screen is displayed.

2. The multimedia device display method according to claim 1, characterized in that, The preset behavior library includes: several preset operation instructions, each preset operation instruction being independently loaded with a preset operation category and a preset operation object; The operation instructions for the multimedia device are loaded with a target operation category and a target operation object.

3. The multimedia device display method according to claim 2, characterized in that, The matching includes: Receive the target operation instruction for the audio file, and obtain the target operation category and target operation object: When the target operation category matches the preset operation category, the operation object is matched. If the target operation object matches the preset operation object, the preset response information associated with the audio file is invoked. If the target object fails to match the preset operation object, a request is made to re-acquire the operation instructions for the audio file or to display an alarm.

4. The multimedia device display method according to claim 2, characterized in that, The matching includes: If the target operation category fails to match the preset operation category, a request is made to re-acquire the operation instructions for the audio file or to display an alarm.

5. A multimedia device display method according to claim 1, characterized in that, The method for generating the preset response information includes: The lyrics data and melody data of the audio file are extracted from the metadata location respectively; the lyrics data includes characters, number of characters, and character time features, and the melody data includes: melody spectrum and melody type; The lyrics data and melody data are bound to a matching lyrics effect file to form the first... Special effects; The melody data is bound to background effects according to melody type to form a second effect; Bind the first effect and the second effect to generate preset response information.

6. A multimedia device display method according to claim 5, characterized in that, The formation of the first special effect includes: The duration of a single character in the audio file is obtained, and the duration of a single character is divided into intervals. Based on the segmentation results, special effects are matched, and the matched lyric special effects are bound to the lyric data to obtain the first special effect.

7. A multimedia device display method according to claim 6, characterized in that, The special effects matching includes: Based on the interval segmentation results based on the duration of a single character and the rhythm recognition based on the melody spectrum, any audio file is anchored, so that any audio file has multiple anchor tags at its corresponding melody position and / or character position, and special effects are matched based on the positional relationship of the anchor tags.

8. A multimedia device display method according to claim 7, characterized in that, Special effects matching based on the positional relationship of the anchor tags includes: Based on the density of the multiple anchor tags and the interval segmentation results of the duration of a single character, the duration of the audio file between two adjacent anchor tags is matched with special effects, so that any audio file has multiple special effects matched on its playback duration axis.

9. A multimedia device display method according to any one of claims 1 to 8, characterized in that, The effects preloaded in the preset response information include: Add the special effects from the preset corresponding information to the special effects sequence, and add the audio file to the audio sequence; Verify the correspondence between the special effects sequence and the audio sequence. If there is a misalignment, regenerate the preset response information. If there is no misalignment, according to the correspondence between the special effects sequence and the audio sequence, simultaneously call the preset response information and audio file of the same sequence and add them to the playback queue.

10. A multimedia device display method according to claim 9, characterized in that, The display includes: After loading the audio file based on one or more preset response messages, save one or more preset response messages to the playback queue, check whether to use fast effects, and check the queue length based on the effect relationship between any audio file in the playback queue and the next audio file. Determine the degree of transition effects; Based on the order of the playback queue, the target lyrics to be changed are bound to the corresponding special effects for display, and the audio file is played.

11. A multimedia device display method according to claim 10, characterized in that, The check to see if quick effects are used includes: Retrieve the duration value of a single character in the audio file and check if it exceeds a preset threshold; If it exists, then the endpoint position of the playback duration where the number of characters exceeds the preset threshold within the preset display time will be anchored again, and the fast effects will be refilled.

12. A multimedia device display method according to claim 11, characterized in that, The secondary anchoring includes: Establish the density relationship between characters and time based on the preset display time; Traverse the lyrics data along the time axis and mark anchor points at the two endpoints of the interval with the highest density relationship value.

13. A multimedia device display method according to claim 9, characterized in that, In the playback queue, preset response information that is not in the first or second order is processed using an asynchronous thread; and when switching audio files during playback, for audio files that have not finished playing, a transition effect is inserted to convert them after receiving the operation instruction; the start point of the transition effect is located at the breakpoint of the previous song, and the end point is located at the first anchor tag of the next song.

14. A multimedia device display method according to claim 9, characterized in that, The process includes overlaying the target lyrics to be changed onto the corresponding special effects for display, playing the audio file, and also includes: Receive the anchor tag of the audio file; After receiving the anchor tag of the audio file, the audio file is loaded and signal feedback is performed. The first reception time and the first transmission time of this feedback are recorded. After loading is completed, the next anchor tag of the audio file is read in the time axis direction, and the second reception time and the second feedback time are recorded again. The second receiving time and the second feedback time are matched with the preset special effect duration to determine the playback time of the next special effect data.

15. A multimedia device display system, used to perform the multimedia device display method as described in any one of claims 1-14, characterized in that, include: Multimedia devices are used to receive user-driven audio files and display video feeds. The interaction module is used to establish connections with the user's operations and signals; The storage module is used to store preset behavior libraries, music libraries, and special effects material libraries; The matching module is used for matching special effects and playback. The control module is used to control the display elements of the multimedia device to operate during playback, thereby enabling dynamic changes in the image.

Images