Audio visualization method, device, projection equipment and storage medium

Abstract

The present disclosure provides an audio visualization method, apparatus, projection equipment and storage medium, including: determining the element group corresponding to the target audio and the display parameters of the background elements in each element group within the target display frame according to the audio information corresponding to the target audio and preset matching conditions; performing clarity processing on the initial rendering image of the background elements according to the display parameters of the background elements within the target display frame to obtain a target rendering image of the background elements; outputting a background image of the target display frame according to the target rendering image of the background elements within the target display frame; and visually displaying the target audio according to the background image of the target display frame. The present disclosure performs clarity processing on the initial rendering image of the background elements according to the display parameters of the background elements, and visually displays the target audio based on the target rendering image obtained by the clarity processing, which can avoid bandwidth pressure caused by data copying during post-processing, increase data processing efficiency, and improve the smoothness of screen display.

Description

Technical Field

[0001] The present disclosure relates to the field of projection technology, and in particular to an audio visualization method, apparatus, projection equipment, and storage medium. Background Art

[0002] With the popularization of the Internet and the rapid popularity of digital audio, users can play a variety of audio data (such as audio novels, songs, etc.) through electronic devices such as mobile phones and tablets. In order to improve the diversity of displayed information during audio data playback, the existing technology extracts the characteristics of audio data and renders the picture based on the characteristics of the audio data. After the picture rendering is completed, the rendered image is post-processed on the screen so that the rendered image has a depth of field effect. However, the existing method of achieving depth of field effects through screen post-processing requires that the rendered image be transmitted back and forth between the GPU (graphics processing unit) and the CPU (central processing unit), resulting in high GPU bandwidth pressure and low picture frame rate. Summary of the Invention

[0003] The technical problem to be solved by the present disclosure is to provide an audio visualization method, device, projection equipment and storage medium in response to the above-mentioned defects of the existing technology, aiming to solve the problem that the existing method of realizing depth of field special effects easily leads to high GPU bandwidth pressure and low picture frame rate.

[0004] The technical solutions adopted by the present disclosure to solve the problem are as follows:

[0005] In a first aspect, an embodiment of the present disclosure provides an audio visualization method, wherein the method includes:

[0006] Determining, based on audio information corresponding to the target audio and a preset matching condition, the element group corresponding to the target audio and first display parameters of the background elements in each element group within the target display frame;

[0007] According to the first display parameter of the background element in the target display frame, performing clarity processing on the initial rendering image of the background element to obtain a target rendering image of the background element;

[0008] outputting a background image of the target display frame according to a target rendering image of background elements within the target display frame;

[0009] The target audio is visually displayed according to the background image of the target display frame.

[0010] Optionally, the audio information includes audio text information, and the step of determining, based on the audio information corresponding to the target audio and a preset matching condition, the element group corresponding to the target audio and the first display parameter of the background element in each element group within the target display frame includes:

[0011] Determine the element group corresponding to the target audio and the animation type and animation duration corresponding to the background element in each element group according to the audio text information corresponding to the target audio and the preset matching conditions;

[0012] According to the animation type and the animation duration, a first display parameter of the background element in each element group in the target display frame is determined.

[0013] Optionally, the initial rendering of the background element is formed by superimposing multiple basic renderings of the background element, among which there are at least two basic renderings with different clarity, and the absolute value of the difference in clarity corresponding to each of the at least two basic renderings with different clarity is greater than a preset threshold.

[0014] Optionally, the step of performing clarity processing on the initial rendering image of the background element according to the first display parameter of the background element in the target display frame to obtain the target rendering image of the background element includes:

[0015] determining, according to a first presentation parameter of the background element in the target display frame, a target transparency value of each of the plurality of base renderings in a target rendering of the background element;

[0016] The transparency values of the multiple basic rendering images in the initial rendering image of the background element are adjusted respectively according to the target transparency value to obtain the target rendering image of the background element.

[0017] Optionally, the step of performing clarity processing on the initial rendering image of the background element according to the first display parameter of the background element in the target display frame to obtain the target rendering image of the background element includes:

[0018] Determining a target Gaussian blur value corresponding to each pixel in an initial rendering of the background element according to a first display parameter of the background element in the target display frame;

[0019] Gaussian blur processing is performed on each pixel in the initial rendering image of the background element according to the target Gaussian blur value to obtain a target rendering image of the background element.

[0020] Optionally, after the step of determining, based on the audio information corresponding to the target audio and the preset matching condition, the element groups corresponding to the target audio and the first display parameters of the background elements in each element group within the target display frame, the step further includes:

[0021] determining a foreground element in the target display frame and a second display parameter of the foreground element in the target display frame according to the audio information and the first display parameter of the background element in the target display frame;

[0022] A foreground image of the target display frame is output according to the foreground element in the target display frame and a second display parameter of the foreground element in the target display frame.

[0023] Optionally, the step of visually displaying the target video according to the background image of the target display frame includes:

[0024] outputting the target display frame according to the background image of the target display frame and the foreground image of the target display frame;

[0025] The target video is visually displayed according to the target display frame.

[0026] In a second aspect, an embodiment of the present disclosure provides an audio visualization device, wherein the device includes:

[0027] a parameter determination module, configured to determine, based on audio information corresponding to the target audio and a preset matching condition, a first display parameter of an element group corresponding to the target audio and a background element in each element group within a target display frame;

[0028] an image processing module, configured to perform clarity processing on an initial rendering of the background element according to a first display parameter of the background element in the target display frame to obtain a target rendering of the background element;

[0029] An image output module, configured to output a background image of the target display frame according to a target rendering image of background elements within the target display frame;

[0030] A visualization display module is used to visualize the target video according to the background image of the target display frame.

[0031] In a third aspect, an embodiment of the present disclosure provides a projection device, comprising: a processor, a storage medium communicatively connected to the processor, the storage medium being suitable for storing multiple instructions; the processor being suitable for calling the instructions in the storage medium to execute the steps in the audio visualization method.

[0032] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium on which a plurality of instructions are stored, wherein the instructions are suitable for being loaded and executed by a processor to perform the steps in implementing the audio visualization method.

[0033] Beneficial effects of the present disclosure: The present disclosure first determines the element group corresponding to the target audio and the first display parameters of the background elements in each element group within the target display frame according to the audio information corresponding to the target audio and the preset matching conditions, and then performs clarity processing on the initial rendering image of the background elements according to the first display parameters of the background elements in the target display frame to obtain the target rendering image of the background elements. Then, based on the target rendering image of the background elements in the target display frame, the background image of the target display frame is output. Finally, based on the background image of the target display frame, the target audio is visually displayed. Therefore, by performing clarity processing on the initial rendering image of the background elements through the first display parameters of the background elements, and visually displaying the target audio based on the target rendering image obtained by the clarity processing, the bandwidth pressure caused by data copying during post-processing can be avoided, the efficiency of data processing can be increased, and the smoothness of the screen display can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments recorded in the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0035] Figure 1 This is a flowchart of audio visualization provided by one embodiment of the present disclosure;

[0036] Figure 2 is a diagram showing a depth of field change state when the background element is a circle, provided by an embodiment of the present disclosure;

[0037] Figure 3 is a diagram showing a depth of field change state when the background element is circular, provided by an embodiment of the present disclosure;

[0038] Figure 4 is a flowchart of audio visualization provided by another embodiment of the present disclosure;

[0039] Figure 5 This is a basic rendering provided by an embodiment of the present disclosure in a clear state when the background element is a circle;

[0040] Figure 6 This is a basic rendering image in a blurred state when the background element is a circle provided by an embodiment of the present disclosure;

[0041] Figure 7 This is a basic rendering provided by an embodiment of the present disclosure in a clear state when the background element is circular;

[0042] Figure 8This is a basic rendering provided by an embodiment of the present disclosure in a blurred state when the background element is a circle;

[0043] Figure 9 is a flowchart of audio visualization provided by another embodiment of the present disclosure;

[0044] Figure 10 is a principle block diagram of an audio visualization device provided by an embodiment of the present disclosure;

[0045] Figure 11 This is a block diagram of the internal structure principle of the projection device provided by the embodiment of the present disclosure. DETAILED DESCRIPTION

[0046] To make the objectives, technical solutions and advantages of the present disclosure more clear and explicit, the present disclosure is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific examples described herein are only used to explain the present disclosure and are not intended to limit the present disclosure.

[0047] It should be noted that if the embodiments of the present disclosure involve directional indications (such as up, down, left, right, front, back, etc.), the directional indications are only used to explain the relative position relationship, movement status, etc. between the various components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indications will also change accordingly.

[0048] Audio visualization refers to a visually oriented approach, using music as a medium to interpret musical content through images and video. It combines visual and audio elements, providing an intuitive visual presentation for understanding, analyzing, and comparing the expressive form and internal and external structure of musical works. Existing technologies extract features from audio data and render images based on these features. After rendering, the rendered image is post-processed to impart a depth-of-field effect. Post-processing methods for achieving depth-of-field effects include screen post-processing and shader post-processing. Screen post-processing involves copying the rendered image from the GPU to the CPU for post-processing effects calculation, and then copying the rendered image back from the CPU for final output. This places significant pressure on GPU bandwidth and reduces frame rates. For example, when rendering a 1920×1080 pixel image, each RGBA pixel occupies 4 bytes, resulting in an image size of approximately 8MB. Screen post-processing requires copying 8MB of data from the GPU to the CPU for each frame, and then copying the processed 8MB back to the GPU for display, resulting in an instantaneous bandwidth pressure of 16MB. The shader post-processing also processes the rendered image and outputs the processed image to the screen. However, the image processing part is written by the implementer, and the image needs to be rendered and processed multiple times to achieve the depth of field effect.

[0049] In order to solve the problems of the prior art, the present embodiment provides an audio visualization method, apparatus, projection device and storage medium. This method can avoid the bandwidth pressure caused by data copying during post-processing, increase the efficiency of data processing, and improve the smoothness of screen display. In specific implementation, first, based on the audio information corresponding to the target audio and the preset matching conditions, the element group corresponding to the target audio and the first display parameters of the background elements in each element group in the target display frame are determined. Then, based on the first display parameters of the background elements in the target display frame, the initial rendering image of the background elements is processed for clarity to obtain the target rendering image of the background elements. Then, based on the target rendering image of the background elements in the target display frame, the background image of the target display frame is output. Finally, based on the background image of the target display frame, the target video is visualized. Therefore, by processing the initial rendering image of the background elements for clarity using the first display parameters of the background elements to obtain the target rendering image of the background elements, and visually displaying the target audio based on the target rendering image of the background elements, the bandwidth pressure caused by data copying during post-processing can be avoided, the efficiency of data processing can be increased, and the smoothness of screen display can be improved.

[0050] Exemplary Methods

[0051] The present disclosure provides an audio visualization method, which can be applied to a projection device. Figure 1 As shown in , the method includes:

[0052] Step S100: Determine, based on audio information corresponding to the target audio and a preset matching condition, the element groups corresponding to the target audio and first display parameters of the background elements in each element group within the target display frame.

[0053] Specifically, the target audio includes but is not limited to music, voice programs, audio novels, etc. The audio information includes audio text information and audio feature information. The audio text information includes text content information, text trigger time, and text duration, etc. The audio feature information includes audio style information, pitch information, sound intensity information, and timbre information. The projection device can directly obtain the audio information corresponding to the target audio from other devices, or it can obtain the target audio from other devices and parse the target audio to obtain the audio information corresponding to the target audio. When the projection device obtains the target audio from other devices for parsing, the projection device can use its own audio visualization tool to parse the target audio and obtain the audio information corresponding to the target audio.

[0054] The target audio corresponds to several element groups, each of which contains several background elements. The background elements can be points, lines, or other set shapes, such as circles, triangles, columns, waveforms, etc. The first display parameters of the background elements in the target display frame include clarity parameters, position parameters, deformation parameters, and color parameters. The first display parameters of the background elements in the target display frame change with the changes in the audio information corresponding to the target audio, thereby realizing the visual display of the target audio. For example, Figure 2 and Figure 3 As shown, when the target audio is a song and the background elements are circles and circles, as a line of lyrics begins and ends, the position of the background elements (i.e., circles and circles) changes from left to right, and gradually becomes clear from blurry. Specifically, after the projection device obtains the audio information corresponding to the target audio, it determines the element group corresponding to the target audio and the first display parameters of the background elements in each element group within the target display frame based on the audio information corresponding to the target audio and the preset matching conditions, so that in the subsequent steps, the initial rendering of the background elements is processed according to the first display parameters of the background elements within the target display frame.

[0055] In a specific embodiment, the preset matching conditions include a correspondence between audio text and element groups. When the target audio is a song, the audio text includes lyrics text, song title, album, file producer, etc. When determining the element group corresponding to the target audio based on the audio information and the preset matching conditions, the audio text corresponding to the target audio can be determined based on the audio information corresponding to the target audio, and then the element group corresponding to the target audio can be determined based on the audio text corresponding to the target audio and the correspondence between the audio text and the element group. For example, if the preset matching conditions include that a single sentence of audio text corresponds to one element group, and the target audio corresponds to N sentences of audio text, N element groups can be determined based on the audio information and the preset matching conditions, and the N element groups correspond one-to-one with the N sentences of audio text.

[0056] In one embodiment, Figure 4 As shown, step S100 includes:

[0057] Step S110: Determine the element group corresponding to the target audio and the animation type and animation duration corresponding to the background element in each element group according to the audio text information corresponding to the target audio and a preset matching condition;

[0058] Step S120: Determine first display parameters of the background elements in each element group within the target display frame according to the animation type and the animation duration.

[0059] Specifically, the animation types include clarity change, position change, size change, and color change. The animation duration corresponding to the background element is the time it takes for the background element to change from the initial state to the target state. For example, Figure 2The animation type corresponding to the background element (i.e., circle) in the image is clarity change, and the animation duration corresponding to the background element is the time it takes to change from the most blurred state to the clearest state. When the audio information includes audio text information, the preset matching condition also includes the correspondence between the audio text information and the animation duration. For example, the preset matching condition includes that the animation duration corresponding to the background element in each element group is equal to the duration of the single-sentence audio text corresponding to each element group. When determining the element group corresponding to the target audio and the first display parameter of the background element in each element group within the target display frame, the element group corresponding to the target audio and the animation type and animation duration corresponding to the background element in each element group can be first determined based on the audio text information corresponding to the target audio and the preset matching condition. Then, based on the animation type and animation duration, the first display parameter of the background element in each element group within the target display frame is determined. For example, it is determined that the animation type corresponding to background element A in element group A is clarity change, and the animation duration corresponding to background element A is 20s. The clarity parameter of background element A within the target display frame can be determined based on the animation type and animation duration corresponding to background element A.

[0060] When determining the first display parameter of the background elements in each element group within a target display frame based on the animation type and animation duration, the projection device may first determine the animation rate corresponding to the background elements in each element group, and then determine the first display parameter of the background elements in each element group within the target display frame based on the animation type, animation duration, and animation rate. The animation rate is the rate at which the background elements change from an initial state to a target state. For example, when the animation type is clarity change, the animation rate is the rate at which the background elements change from an initial clarity to a target clarity; when the animation type is position change, the animation rate is the rate at which the background elements change from an initial position to a target position. The animation rate corresponding to the background elements in each element group can be pre-set or determined based on audio feature information corresponding to the target audio, namely, based on audio style information, pitch information, volume information, and timbre information corresponding to the target audio. For example, the animation rate corresponding to the background elements in each element group is determined based on the pitch information corresponding to the target audio. Higher pitches correspond to faster animation rates for the background elements, while lower pitches correspond to slower animation rates for the background elements.

[0061] S200: Perform clarity processing on an initial rendering image of the background element according to a first display parameter of the background element in the target display frame to obtain a target rendering image of the background element.

[0062] Specifically, the initial rendering of the background element can be formed by superimposing multiple basic renderings of the background element, or it can be composed of one basic rendering of the background element. When the initial rendering of the background element is formed by superimposing multiple basic renderings of the background element, there are at least two basic renderings with different clarity among the multiple basic renderings of the background element, and the absolute value of the difference in clarity corresponding to each of the at least two basic renderings with different clarity is greater than a preset threshold. For example, the initial rendering of the background element is formed by superimposing two basic renderings of the background element, and the background elements in the two basic renderings are respectively in the clearest state and the most blurred state. When the initial rendering of the background element is composed of one basic rendering of the background element, the background element in the basic rendering is in the clearest state.

[0063] After determining the element group corresponding to the target audio and the first display parameters of the background elements in each element group within the target display frame, the initial rendering image of the background elements can be processed for clarity according to the first display parameters of the background elements within the target display frame to obtain the target rendering image of the background elements. Specifically, when the initial rendering image of the background element is formed by superimposing multiple basic rendering images of the background element, the clarity processing of the initial rendering image of the background element according to the first display parameter is to perform clarity processing on the multiple basic rendering images of the background element respectively according to the first display parameter. When the initial rendering image of the background element is composed of basic rendering images of the background element in the clearest state, the clarity processing of the initial rendering image of the background element according to the first display parameter is to perform clarity processing on a basic rendering image of the background element according to the first display parameter.

[0064] The first display parameters of the background elements mentioned in the above steps in the target display frame include not only clarity parameters, but also position parameters, deformation parameters and color parameters. Before the clarity processing of the initial rendering of the background elements according to the first display parameters, the present disclosure also renders the background elements according to the display parameters of the background elements in the target display frame to obtain the initial rendering of the background elements, so that the position parameters, deformation parameters and color parameters of the background elements in the initial rendering correspond to the audio information, thereby realizing the visual display of the target audio. For example, when the target audio is a song and the lyrics contain the character "black", the color of the background elements in the element group corresponding to the lyrics is black. When the lyrics contain the character "heartbeat", there is a heart-shaped background element in the element group corresponding to the lyrics, and the color of the heart-shaped background element is pink. The position of the heart-shaped background element moves up and down with the lyrics, thereby forming a special effect similar to a heartbeat.

[0065] In one embodiment, continue to refer to Figure 4 As shown, step S200 includes:

[0066] S210, determining a target transparency value of each of the multiple basic renderings in a target rendering of the background element according to a first display parameter of the background element in the target display frame;

[0067] S220 : Adjust the transparency values of the multiple basic rendering images in the initial rendering image of the background element according to the target transparency value to obtain a target rendering image of the background element.

[0068] When the initial rendering of the background element is formed by superimposing multiple basic renderings of the background element, when the clarity of the initial rendering of the background element is processed according to the first display parameter of the background element in the target display frame, first determine the target transparency value of each basic rendering in the multiple basic renderings in the target rendering of the background element according to the first display parameter of the background element in the target display frame, and then adjust the transparency values of the multiple basic renderings in the initial rendering of the background element according to the target transparency value to obtain the target rendering of the background element. Since there are at least two basic renderings with different clarity among the multiple basic renderings, the depth of field effect of the background element can be achieved by adjusting the transparency values of the multiple basic renderings, thereby avoiding the bandwidth pressure caused by data copying during post-processing, increasing the efficiency of data processing, and improving the smoothness of the screen display. For example, when the background element is a circle, the basic rendering corresponding to the background element is as follows: Figure 5 and Figure 6 As shown, Figure 5 The background elements (i.e. circles) are in the clearest state. Figure 6 The background elements (i.e. circles) in the image are in the most blurred state. Figure 5 and Figure 6 Overlay and adjust Figure 5 and Figure 6 transparency, which can be achieved as Figure 2 The depth of field changes shown in the figure; when the background element is circular, the basic rendering corresponding to the background element is as follows Figure 7 and Figure 8 As shown, Figure 7 The background elements (i.e. circles) are in the clearest state. Figure 8 The background element (i.e. circle) in the image is in the most blurred state. Figure 7 and Figure 8 Overlay and adjust Figure 7 and Figure 8 transparency, which can be achieved as Figure 3 Depth of field changes shown.

[0069] In one embodiment, continue to refer to Figure 4 As shown, step S200 includes:

[0070] S210′, determining a target Gaussian blur value corresponding to each pixel in the initial rendering image of the background element according to the first display parameter of the background element in the target display frame;

[0071] S220 ′: Perform Gaussian blur processing on each pixel in the initial rendering image of the background element according to the target Gaussian blur value to obtain a target rendering image of the background element.

[0072] When the initial rendering of the background element is composed of a basic rendering in which the background element is in its clearest state, when the clarity of the initial rendering of the background element is processed according to the first display parameter of the background element in the target display frame, the target Gaussian blur value corresponding to each pixel in the initial rendering of the background element is first determined according to the first display parameter of the background element in the target display frame, and then Gaussian blur processing is performed on each pixel in the initial rendering of the background element according to the target Gaussian blur value to obtain the target rendering of the background element. Performing Gaussian blur processing on each pixel in the initial rendering of the background element according to the first display parameter of the background element in the target display frame can also achieve a depth of field effect for the background element, avoid bandwidth pressure caused by data copying during post-processing, increase data processing efficiency, and improve the smoothness of the screen display.

[0073] S300: Outputting a background image of the target display frame according to a target rendering image of background elements in the target display frame.

[0074] After obtaining the target rendering of the background elements in the target display frame, the background image of the target display frame can be output according to the target rendering of the background elements in the target display frame. Since the target rendering is a rendering obtained by performing clarity processing on the initial rendering of the background elements according to the first display parameter, the background image of the target display frame output according to the target rendering can achieve the depth of field effect of the background elements.

[0075] S400: Visually display the target video according to the background image of the target display frame.

[0076] After outputting the background image of the target display frame, the target display frame is output according to the background image of the target display frame, and the target video is visually displayed according to the target display frame. When visually displaying the target video according to the target display frame, the target display frame can be played frame by frame through a projection device when playing the target audio to achieve visual display of the target audio. Alternatively, a visual video can be generated according to the target display frame, and when playing the target audio, the visual video can be played through a projection device, which can also achieve visual display of the target audio.

[0077] In one embodiment, referring to Figure 9 As shown, after step S100, the following steps are further included:

[0078] M100, using the audio information and the first display parameter of the background element in the target display frame, to determine the foreground element in the target display frame and the second display parameter of the foreground element in the target display frame;

[0079] M200: Output a foreground image of the target display frame according to the foreground element in the target display frame and a second display parameter of the foreground element in the target display frame.

[0080] Specifically, the foreground element in the target display frame is the audio text corresponding to the target audio or the associated text of the target audio. For example, when the target audio is a song, the foreground element can be the song name, singer name, lyrics, etc. The second display parameters of the foreground element in the target display frame include the position parameters and color parameters of the foreground element in the target display frame. In order to achieve a special effect display combining audio text with background elements, the present disclosure determines the first display parameters of the background elements in each element group in the target display frame, and then determines the foreground elements in the target display frame and the second display parameters of the foreground elements in the target display frame based on the audio information and the first display parameters. Then, based on the foreground elements in the target display frame and the second display parameters of the foreground elements in the target display frame, the foreground elements of the target display frame are output.

[0081] In one embodiment, continue to refer to Figure 9 As shown, step S400 includes:

[0082] S410, outputting the target display frame according to the background image of the target display frame and the foreground image of the target display frame;

[0083] S420: Visually display the target video according to the target display frame.

[0084] In a specific embodiment, when the target display frame includes a background image and a foreground image, when visually displaying the target audio based on the background image of the target display frame, the target display frame is first output based on the background image of the target display frame and the foreground image of the target display frame, and then the target audio is visually displayed based on the target display frame.

[0085] Exemplary devices

[0086] like Figure 10 As shown, an embodiment of the present disclosure provides an audio visualization device, which is applied to a projection device. The device 1000 includes:

[0087] A parameter determination module 1010 is configured to determine, based on audio information corresponding to the target audio and a preset matching condition, a first display parameter of an element group corresponding to the target audio and a background element in each element group within a target display frame;

[0088] An image processing module 1020 is configured to perform clarity processing on an initial rendering of the background element according to a first display parameter of the background element in the target display frame to obtain a target rendering of the background element;

[0089] An image output module 1030 is configured to output a background image of the target display frame according to a target rendering image of background elements within the target display frame;

[0090] The visualization display module 1040 is configured to perform visualization display on the target video according to the background image of the target display frame.

[0091] Optionally, the parameter determination module 1010 is further configured to determine a foreground element in the target display frame and a second display parameter of the foreground element in the target display frame based on the audio information and the first display parameter of the background element in the target display frame.

[0092] Optionally, the image output module 1030 is further configured to output the foreground image of the target display frame according to the foreground element in the target display frame and a second display parameter of the foreground element in the target display frame.

[0093] Optionally, the parameter determination module 1010 includes:

[0094] A type and duration determination unit, configured to determine, based on the audio text information corresponding to the target audio and a preset matching condition, the element group corresponding to the target audio and the animation type and animation duration corresponding to the background element in each element group;

[0095] The parameter determination unit is configured to determine a first display parameter of the background element in each element group within a target display frame according to the animation type and the animation duration.

[0096] Optionally, the image processing module 1020 includes:

[0097] a transparency value determining unit, configured to determine a target transparency value of each of the plurality of basic renderings in a target rendering of the background element according to a first presentation parameter of the background element in the target display frame;

[0098] The transparency value adjustment unit is used to adjust the transparency values of multiple basic rendering images in the initial rendering image of the background element according to the target transparency value to obtain the target rendering image of the background element.

[0099] Optionally, the image processing module 1020 further includes:

[0100] a blur value determining unit, configured to determine a target Gaussian blur value corresponding to each pixel point in the initial rendering image of the background element according to the first display parameter of the background element in the target display frame;

[0101] The blur processing unit is used to perform Gaussian blur processing on each pixel in the initial rendering image of the background element according to the target Gaussian blur value to obtain a target rendering image of the background element.

[0102] Optionally, the visualization display module 1040 includes:

[0103] A display frame output unit, configured to output the target display frame according to the background image of the target display frame and the foreground image of the target display frame;

[0104] A visualization display unit is used to visualize the target video according to the target display frame.

[0105] Based on the above embodiments, the present disclosure also provides a projection device, which may include but is not limited to a projector, a projection TV, etc. Figure 11 As shown, the projection device includes a processor, memory, network interface, display screen, and temperature sensor connected via a system bus. The processor of the projection device is used to provide computing and control capabilities. The memory of the projection device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The network interface of the projection device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, an audio visualization method is implemented. The display screen of the projection device can be a liquid crystal display screen or an electronic ink display screen. The temperature sensor of the projection device is pre-installed inside the projection device and is used to detect the operating temperature of the internal device.

[0106] Those skilled in the art will understand that Figure 11 The principle block diagram shown in the figure is only a block diagram of a partial structure related to the scheme of the present disclosure, and does not constitute a limitation on the projection device to which the scheme of the present disclosure is applied. The specific projection device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0107] In one embodiment, a projection device is provided, comprising: a processor, and a storage medium communicatively connected to the processor, the storage medium being suitable for storing a plurality of instructions; the processor being suitable for calling the instructions in the storage medium to execute some or all steps of any one of the audio visualization methods described in the above method embodiments.

[0108] In one embodiment, a computer-readable storage medium is provided, on which a plurality of instructions are stored. The instructions are suitable for being loaded and executed by a processor to perform some or all of the steps of any one of the audio visualization methods described in the above method embodiments.

[0109] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided by the present disclosure can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0110] In summary, the present disclosure provides an audio visualization method, apparatus, projection device and storage medium, including: determining the element group corresponding to the target audio and the first display parameters of the background elements in each element group within the target display frame according to the audio information corresponding to the target audio and preset matching conditions; performing clarity processing on the initial rendering image of the background elements according to the first display parameters of the background elements within the target display frame to obtain a target rendering image of the background elements; outputting the background image of the target display frame according to the target rendering image of the background elements within the target display frame; and visually displaying the target audio according to the background image of the target display frame. The present disclosure performs clarity processing on the initial rendering image of the background elements through the display parameters of the background elements, and visually displays the target audio based on the target rendering image obtained by the clarity processing, which can avoid bandwidth pressure caused by data copying during post-processing, increase data processing efficiency, and improve the smoothness of screen display.

[0111] It should be understood that the application of the present disclosure is not limited to the above examples. For those skilled in the art, improvements or changes can be made based on the above description, and all such improvements and changes should fall within the scope of protection of the claims attached to the present disclosure.

Claims

1. An audio visualization method, characterized in that: Applied to a projection device, the method includes: Determining, based on audio information corresponding to the target audio and a preset matching condition, first display parameters of the element group corresponding to the target audio and the background elements in each element group within a target display frame, wherein the audio information includes audio text information, including: determining, based on the audio text information corresponding to the target audio and the preset matching condition, the element group corresponding to the target audio and the background elements in each element group, an animation type and an animation duration; determining, based on the animation type and the animation duration, the first display parameters of the background elements in each element group within the target display frame; determining, according to the first display parameter of the background element in the target display frame, a target transparency value of each of the multiple base rendering images in the initial rendering image of the background element in the target rendering image of the background element; The transparency values of the multiple basic renderings are adjusted according to the target transparency value to obtain a target rendering of the background element; wherein the initial rendering of the background element is formed by superimposing multiple basic renderings of the background element, and at least two basic renderings of different clarity exist among the multiple basic renderings, and the absolute value of the difference in clarity corresponding to the at least two basic renderings of different clarity is greater than a preset threshold; outputting a background image of the target display frame according to a target rendering image of background elements within the target display frame; The target audio is visually displayed according to the background image of the target display frame.

2. The audio visualization method according to claim 1, characterized in that The step of performing clarity processing on the initial rendering image of the background element according to the first display parameter of the background element in the target display frame to obtain the target rendering image of the background element includes: Determining a target Gaussian blur value corresponding to each pixel in an initial rendering of the background element according to a first display parameter of the background element in the target display frame; Gaussian blur processing is performed on each pixel in the initial rendering image of the background element according to the target Gaussian blur value to obtain a target rendering image of the background element.

3. The audio visualization method according to claim 1, wherein: After the step of determining the element groups corresponding to the target audio and the first display parameters of the background elements in each element group within the target display frame based on the audio information corresponding to the target audio and the preset matching condition, the step further includes: determining a foreground element in the target display frame and a second display parameter of the foreground element in the target display frame according to the audio information and the first display parameter of the background element in the target display frame; A foreground image of the target display frame is output according to the foreground element in the target display frame and a second display parameter of the foreground element in the target display frame.

4. The audio visualization method according to claim 3, characterized in that The step of visually displaying the target audio according to the background image of the target display frame includes: outputting the target display frame according to the background image of the target display frame and the foreground image of the target display frame; The target audio is visually displayed according to the target display frame.

5. An audio visualization device, characterized in that: Applied to a projection device, the device comprises: A parameter determination module is configured to determine, based on audio information corresponding to the target audio and a preset matching condition, a first display parameter of an element group corresponding to the target audio and a background element in each element group within a target display frame, wherein the audio information includes audio text information, including: determining, based on the audio text information corresponding to the target audio and the preset matching condition, an animation type and an animation duration corresponding to the element group corresponding to the target audio and the background element in each element group; and determining, based on the animation type and the animation duration, a first display parameter of the background element in each element group within a target display frame; An image processing module is configured to determine, based on a first display parameter of the background element in the target display frame, a target transparency value for each of a plurality of base renderings in the initial rendering of the background element in the target rendering of the background element; and to adjust the transparency values of the plurality of base renderings according to the target transparency values to obtain the target rendering of the background element; wherein the initial rendering of the background element is formed by superimposing the plurality of base renderings of the background element, wherein at least two of the plurality of base renderings have different sharpnesses, and the absolute value of the difference in sharpness corresponding to each of the at least two base renderings with different sharpnesses is greater than a preset threshold; An image output module, configured to output a background image of the target display frame according to a target rendering image of background elements within the target display frame; A visualization display module is used to visualize the target audio according to the background image of the target display frame.

6. A projection device, characterized in that: include: A processor and a storage medium communicatively connected to the processor, wherein the storage medium is suitable for storing a plurality of instructions; the processor is suitable for calling the instructions in the storage medium to execute the steps of the audio visualization method according to any one of claims 1 to 4.

7. A computer-readable storage medium having a plurality of instructions stored thereon, characterized in that: The instructions are suitable for being loaded and executed by a processor to perform the steps of the audio visualization method according to any one of claims 1 to 4.

Images