Information processing method and device, electronic equipment and storage medium

Abstract

The invention provides an information processing method and device, electronic equipment and a storage medium, and relates to the technical field of image processing. The method comprises the following steps: acquiring a basic map, and constructing a coordinate system corresponding to the basic map; dividing the basic map based on the coordinate system, generating a plurality of sub-regions corresponding to the basic map, and generating a display identifier with a preset size for each sub-region; according to a preset audio attribute, generating a motion effect map for representing the display effect of each frame; and according to the coordinate information of each sub-region and the motion effect map, determining a to-be-displayed target sub-region corresponding to each frame, and rendering and displaying a display identifier of each target sub-region corresponding to each frame. According to the method, audio visualization processing does not need to be realized based on analysis and processing of audio data, rapid audio visualization processing is realized by means of an image rendering technology, and the calculation amount and resource consumption are reduced.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an information processing method, device, electronic device and storage medium. Background Art

[0002] Audio visualization processing separates the amplitude of the high and low frequencies of the audio, and displays the intensity of the high and low frequencies in the form of visual graphics, forming an audio effect that changes dynamically with the amplitude of the audio, so as to enrich the audio display effect and enhance the user's sense of immersion.

[0003] In the prior art, Fourier transform is usually used to analyze and process audio to separate complex audio waveforms into different triangular function waves, and a visual graph of the audio is generated according to the amplitude and frequency of each triangular function wave.

[0004] However, the above method is heavily dependent on the audio itself. It is necessary to perform complex analysis and processing on the audio after obtaining it in order to generate a visual graph of the audio, which makes the calculation process complicated and consumes a lot of processor power. Summary of the invention

[0005] The purpose of this application is to provide an information processing method, device, electronic device and storage medium, so as to improve the efficiency of audio visualization processing and reduce the consumption of processor resources.

[0006] To achieve the above purpose, the technical solution adopted in the embodiment of the present application is as follows:

[0007] In a first aspect, an embodiment of the present application provides an information processing method, including:

[0008] Obtain a base map and construct a coordinate system corresponding to the base map;

[0009] Dividing the basic map based on the coordinate system to generate a plurality of sub-regions corresponding to the basic map, and generating a display mark of a preset size for each sub-region;

[0010] Generate a motion effect map for representing the display effect of each frame according to preset audio attributes, wherein the audio attributes include: a rhythm fluctuation state and a wave peak fluctuation state;

[0011] According to the coordinate information of each sub-region and the motion effect map, the target sub-region to be displayed corresponding to each frame is determined, and the display identifier of each target sub-region corresponding to each frame is rendered and displayed.

[0012] In a second aspect, an embodiment of the present application further provides an information processing device, including: a construction module, a generation module, and a rendering module;

[0013] The construction module is used to obtain a base map and construct a coordinate system corresponding to the base map;

[0014] The generating module is used to divide the basic map based on the coordinate system, generate a plurality of sub-regions corresponding to the basic map, and generate a display mark of a preset size for each sub-region;

[0015] The generating module is used to generate a motion effect map for representing the display effect of each frame according to preset audio attributes, wherein the audio attributes include: a rhythm fluctuation state and a wave peak fluctuation state;

[0016] The rendering module is used to determine the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and render and display the display identifier of each target sub-region corresponding to each frame.

[0017] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor. When the electronic device is running, the processor and the storage medium communicate through the bus, and the processor executes the machine-readable instructions to execute the information processing method provided in the first aspect.

[0018] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the information processing method provided in the first aspect is executed.

[0019] The beneficial effects of this application are:

[0020] The present application provides an information processing method, device, electronic device and storage medium, including: obtaining a basic map, and constructing a coordinate system corresponding to the basic map; dividing the basic map based on the coordinate system, generating multiple sub-areas corresponding to the basic map, and generating a display mark of a preset size for each sub-area; generating a motion effect map for representing the display effect of each frame according to the preset audio attribute; determining the target sub-area to be displayed corresponding to each frame according to the coordinate information of each sub-area and the motion effect map, and rendering and displaying the display mark of each target sub-area corresponding to each frame. The method generates a motion effect map for representing the display effect of each frame based on the preset audio attribute, so that the display mark corresponding to each frame can be controlled to be rendered and displayed in the screen space according to the coordinate information of each divided sub-area and the motion effect map, and the audio visualization effect under each frame is presented by each display mark. Among them, the preset audio attribute is not dependent on the current audio data to be processed itself, which can avoid dependence on audio data, and there is no need to realize audio visualization processing based on the analysis and processing of audio data, thereby realizing audio visualization processing separated from the audio data itself, and at the same time, with the help of image rendering technology, the rapid processing of audio visualization is realized, which reduces the processing calculation amount and resource consumption.

[0021] In addition, a simulated color map corresponding to the audio is generated through a color simulation algorithm, and the color of the display logo is rendered through the simulated color map. By highlighting the display brightness of the display logo exceeding a certain height, the generated visualization effect can be enriched. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0023] Figure 1 A flowchart of an information processing method provided in an embodiment of the present application;

[0024] Figure 2 A flowchart of another information processing method provided in an embodiment of the present application;

[0025] Figure 3 A schematic diagram of horizontal axis division provided in an embodiment of the present application;

[0026] Figure 4 A schematic diagram of grid division provided in an embodiment of the present application;

[0027] Figure 5A flowchart of another information processing method provided in an embodiment of the present application;

[0028] Figure 6 A flowchart of another information processing method provided in an embodiment of the present application;

[0029] Figure 7 A flowchart of another information processing method provided in an embodiment of the present application;

[0030] Figure 8 A schematic diagram of an audio waveform curve provided in an embodiment of the present application;

[0031] Fig. 9 A schematic diagram of a waveform effect map provided in an embodiment of the present application;

[0032] Fig.10 A schematic diagram of an initial wave crest effect map provided in an embodiment of the present application;

[0033] Fig.11 A flowchart of another information processing method provided in an embodiment of the present application;

[0034] Fig.12 A schematic diagram of a reverse motion curve mapping provided in an embodiment of the present application;

[0035] Fig.13 A flowchart of another information processing method provided in an embodiment of the present application;

[0036] Fig.14 A flowchart of another information processing method provided in an embodiment of the present application;

[0037] Fig.15 A flowchart of another information processing method provided in an embodiment of the present application;

[0038] Fig.16 A flowchart of another information processing method provided in an embodiment of the present application;

[0039] Fig.17 A schematic diagram of a simulated color map provided in an embodiment of the present application;

[0040] Fig.18 A schematic diagram of another simulated color map provided in an embodiment of the present application;

[0041] Fig.19 A flowchart of another information processing method provided in an embodiment of the present application;

[0042] Fig. 20 A flowchart of another information processing method provided in an embodiment of the present application;

[0043] Fig.21 A schematic diagram of an audio visualization effect under multiple frames provided in an embodiment of the present application;

[0044] Fig. 22 A flowchart of another information processing method provided in an embodiment of the present application;

[0045] Fig.23 A flowchart of another information processing method provided in an embodiment of the present application;

[0046] Fig.24 A schematic diagram of an information processing device provided in an embodiment of the present application;

[0047] Fig.25 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0048] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the present application, or remove one or more operations from the flowchart.

[0049] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0050] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0051] Existing audio visualization processing is usually implemented based on the audio data itself. By analyzing the audio data, sound waves of different frequencies and amplitudes in the audio are extracted, and then audio sound wave effects are simulated according to the differences in frequency and amplitude.

[0052] However, this method relies on audio data, requires audio data as input, and needs to analyze the audio data. This calculation process is relatively complicated and consumes a certain amount of processor power.

[0053] Based on this, this solution provides an information processing method, which uses graphics rendering technology to divide the screen space and generate display labels; based on the general rhythm attributes of the audio, a motion effect map of the audio is generated, and based on the color simulation technology, a simulated color map is generated, so that according to the motion effect map and the simulated color map, the display of the display label is controlled to render and display the audio visualization effect. Among them, the motion effect map is generated based on the general rhythm attributes, which can be obtained by analyzing the historical audio visualization effects or generated based on experience, and has nothing to do with the audio data itself. The simulated color map is also independent of the audio data itself and can be generated based on the color simulation related algorithm, thereby realizing audio visualization processing that is independent of the audio data itself, reducing the computational complexity and resource consumption, and improving the computational efficiency.

[0054] Figure 1 A flowchart of an information processing method provided in an embodiment of the present application; the execution subject of the method may be a computer device, such as Figure 1 As shown, the method may include:

[0055] S101, obtaining a base map, and constructing a coordinate system corresponding to the base map.

[0056] This application takes the audio visualization effect of a columnar grid as an example, so it is first necessary to divide the screen space into grids. The screen can be regarded as a model, and the rendering of the model needs to be implemented based on a texture, so a basic texture corresponding to the screen space can be constructed. The basic texture can be understood as a blank texture tiled on the screen surface. The basic texture can have the same size as the screen surface. Of course, the size of the basic texture can also be smaller than the size of the screen surface. In this embodiment, the basic texture is taken as the same size as the screen surface.

[0057] Based on this, the coordinate system corresponding to the base texture can be the coordinate system corresponding to the screen space, that is, the horizontal coordinate of the screen space can be used as the horizontal coordinate of the base texture; the vertical coordinate of the screen space can be used as the vertical coordinate of the base texture.

[0058] S102 . Divide the basic texture based on the coordinate system to generate a plurality of sub-regions corresponding to the basic texture, and generate a display mark of a preset size for each sub-region.

[0059] In some embodiments, the base texture can be divided based on the coordinate system of the base texture, including the division of the horizontal axis and the vertical axis of the base texture, so that based on the division results, multiple sub-areas corresponding to the base texture can be generated, and a display mark of a preset size can be generated for each sub-area.

[0060] Optionally, in order to make the final audio visualization effect more beautiful and neat, the display mark generated for each sub-area here can be of the same size.

[0061] S103: Generate a motion effect map for representing the display effect of each frame according to preset audio properties.

[0062] Audio properties are used to indicate the dynamic changes of the audio waveform over time. The dynamic changes of the waveform over time can be used to simulate the visualization effect of audio.

[0063] Optionally, the preset audio properties may be summarized by statistically analyzing the existing audio visualization effects in the past; or the preset audio properties may be obtained by observing the existing audio visualization effects; or the preset audio properties may be generated based on the rich experience of the art production staff.

[0064] The motion effect in the audio visualization effect can be simulated according to the audio property, and the visual motion effect of the audio can be simulated based on the motion effect.

[0065] Optionally, based on the audio properties, a display effect map corresponding to the audio in each frame can be generated. The display effect map is used to characterize the visual display effect of the audio in each frame. The display effect map corresponding to the audio in each frame contains static motion information. As time goes by, the display effect map corresponding to each frame is different, so that the display effect map corresponding to multiple consecutive frames of audio constitutes a motion effect map. The motion effect map can be used to simulate the generation of audio visualization effects. The audio visualization effect can present a motion effect that fluctuates over time, thereby enhancing the user's sense of immersion in the music.

[0066] S104 , determining the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and rendering and displaying the display mark of each target sub-region corresponding to each frame.

[0067] Optionally, based on the coordinate information of each sub-area and the motion effect map, it can be determined which target sub-areas to be displayed in each frame, so that based on the determined target sub-areas to be displayed, the display identifiers in each target sub-area can be rendered and displayed in the screen space, so that the audio visualization effect is formed by each display identifier.

[0068] That is, the motion effect of the simulated audio is essentially achieved by controlling whether the display markers in each sub-area generated above are displayed. The waveform fluctuation state presented by the audio visualization effect in each frame is different, and the display markers that need to be lit up and displayed in different waveform fluctuation states are different. If all display markers are displayed, the waveform fluctuation state cannot be presented. When some display markers are displayed and some display markers are not displayed, the waveform fluctuation state can be outlined together.

[0069] In summary, the information processing method provided by this embodiment includes: obtaining a basic map and constructing a coordinate system corresponding to the basic map; dividing the basic map based on the coordinate system, generating multiple sub-areas corresponding to the basic map, and generating a display mark of a preset size for each sub-area; generating a motion effect map for representing the display effect of each frame according to the preset audio attribute; determining the target sub-area to be displayed corresponding to each frame according to the coordinate information of each sub-area and the motion effect map, and rendering and displaying the display mark of each target sub-area corresponding to each frame. This method generates a motion effect map for representing the display effect of each frame based on the preset audio attribute, so that the display mark corresponding to each frame can be rendered and displayed in the screen space according to the coordinate information of each divided sub-area and the motion effect map, and the audio visualization effect under each frame is presented by each display mark. Among them, the preset audio attribute is not dependent on the current audio data to be processed itself, which can avoid dependence on audio data, and there is no need to realize audio visualization processing based on the analysis and processing of audio data, thereby realizing audio visualization processing separated from the audio data itself, and at the same time, with the help of image rendering technology, the rapid processing of audio visualization is realized, which reduces the processing calculation amount and resource consumption.

[0070] Figure 2 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S102, dividing the base map based on the coordinate system to generate multiple sub-areas corresponding to the base map may include:

[0071] S201, performing a decimal operation on each horizontal coordinate in the base map, and dividing the horizontal axis of the base map into a plurality of intervals.

[0072] Optionally, the Frac(x) function may be used to process each horizontal coordinate in the base map, thereby dividing the horizontal axis of the coordinate of the base map into a plurality of intervals with a period of 1.

[0073] Among them, the Frac(x) function can obtain the decimal part of the data, for example: frac(3.78)=0.78. Through this function, the horizontal axis of the basic map can be divided into multiple intervals with a period of 1.

[0074] Figure 3 A horizontal axis division diagram provided in an embodiment of the present application. Figure 3 As shown, the horizontal axis is divided into multiple intervals, and the length of each interval is 1.

[0075] S202: Perform a decimal operation on each vertical coordinate in the base map, and divide the vertical axis of the base map into multiple intervals.

[0076] Optionally, the vertical axis of the basic map may be divided in the same manner, and a plurality of intervals with a period of 1 may also be obtained.

[0077] S203 , generating a plurality of sub-regions corresponding to the basic map according to the plurality of intervals divided by the horizontal axis of the basic map and the two intervals divided by the vertical axis.

[0078] Figure 4 A schematic diagram of a grid division provided in an embodiment of the present application. Based on the multiple intervals obtained after the above-mentioned division of the horizontal axis and the vertical axis, a sub-area can be generated by connecting the corresponding horizontal axis intervals and the vertical axis intervals. Figure 4 As shown in , each dotted box shown represents a sub-region, and a sub-region can also be called a lattice. The small rectangle shown in each sub-region can represent a display mark in each sub-region.

[0079] The size of the display mark in each sub-region is smaller than the size of the sub-region, so that there is a certain interval between the display marks to form a plurality of grids.

[0080] In this embodiment, the display mark is a rectangle for illustration. In actual application, the display mark can also be designed as an ellipse, a triangle, etc.

[0081] Based on the above division results, each sub-area will correspond to a coordinate information, and continue as follows Figure 4 As shown, from left to right, the first column, from bottom to top, the coordinates of the sub-area in the first row can be (0,0), the coordinates of the sub-area in the second column and the first row can be (1,0), and the coordinates of the sub-area in the third column can be (2,2).

[0082] Therefore, each pixel in a sub-area has two coordinate information, one is the sub-area coordinate, and the other is the actual coordinate. The sub-area coordinates of each pixel in a sub-area are the same, and the actual coordinates of each pixel in a sub-area are determined according to the specific position of the pixel. The actual coordinates of each pixel in a sub-area are different, but the horizontal and vertical coordinates are both between 0 and 1, which is related to the divided interval.

[0083] Figure 5 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S103, generating a motion effect map for representing the display effect of each frame according to preset audio attributes may include:

[0084] S301, generating a display effect map corresponding to the audio in the current frame according to audio properties and horizontal coordinate information of each pixel point in the basic map in the current frame.

[0085] Based on the acquired horizontal coordinate information of each pixel point in the basic map of the current frame and the audio attribute, a display effect map corresponding to the audio of the current frame can be generated.

[0086] S302: According to a preset first adjustment parameter, the horizontal coordinate information of each pixel point in the basic map of the current frame is adjusted to generate the horizontal coordinate information of each pixel point in the basic map of the next frame.

[0087] The horizontal coordinate information of each pixel in the basic map in the current frame can be adjusted by the preset first adjustment parameter, so that the horizontal coordinate information of each pixel in the basic map changes with time, and the horizontal coordinate information of each pixel in the basic map in the next frame is generated.

[0088] The first adjustment parameter may be a preset value or a game time, for example, 1. Then, each pixel of the next frame of the basic map may be shifted right or left relative to the previous frame.

[0089] S303: Generate a display effect map corresponding to the audio in the next frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the next frame.

[0090] Based on the horizontal coordinate information of each pixel point in the basic map of the next frame and the audio properties, a display effect map corresponding to the audio of the next frame can be generated. In this way, a display effect map corresponding to the audio of multiple frames can be generated.

[0091] S304: Generate a motion effect map according to the display effect maps corresponding to the consecutive frames.

[0092] Optionally, by fusing the display effect maps corresponding to the generated multiple consecutive frames, a motion effect map can be generated, that is, a continuous dynamic effect can be formed by the static display effects of each frame.

[0093] Figure 6 A flowchart of another information processing method provided by an embodiment of the present application; optionally, in step S301, generating a display effect map corresponding to the audio in the current frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame may include:

[0094] S401, generating a waveform effect map corresponding to the audio in the current frame and a target peak effect map corresponding to the audio according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame.

[0095] In this embodiment, the focus is on simulating the overall fluctuation effect of the waveform presented by the audio visualization along with the audio rhythm and the height difference of the waveform, and the height difference of the waveform forms an effect of rising and falling peaks as a whole. Therefore, based on the audio properties and the horizontal coordinate information of each pixel point in the basic map under the current frame, the waveform effect map corresponding to the audio in the current frame and the target peak effect map can be generated respectively.

[0096] Among them, the waveform effect map is used to control the overall fluctuation effect of the waveform of the simulated audio with the rhythm, and the target peak effect map is used to control the rise and fall effect of the simulated peak.

[0097] S402: Generate a display effect map corresponding to the audio in the current frame according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map.

[0098] Based on the superposition of the waveform effect map and the target peak effect map, a display effect map corresponding to the audio in the current frame can be generated, so as to perform audio visualization simulation control based on the display effect map, and the presented visualization effect can include both rhythm fluctuation effect and peak fluctuation effect.

[0099] Optionally, the above-mentioned audio attributes may include but are not limited to: audio waveform curve and audio peak curve. The audio waveform curve is used to indicate the overall fluctuation effect of the audio curve with the rhythm. The audio waveform curve of each frame can be extracted from the complete audio waveform curve. The amplitude of each point in the audio waveform curve of each frame may be different, so the shape of the audio waveform curve of each frame may be different. The audio waveform curves of multiple consecutive frames can constitute a complete audio waveform curve.

[0100] The audio peak curve indicates the up and down movement of the peaks in the audio curve with the rhythm (that is, the rise and fall of the peaks). In the audio visualization effect, the peak refers to the upward protruding part of the waveform line, which represents the high or strong part of the audio signal. The audio peak curve refers to the dynamic change process of these peaks in the audio waveform. The up and down movement of the peaks reflects the amplitude change of the audio signal, that is, the change of sound intensity.

[0101] Figure 7 A flowchart of another information processing method provided by an embodiment of the present application; optionally, in step S401, a waveform effect map and a target peak effect map corresponding to the audio in the current frame are generated according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame, including:

[0102] S501, generating a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame.

[0103] Figure 8 A schematic diagram of an audio waveform curve provided in an embodiment of the present application. It can be observed that the audio visualization effect usually presents an overall fluctuation with the rhythm, such as Figure 8 (a) in FIG. 1 shows the initial audio waveform curve.

[0104] In detail, the audio usually starts very quickly with the rise and fall of the rhythm, and then falls slowly. Figure 8 After adjusting (a) in Figure 8 The audio waveform curve shown in (b). Figure 8 The audio waveform curve shown in (b) can better represent the rhythm fluctuation effect presented by the audio visualization effect.

[0105] According to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame, the rhythm fluctuation state information represented by the audio waveform curve in the current frame can be converted to the map, thereby generating a waveform effect map corresponding to the audio in the current frame.

[0106] Fig. 9 A schematic diagram of a waveform effect map provided in an embodiment of the present application. The waveform effect map has the same size as the base map, that is, the horizontal coordinate of the waveform effect map corresponds to the horizontal coordinate of the base map, and the vertical coordinate of the waveform effect map corresponds to the vertical coordinate of the base map. The vertical axis of the waveform effect map is used to indicate brightness information.

[0107] S502: Generate an initial peak effect map corresponding to the audio in the current frame according to the audio peak curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame.

[0108] The audio peak curve is not illustrated in this embodiment. It is worth noting that both the audio waveform curve and the audio peak curve can be pre-drawn and generated by a drawing tool.

[0109] Similarly, it is necessary to convert the audio peak curve of the current frame to the map to generate the initial peak effect map corresponding to the audio of the current frame.

[0110] Fig.10 A schematic diagram of an initial peak effect map provided in an embodiment of the present application. The initial peak effect map also has the same size as the base map, and it can be seen that the brightness information of the initial peak effect map from left to right is different.

[0111] S503: Generate a reverse wave crest effect map corresponding to the initial wave crest effect map according to the initial wave crest effect map and a preset second adjustment parameter.

[0112] In order to make the generated wave crest undulation map present wave crests that appear random, the initial wave crest effect map may be adjusted using a preset second adjustment parameter so that the initial wave crest effect map produces a reverse motion, thereby obtaining a reverse wave crest effect map.

[0113] S504: Generate a target peak effect map corresponding to the audio in the current frame according to the initial peak effect map and the reverse peak effect map.

[0114] By superimposing the initial peak effect map and the reverse peak effect map, a target peak effect map corresponding to the audio can be generated. The peak value in the target peak effect map is more random, and the peak fluctuation effect is more realistic.

[0115] Fig.11 A flowchart of another information processing method provided by an embodiment of the present application; optionally, in step S501, a waveform effect map corresponding to the audio in the current frame is generated according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame, including:

[0116] S601. Determine the ordinate information of each pixel point in the audio waveform curve corresponding to the current frame according to the abscissa information of the audio waveform curve and the abscissa information of each pixel point in the basic map; the ordinate information in the audio waveform curve is used to indicate the height of the fluctuation.

[0117] The horizontal axis of the audio waveform curve and the basic map are also one-to-one corresponding, and the vertical axis of the audio waveform curve corresponds to the brightness information of the basic map. The vertical axis information corresponding to each pixel point in the audio waveform curve can be found according to the horizontal axis information of the audio waveform curve and the horizontal axis information of each pixel point in the basic map.

[0118] S602: Determine brightness information of each pixel point according to the ordinate information of each pixel point in the audio waveform curve.

[0119] Since the audio waveform curve and the waveform effect map have a corresponding relationship, different vertical coordinate values ​​in the audio waveform curve correspond to different brightness information. Therefore, the brightness information of each pixel point in the waveform effect map can be determined according to the vertical coordinate information corresponding to each pixel point in the audio waveform curve.

[0120] S603. Generate a waveform effect map corresponding to the audio in the current frame according to the brightness information of each pixel point, wherein the abscissa of the waveform effect map corresponds to the abscissa of the audio waveform curve, and the ordinate of the waveform effect map is used to indicate brightness.

[0121] Then, based on the horizontal coordinate information of each pixel point and the brightness information of each pixel point, a waveform effect map corresponding to the audio in the current frame can be generated. The waveform effect map also indicates the fluctuation effect of the audio with the rhythm. It can be understood that the audio waveform curve and the waveform effect map are different ways of expressing the fluctuation effect of the audio with the rhythm.

[0122] Optionally, in step S503, generating a reverse peak effect map corresponding to the initial peak effect map according to the initial peak effect map and a preset second adjustment parameter may include: according to the initial peak effect map and the second adjustment parameter, moving the horizontal coordinate of the initial peak effect map in the opposite direction to generate a reverse peak effect map corresponding to the initial peak effect map.

[0123] The second adjustment parameter is also a preset value, and the second adjustment parameter may be the same as or different from the first adjustment parameter.

[0124] Optionally, the second adjustment parameter may be used to control the initial wave crest effect map to produce an effect of moving in the reverse direction over time, thereby obtaining a reverse wave crest effect map corresponding to the initial wave crest effect map.

[0125] Fig.12 A schematic diagram of a reverse motion curve map provided in an embodiment of the present application, assuming that curve A represents the curve corresponding to the initial peak effect map, and curve B represents the curve corresponding to the reverse peak effect map. The waveforms formed by the initial peak effect map and the reverse peak effect map are generally unchanged, except that the two waveforms move in opposite directions.

[0126] Fig.13 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S402, a motion effect map corresponding to the audio in the current frame is generated according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map, including:

[0127] S701 , multiplying first ordinate information and second ordinate information corresponding to the same horizontal coordinates in the waveform effect map and the target peak effect map, respectively, to obtain new ordinate information corresponding to each horizontal coordinate.

[0128] Optionally, the product of two ordinate information corresponding to the same horizontal coordinate in the waveform effect map and the target peak effect map may be taken to obtain new ordinate information.

[0129] Assuming that the horizontal coordinates of pixel 1 in the waveform effect map and pixel 2 in the target peak effect map are the same, then the brightness information of pixel 1 in the waveform effect map is multiplied by the brightness information of pixel 2 in the target peak effect map to obtain new brightness information, and the new brightness information is used as the new vertical coordinate information.

[0130] S702: Generate a display effect map corresponding to the audio in the previous frame according to each horizontal coordinate and new vertical coordinate information corresponding to each horizontal coordinate.

[0131] Then, according to the horizontal coordinate of each pixel point and the new vertical coordinate information corresponding to each horizontal coordinate, a display effect map corresponding to the audio can be generated.

[0132] Of course, in another implementation, it can also be based on Fig.12 The curve shown in , multiply the two vertical coordinates corresponding to the same horizontal coordinates in curve A and curve B to obtain a new vertical coordinate, thereby generating a motion effect curve, and then converting the motion effect curve to the map to generate a display effect map.

[0133] Fig.14 A flowchart of another information processing method provided by an embodiment of the present application; optionally, in step S104, according to the coordinate information of each sub-region and the motion effect map, the target sub-region to be displayed corresponding to each frame is determined, and the display mark of each target sub-region corresponding to each frame is rendered and displayed, including:

[0134] S801, generating a simulated color map in each frame according to information of each horizontal coordinate in the base map, position information of the central axis of the base map, and a preset third adjustment parameter.

[0135] In some embodiments, in addition to simulating the audio rhythm, in order to enrich the display effect of audio visualization, color simulation can also be performed, that is, the color of the display logo in the sub-area is simulated so that the final audio visualization effect is more colorful.

[0136] Optionally, the preset third adjustment parameter is also a preset value, which is used to control the movement of the abscissa axis over time. The third adjustment parameter may be the same as the first adjustment parameter, or may be different.

[0137] In some embodiments, a simulated color map can be generated based on the information of each horizontal coordinate in the base map and the position information of the central axis of the base map. By moving each horizontal coordinate in the base map through the third adjustment parameter, a simulated color map in each frame can be generated respectively, and the simulated color map in each frame will show the effect of horizontal movement over time.

[0138] S802. Determine the target sub-regions to be displayed corresponding to each frame and the display attributes of each target sub-region according to the coordinate information of each sub-region, the coordinate information of each pixel in the display identifier of each sub-region, the motion effect map, and the simulated color map under each frame, and render and display the display identifier of each target sub-region according to the display attributes of each target sub-region.

[0139] Then, by combining the coordinate information of each sub-area, the coordinate information of each pixel point in the display marker in each sub-area, the motion effect map, and the simulated color map under each frame, each display marker that needs to be displayed under each frame can be controlled to be displayed according to the corresponding display color to present the audio visualization effect in the screen space.

[0140] Fig.15 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S801, according to the information of each horizontal coordinate in the base map, the position information of the central axis of the base map and the preset third adjustment parameter, a simulated color map under each frame is generated, including:

[0141] S901. Determine the distance between each vertical axis and the central axis in the base texture in the current frame according to the horizontal coordinate information of the base texture in the current frame and the position information of the central axis of the base texture.

[0142] Assuming that the position information of the central axis of the base texture is 0.5, and the horizontal coordinate information of the base texture is represented by UV.x, the function abs(Uv.x-0.5) can be used to calculate the distance between each vertical axis in the base texture and 0.5. The vertical axis can refer to each axis parallel to the longitudinal axis of the base texture.

[0143] S902: Generate a simulated color map for the current frame according to the distances between each vertical axis and the central axis in the basic map for the current frame.

[0144] According to the distance between each vertical axis and the central axis, the simulated color corresponding to each vertical axis can be determined, thereby generating a simulated color map in the current frame.

[0145] S903: Adjust the horizontal coordinate information of the basic map in the current frame according to the preset third adjustment parameter to generate the horizontal coordinate information of the basic map in the next frame.

[0146] The third adjustment parameter can be used to adjust the horizontal coordinate information of the basic map in the current frame, so that the horizontal coordinate of the basic map produces an effect of changing over time, thereby obtaining the horizontal coordinate information of the basic map in the next frame.

[0147] S904: Generate a simulated color map for the next frame according to the horizontal coordinate information of the basic map for the next frame and the position information of the central axis.

[0148] Thus, according to the horizontal coordinate information of the base map in the next frame and the position information of the central axis, the simulated color map in the next frame can be generated in the above manner. By repeating this cycle, simulated color maps of multiple frames can be generated respectively.

[0149] Fig.16 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S902, a simulated color map under the current frame is generated according to the distance between each vertical axis and the central axis in the basic map under the current frame, including:

[0150] S1001. Determine the color gradient degree of each vertical axis according to the distance between each vertical axis and the central axis.

[0151] S1002: Determine color information of each pixel point on each vertical axis according to the color gradient degree of each vertical axis and the preset first color and second color.

[0152] Assuming that a first color and a second color are preset, and the first color and the second color are different, if the vertical axis is closer to the central axis, it can be determined that the color of each pixel on the vertical axis is closer to the first color, and if the vertical axis is farther from the central axis, it can be determined that the color of each pixel on the vertical axis is closer to the second color. In this way, the color information of each pixel can be determined.

[0153] S1003: Generate a simulated color map in the current frame according to the horizontal coordinate information of each pixel and the determined color information of each pixel.

[0154] Based on the horizontal coordinate information of each pixel point and the color information of each pixel point, a simulated color map can be generated, and the vertical axis of the simulated color map represents the color information.

[0155] In some embodiments, if the position of the central axis in the base map is slightly shifted to the right along the vertical axis, the generated simulated color map may present a slightly inclined gradient effect.

[0156] The color of the display logo is rendered based on the simulated color map in each frame, which can produce a color change effect similar to a marquee.

[0157] Fig.17 A schematic diagram of a simulated color map provided in an embodiment of the present application, such as Fig.17 As shown, the color of each pixel in the area close to the central axis 0.5 is different from the color of each pixel in the area far from 0.5. The closer to 0.5, the closer the color is to C1, which is also the first color. The farther away from 0.5, the closer the color is to C2, which is also the first color. Since colors cannot appear in the attached drawings, grayscale images are used for illustration to show the color differences in different areas. In practical applications, the first color can be pink, for example, and the second color can be blue.

[0158] Fig.18 A schematic diagram of another simulated color map provided in an embodiment of the present application, after the central axis is shifted to the right along the longitudinal axis, the following can be generated: Fig.18 The skewed gradient shown simulates a color map.

[0159] Fig.19 A flowchart of another information processing method provided by an embodiment of the present application; optionally, in step S802, according to the coordinate information of each sub-region, the coordinate information of each pixel in the display identifier of each sub-region, the motion effect map, and the simulated color map under each frame, the target sub-region to be displayed corresponding to each frame and the display attributes of each target sub-region are determined, and the display identifier of each target sub-region is rendered and displayed according to the display attributes of each target sub-region, including:

[0160] S1101, determining the display status of the display identifier in each sub-region in each frame according to the coordinate information of each sub-region and the display effect map in each frame; the display status includes: display or non-display.

[0161] Next, the process of rendering and generating visualization effects based on the generated motion effect map and simulated color map is explained.

[0162] Optionally, the display status of the display identifier in each sub-region in each frame may be determined according to the coordinate information of each sub-region and the display effect map in each frame.

[0163] The audio fluctuation state represented by the display effect map in each frame is different, and different audio fluctuation states determine whether each display mark is displayed. Therefore, in different frames, the display mark to be displayed according to the display effect map may be different. The display state of the same display mark in different frames may also be different.

[0164] S1102: Determine the display color of the display mark in each sub-region in each frame according to the coordinate information of each pixel point in the display mark in each sub-region and the simulated color map in each frame.

[0165] The display color of the display mark in each sub-area can be determined according to the coordinate information of each pixel point in the display mark in each sub-area and the simulated color map in each frame.

[0166] S1103 , determining the target sub-regions to be displayed corresponding to each frame according to the display state, determining the display color of each target sub-region according to the display color, and rendering and displaying the display identifiers of each target sub-region according to the display color of each target sub-region.

[0167] According to the display status of each display identifier, the target sub-area to be displayed corresponding to each frame can be determined, and the display identifier in each target sub-area can be rendered and displayed. According to the display color of the display identifier in each target sub-area, each rendered display identifier can be colored to enrich the visualization effect.

[0168] Fig. 20 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S1101, determining the display state of the display identifier in each sub-region under each frame according to the coordinate information of each sub-region and the display effect map under each frame may include:

[0169] S1201. Determine brightness information in the display effect map corresponding to the horizontal coordinate of each sub-region according to the horizontal coordinate information of each sub-region and the horizontal coordinate information of the display effect map.

[0170] Optionally, based on the horizontal coordinate information of each sub-area and the horizontal coordinate information of the display effect map, pixel points matching the horizontal coordinate of each sub-area can be found in the display effect map, so that the brightness information of the pixel points matching the horizontal coordinate of each sub-area in the display effect map can be determined as the brightness information corresponding to the horizontal coordinate of each sub-area in the display effect map.

[0171] S1202: Determine the display status of the display identifier in each sub-region according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information corresponding to the abscissa of each sub-region in the display effect map.

[0172] Optionally, the ordinate corresponding to the abscissa of each sub-region may be compared with the brightness information corresponding to the abscissa in the display effect map, and the display status of the display identifier in each sub-region may be determined according to the comparison result.

[0173] Optionally, in step S1202, the display status of the display identifier in each sub-area is determined according to the vertical coordinate information corresponding to the horizontal coordinate of each sub-area and the brightness information in the display effect map corresponding to the horizontal coordinate of each sub-area, including: if the vertical coordinate information corresponding to the horizontal coordinate of the sub-area is less than the brightness information in the display effect map corresponding to the horizontal coordinate of the sub-area, then the display status of the display identifier in the sub-area is determined to be display; if the vertical coordinate information corresponding to the horizontal coordinate of the sub-area is greater than or equal to the brightness information in the display effect map corresponding to the horizontal coordinate of the sub-area, then the display status of the display identifier in the sub-area is determined to be non-display.

[0174] In some embodiments, if the ordinate information corresponding to the abscissa of the sub-region is less than the brightness information corresponding to the abscissa in the display effect map, it can be considered that the sub-region is located below the display effect curve corresponding to the display effect map, and the display identifier in the sub-region needs to be displayed; on the contrary, if the ordinate information corresponding to the abscissa of the sub-region is greater than or equal to the brightness information corresponding to the abscissa in the display effect map, it can be considered that the sub-region is located above the display effect curve corresponding to the display effect map. The shape of the curve is outlined by displaying the display identifier located below the curve, and the area above the curve is a blank area and does not need to be displayed. Based on this principle, the display status of each display identifier in each frame can be determined.

[0175] Optionally, in step S1103, determining the target sub-region to be displayed corresponding to each frame according to the display state includes: determining the sub-region whose display state of the display identifier in the sub-region is displayed as the target sub-region to be displayed.

[0176] Then, the sub-region where each display marker whose display status is displayed is located can be determined as the target sub-region to be displayed, so that each display marker in each target sub-region is rendered and displayed, while the remaining display markers are not displayed.

[0177] Fig.21 A schematic diagram of an audio visualization effect under multiple frames provided in an embodiment of the present application. Fig.21 As shown in the figure, the visualization effects of three consecutive frames are shown. The display logos to be displayed in each frame are different, so that the waveform corresponding to the visualization effect displayed in each frame has fluctuation differences. If multiple consecutive frames are displayed, a fluctuating visualization effect can be presented.

[0178] Fig. 22A flowchart of another information processing method provided by an embodiment of the present application; optionally, in step S1102, the display color of the display identifier in each sub-region under each frame is determined according to the coordinate information of each pixel point in the display identifier in each sub-region and the simulated color map under each frame, including:

[0179] S1301. Read, from a simulated color map, a map color corresponding to the coordinate information of each pixel point in the display mark in the sub-region according to the coordinate information of each pixel point in the display mark in the sub-region.

[0180] The coordinate information of each pixel point can map the position of each pixel point in the simulated color map, so that according to the coordinate information of each pixel point in the display mark in the sub-area, the map color can be read from the position corresponding to each pixel point in the simulated color map.

[0181] S1302: Determine a display color of the display marker in the sub-region according to a map color corresponding to coordinate information of each pixel point in the display marker in the sub-region.

[0182] Therefore, the display color of the display logo is determined according to the color of the map corresponding to each pixel in the display logo, and the display color of the display logo is composed of the color of each pixel in the display logo.

[0183] Since the attached figure cannot display color images, the visualization effect after simulating colors is not shown, but through Fig.21 It can be seen that there are differences in the displayed grayscale of the display logo, which reflects the color difference of the display logo.

[0184] Fig.23 A flowchart of another information processing method provided by an embodiment of the present application; Optionally, in step S1103, display identification of each target sub-region is rendered and displayed according to the display color of each target sub-region, and further includes:

[0185] S1401: Determine the display brightness of the display mark in each target sub-region according to the ordinate information of each target sub-region and a preset height threshold.

[0186] In some embodiments, for display marks whose amplitude exceeds a certain height, their display brightness can be increased to enrich the visualization effect.

[0187] Optionally, the display brightness of the display mark in each target sub-region may be determined according to the ordinate information of each target sub-region to be displayed and a preset height threshold.

[0188] S1402 : Render and display a display mark of each target sub-region according to the display color and display brightness of each target sub-region.

[0189] Therefore, the display mark in each target sub-region is rendered according to the display color and display brightness of each target sub-region, so as to render and generate a display mark with the corresponding display color and display brightness.

[0190] Optionally, in step S1401, the display brightness of the display marker in each target sub-area is determined according to the vertical coordinate information of each target sub-area and a preset height threshold, including: if the vertical coordinate information of the target sub-area is greater than the height threshold, then the display brightness of the display marker in the target sub-area is determined to be the target brightness.

[0191] In some embodiments, if the ordinate information of the target sub-region is greater than the height threshold, it is considered that the amplitude indicated by the target sub-region exceeds a certain height, and the display brightness of the display mark in the target sub-region can be determined as the target brightness. That is, the brightness of each display mark exceeding the height threshold is adjusted to be greater than the brightness of each display mark not exceeding the height threshold, so as to enrich the visualization effect.

[0192] refer to Fig.21 It can be seen that the display brightness of the display mark in the top area is greater than the display brightness of the display marks in other areas.

[0193] In summary, the information processing method provided by this embodiment includes: obtaining a basic map and constructing a coordinate system corresponding to the basic map; dividing the basic map based on the coordinate system, generating multiple sub-areas corresponding to the basic map, and generating a display mark of a preset size for each sub-area; generating a motion effect map for representing the display effect of each frame according to the preset audio attribute; determining the target sub-area to be displayed corresponding to each frame according to the coordinate information of each sub-area and the motion effect map, and rendering and displaying the display mark of each target sub-area corresponding to each frame. This method generates a motion effect map for representing the display effect of each frame based on the preset audio attribute, so that the display mark corresponding to each frame can be rendered and displayed in the screen space according to the coordinate information of each divided sub-area and the motion effect map, and the audio visualization effect under each frame is presented by each display mark. Among them, the preset audio attribute is not dependent on the current audio data to be processed itself, which can avoid dependence on audio data, and there is no need to realize audio visualization processing based on the analysis and processing of audio data, thereby realizing audio visualization processing separated from the audio data itself, and at the same time, with the help of image rendering technology, the rapid processing of audio visualization is realized, which reduces the processing calculation amount and resource consumption.

[0194] In addition, a simulated color map corresponding to the audio is generated through a color simulation algorithm, and the color of the display logo is rendered through the simulated color map. By highlighting the display brightness of the display logo exceeding a certain height, the generated visualization effect can be enriched.

[0195] The following describes the devices, equipment, storage media, etc. used to execute the information processing method provided by this application. The specific implementation process and technical effects are described above and will not be repeated below.

[0196] Fig.24 A schematic diagram of an information processing device provided in an embodiment of the present application, the functions implemented by the information processing device correspond to the steps performed by the above method. The device can be understood as the above-mentioned computer device or server, or the processor of the server, or can also be understood as a component independent of the above-mentioned server or processor that implements the functions of the present application under the control of the server, such as Fig.24 As shown, the device may include: a construction module 110, a generation module 120 and a rendering module 130;

[0197] Construction module 110, obtaining a base map and constructing a coordinate system corresponding to the base map;

[0198] A generating module 120, configured to divide the base map based on the coordinate system, generate a plurality of sub-regions corresponding to the base map, and generate a display mark of a preset size for each sub-region;

[0199] A generating module 120, for generating a motion effect map for representing the display effect of each frame according to a preset audio attribute;

[0200] The rendering module 130 is used to determine the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and render and display the display mark of each target sub-region corresponding to each frame.

[0201] Optionally, the generating module 120 is specifically used to perform a decimal operation on each horizontal coordinate in the base map, and divide the horizontal axis of the base map into a plurality of intervals;

[0202] Perform decimal operation on each vertical coordinate in the base map, and divide the vertical axis of the base map into multiple intervals;

[0203] A plurality of sub-regions corresponding to the base map are generated according to the plurality of intervals divided by the horizontal axis of the base map and the pairs of intervals divided by the vertical axis.

[0204] Optionally, the generating module 120 is specifically configured to generate a motion effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0205] According to a preset first adjustment parameter, the horizontal coordinate information of each pixel point in the base map of the current frame is adjusted to generate the horizontal coordinate information of each pixel point in the base map of the next frame;

[0206] Generate a display effect map corresponding to the audio in the next frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the next frame;

[0207] A motion effect map is generated according to the display effect maps corresponding to each continuous frame.

[0208] Optionally, the generating module 120 is specifically used to generate a waveform effect map corresponding to the audio in the current frame and a target peak effect map corresponding to the audio according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0209] A display effect map corresponding to the audio in the current frame is generated according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map.

[0210] Optionally, the audio attributes include: an audio waveform curve and an audio peak curve; a generation module 120, specifically configured to generate a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0211] Generate an initial peak effect map corresponding to the audio in the current frame according to the audio peak curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0212] Generate a reverse wave crest effect map corresponding to the initial wave crest effect map according to the initial wave crest effect map and a preset second adjustment parameter;

[0213] A target peak effect map corresponding to the audio in the current frame is generated according to the initial peak effect map and the reverse peak effect map.

[0214] Optionally, the generating module 120 is specifically used to determine the ordinate information corresponding to each pixel point in the audio waveform curve according to the abscissa information of the audio waveform curve in the current frame and the abscissa information of each pixel point in the basic map; the ordinate information in the audio waveform curve is used to indicate the height of the fluctuation;

[0215] Determine the brightness information of each pixel point according to the ordinate information of each pixel point in the audio waveform curve;

[0216] According to the brightness information of each pixel point, a waveform effect map corresponding to the audio in the current frame is generated. The horizontal coordinate of the waveform effect map corresponds to the horizontal coordinate of the audio waveform curve, and the vertical coordinate of the waveform effect map is used to indicate the brightness.

[0217] Optionally, the generating module 120 is specifically configured to move the horizontal coordinate of the initial peak effect map in the reverse direction according to the initial peak effect map and the second adjustment parameter, so as to generate a reverse peak effect map corresponding to the initial peak effect map.

[0218] Optionally, the generating module 120 is specifically used to multiply the first ordinate information and the second ordinate information respectively corresponding to each same horizontal coordinate in the waveform effect map and the target peak effect map to obtain new vertical coordinate information corresponding to each horizontal coordinate;

[0219] A display effect map corresponding to the audio in the previous frame is generated according to each horizontal coordinate and the new vertical coordinate information corresponding to each horizontal coordinate.

[0220] Optionally, the rendering module 130 is specifically used to generate a simulated color map in each frame according to the information of each horizontal coordinate in the basic map, the position information of the central axis of the basic map and the preset third adjustment parameter;

[0221] According to the coordinate information of each sub-area, the coordinate information of each pixel in the display identifier of each sub-area, the motion effect map and the simulated color map under each frame, the target sub-area to be displayed corresponding to each frame and the display attributes of each target sub-area are determined, and the display identifier of each target sub-area is rendered and displayed according to the display attributes of each target sub-area.

[0222] Optionally, the generating module 120 is specifically configured to determine the distance between each vertical axis and the central axis in the base map in the current frame according to the horizontal coordinate information of the base map in the current frame and the position information of the central axis of the base map;

[0223] Generate a simulated color map in the current frame according to the distance between each vertical axis and the central axis in the base map in the current frame;

[0224] According to a preset third adjustment parameter, the horizontal coordinate information of the basic map in the current frame is adjusted to generate the horizontal coordinate information of the basic map in the next frame;

[0225] The simulated color map for the next frame is generated according to the horizontal coordinate information of the base map for the next frame and the position information of the central axis.

[0226] Optionally, the generating module 120 is specifically configured to determine the color gradient degree of each vertical axis according to the distance between each vertical axis and the central axis;

[0227] Determine the color information of each pixel point on each vertical axis according to the color gradient degree of each vertical axis and the preset first color and second color;

[0228] A simulated color map under the current frame is generated according to the horizontal coordinate information of each pixel point and the determined color information of each pixel point.

[0229] Optionally, the rendering module 130 is specifically used to determine the display state of the display identifier in each sub-region in each frame according to the coordinate information of each sub-region and the display effect map in each frame; the display state includes: display or non-display;

[0230] Determine the display color of the display mark in each sub-region in each frame according to the coordinate information of each pixel point in the display mark in each sub-region and the simulated color map in each frame;

[0231] According to the display state, the target sub-region to be displayed corresponding to each frame is determined, and the display color of each target sub-region is determined according to the display color, and the display identifier of each target sub-region is rendered and displayed according to the display color of each target sub-region.

[0232] Optionally, the rendering module 130 is specifically configured to determine brightness information corresponding to the abscissa of each sub-region in the display effect map according to the abscissa information of each sub-region and the abscissa information of the motion effect map;

[0233] The display status of the display identifier in each sub-region is determined according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information in the display effect map corresponding to the abscissa of each sub-region.

[0234] Optionally, the rendering module 130 is specifically configured to determine that the display state of the display identifier in the sub-region is display if the ordinate information corresponding to the abscissa of the sub-region is less than the brightness information corresponding to the abscissa of the sub-region in the display effect map;

[0235] If the ordinate information corresponding to the abscissa of the sub-region is greater than or equal to the brightness information corresponding to the abscissa of the sub-region in the display effect map, it is determined that the display state of the display mark in the sub-region is not displayed.

[0236] Optionally, the rendering module 130 is specifically configured to determine a sub-region in which the display status of the display identifier in the sub-region is displayed as a target sub-region to be displayed.

[0237] Optionally, the rendering module 130 is specifically configured to read the map color corresponding to the coordinate information of each pixel point in the display mark in the sub-region from the simulated color map according to the coordinate information of each pixel point in the display mark in the sub-region;

[0238] The display color of the display mark in the sub-region is determined according to the map color corresponding to the coordinate information of each pixel point in the display mark in the sub-region.

[0239] Optionally, the rendering module 130 is specifically configured to determine the display brightness of the display mark in each target sub-region according to the ordinate information of each target sub-region and a preset height threshold;

[0240] The display mark of each target sub-region is rendered and displayed according to the display color and display brightness of each target sub-region.

[0241] Optionally, the rendering module 130 is specifically configured to determine that the display brightness of the display mark in the target sub-region is the target brightness if the ordinate information of the target sub-region is greater than the height threshold.

[0242] The above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital singnal processors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0243] The above modules can be connected or communicated with each other via a wired connection or a wireless connection. The wired connection may include a metal cable, an optical cable, a hybrid cable, etc., or any combination thereof. The wireless connection may include a connection in the form of a LAN, a WAN, Bluetooth, a ZigBee, or NFC, or any combination thereof. Two or more modules may be combined into a single module, and any one module may be divided into two or more units. Those skilled in the art will clearly understand that for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the method embodiment, and will not be repeated in this application.

[0244] Fig.25 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application includes: a processor 801, a storage medium 802 and a bus 803, wherein the storage medium 802 stores machine-readable instructions executable by the processor 801. When the electronic device runs an information processing method in the embodiment, the processor 801 communicates with the storage medium 802 through the bus 803, and the processor 801 executes the machine-readable instructions to perform the following steps:

[0245] Get the base map and construct the coordinate system corresponding to the base map;

[0246] Divide the base map based on the coordinate system, generate multiple sub-areas corresponding to the base map, and generate a display mark of a preset size for each sub-area;

[0247] Generate a motion effect map for representing the display effect of each frame according to preset audio properties;

[0248] According to the coordinate information of each sub-region and the motion effect map, the target sub-region to be displayed corresponding to each frame is determined, and the display identifier of each target sub-region corresponding to each frame is rendered and displayed.

[0249] In a feasible implementation manner, when the processor 801 divides the base map based on the coordinate system to generate multiple sub-areas corresponding to the base map, it is specifically used to: perform a decimal operation on each horizontal coordinate in the base map to divide the horizontal axis of the base map into multiple intervals;

[0250] Perform decimal operation on each vertical coordinate in the base map, and divide the vertical axis of the base map into multiple intervals;

[0251] A plurality of sub-regions corresponding to the base map are generated according to the plurality of intervals divided by the horizontal axis of the base map and the pairs of intervals divided by the vertical axis.

[0252] In a feasible implementation scheme, when the processor 801 generates a motion effect map for representing the display effect of each frame according to the preset audio attribute, it is specifically used to: generate a display effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0253] According to a preset first adjustment parameter, the horizontal coordinate information of each pixel point in the base map of the current frame is adjusted to generate the horizontal coordinate information of each pixel point in the base map of the next frame;

[0254] Generate a display effect map corresponding to the audio in the next frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the next frame;

[0255] A motion effect map is generated according to the display effect maps corresponding to each continuous frame.

[0256] In a feasible implementation scheme, when the processor 801 generates a display effect map corresponding to the audio in the current frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame, it is specifically used to: generate a waveform effect map corresponding to the audio in the current frame and a target peak effect map corresponding to the audio according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0257] A display effect map corresponding to the audio in the current frame is generated according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map.

[0258] In a feasible implementation scheme, the audio attributes include: an audio waveform curve and an audio peak curve; when the processor 801 generates a waveform effect map and a target peak effect map corresponding to the audio in the current frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame, the processor 801 is specifically used to:

[0259] Generate a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0260] Generate an initial peak effect map corresponding to the audio in the current frame according to the audio peak curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0261] Generate a reverse wave crest effect map corresponding to the initial wave crest effect map according to the initial wave crest effect map and a preset second adjustment parameter;

[0262] According to the initial peak effect map and the reverse peak effect map, a target peak effect map corresponding to the audio in the current frame is generated.

[0263] In a feasible implementation scheme, when the processor 801 generates a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame, it is specifically used to: determine the vertical coordinate information corresponding to each pixel point in the audio waveform curve according to the horizontal coordinate information of the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map; the vertical coordinate information in the audio waveform curve is used to indicate the height of the fluctuation;

[0264] Determine the brightness information of each pixel point according to the ordinate information of each pixel point in the audio waveform curve;

[0265] According to the brightness information of each pixel point, a waveform effect map corresponding to the audio in the current frame is generated. The horizontal coordinate of the waveform effect map corresponds to the horizontal coordinate of the audio waveform curve, and the vertical coordinate of the waveform effect map is used to indicate the brightness.

[0266] In a feasible implementation scheme, when the processor 801 generates a reverse peak effect map corresponding to the initial peak effect map according to the initial peak effect map and the preset second adjustment parameter, it is specifically used to: according to the initial peak effect map and the second adjustment parameter, move the horizontal coordinate of the initial peak effect map in the opposite direction to generate a reverse peak effect map corresponding to the initial peak effect map.

[0267] In a feasible implementation scheme, when the processor 801 generates a display effect map corresponding to the audio in the current frame according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map, it is specifically used to: multiply the first ordinate information and the second ordinate information corresponding to each same horizontal coordinate in the waveform effect map and the target peak effect map, to obtain new ordinate information corresponding to each horizontal coordinate;

[0268] A display effect map corresponding to the audio in the previous frame is generated according to each horizontal coordinate and the new vertical coordinate information corresponding to each horizontal coordinate.

[0269] In a feasible implementation scheme, when the processor 801 determines the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and renders the display identifier of each target sub-region corresponding to each frame, it is specifically used to: generate a simulated color map under each frame according to the information of each horizontal coordinate in the basic map, the position information of the central axis of the basic map and the preset third adjustment parameter;

[0270] According to the coordinate information of each sub-area, the coordinate information of each pixel in the display identifier of each sub-area, the motion effect map and the simulated color map under each frame, the target sub-area to be displayed corresponding to each frame and the display attributes of each target sub-area are determined, and the display identifier of each target sub-area is rendered and displayed according to the display attributes of each target sub-area.

[0271] In a feasible implementation manner, when the processor 801 generates the simulated color map in each frame according to the information of each horizontal coordinate in the base map, the position information of the central axis of the base map and the preset third adjustment parameter, it is specifically used to: determine the distance between each vertical axis and the central axis in the base map in the current frame according to the horizontal coordinate information of the base map in the current frame and the position information of the central axis of the base map;

[0272] Generate a simulated color map in the current frame according to the distance between each vertical axis and the central axis in the base map in the current frame;

[0273] According to a preset third adjustment parameter, the horizontal coordinate information of the basic map in the current frame is adjusted to generate the horizontal coordinate information of the basic map in the next frame;

[0274] The simulated color map for the next frame is generated according to the horizontal coordinate information of the base map for the next frame and the position information of the central axis.

[0275] In a feasible implementation, when the processor 801 generates the simulated color map of the current frame according to the distance between each vertical axis and the central axis in the base map of the current frame, it is specifically used to: determine the color gradient degree of each vertical axis according to the distance between each vertical axis and the central axis;

[0276] Determine the color information of each pixel point on each vertical axis according to the color gradient degree of each vertical axis and the preset first color and second color;

[0277] A simulated color map under the current frame is generated according to the horizontal coordinate information of each pixel point and the determined color information of each pixel point.

[0278] In a feasible implementation scheme, the processor 801 is specifically used to: determine the display state of the display mark in each sub-region under each frame according to the coordinate information of each sub-region, the coordinate information of each pixel point in the display mark in each sub-region, the motion effect map and the simulated color map under each frame, determine the target sub-region to be displayed and the display attributes of each target sub-region corresponding to each frame, and render and display the display mark of each target sub-region according to the display attributes of each target sub-region. The display state includes: display or non-display;

[0279] Determine the display color of the display mark in each sub-region in each frame according to the coordinate information of each pixel point in the display mark in each sub-region and the simulated color map in each frame;

[0280] According to the display state, the target sub-region to be displayed corresponding to each frame is determined, and the display color of each target sub-region is determined according to the display color, and the display identifier of each target sub-region is rendered and displayed according to the display color of each target sub-region.

[0281] In a feasible implementation scheme, when the processor 801 determines the display status of the display identifier in each sub-region under each frame according to the coordinate information of each sub-region and the display effect map under each frame, it is specifically used to: determine the brightness information corresponding to the horizontal coordinate of each sub-region in the display effect map according to the horizontal coordinate information of each sub-region and the horizontal coordinate information of the display effect map;

[0282] The display status of the display identifier in each sub-region is determined according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information in the display effect map corresponding to the abscissa of each sub-region.

[0283] In a feasible implementation manner, when the processor 801 determines the display state of the display identifier in each sub-region according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information corresponding to the abscissa of each sub-region in the display effect map, it is specifically used to: if the ordinate information corresponding to the abscissa of the sub-region is less than the brightness information corresponding to the abscissa of the sub-region in the display effect map, determine that the display state of the display identifier in the sub-region is display;

[0284] If the ordinate information corresponding to the abscissa of the sub-region is greater than or equal to the brightness information corresponding to the abscissa of the sub-region in the display effect map, it is determined that the display state of the display mark in the sub-region is not displayed.

[0285] In a feasible implementation manner, when the processor 801 determines the target sub-region to be displayed corresponding to each frame according to the display state, it is specifically used to: determine the sub-region whose display state of the display identifier in the sub-region is displayed as the target sub-region to be displayed.

[0286] In a feasible implementation manner, when the processor 801 determines the display color of the display identifier in each sub-region under each frame according to the coordinate information of each pixel point in the display identifier in each sub-region and the simulated color map under each frame, it is specifically used to: read the map color corresponding to the coordinate information of each pixel point in the display identifier in the sub-region from the simulated color map according to the coordinate information of each pixel point in the display identifier in the sub-region;

[0287] The display color of the display mark in the sub-region is determined according to the map color corresponding to the coordinate information of each pixel point in the display mark in the sub-region.

[0288] In a feasible implementation manner, when the processor 801 performs rendering and displaying the display mark of each target sub-region according to the display color of each target sub-region, it is specifically used to: determine the display brightness of the display mark in each target sub-region according to the vertical coordinate information of each target sub-region and a preset height threshold;

[0289] The display mark of each target sub-region is rendered and displayed according to the display color and display brightness of each target sub-region.

[0290] In a feasible implementation scheme, when the processor 801 determines the display brightness of the display marker in each target sub-area based on the vertical coordinate information of each target sub-area and a preset height threshold, it is specifically used to: if the vertical coordinate information of the target sub-area is greater than the height threshold, then determine that the display brightness of the display marker in the target sub-area is the target brightness.

[0291] The storage medium 802 stores program code, and when the program code is executed by the processor 801, the processor 801 executes various steps of the information processing method according to various exemplary embodiments of the present application described in the above “Exemplary Method” section of this specification.

[0292] Processor 801 can be a general-purpose processor, such as a central processing unit (CPU), a digital signal processor (DigitalSignal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor can be a microprocessor or any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present application can be directly embodied as a hardware processor to be executed, or a combination of hardware and software modules in the processor can be executed.

[0293] Storage medium 802, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer executable programs and modules. The memory may include at least one type of storage medium, such as flash memory, hard disk, multimedia card, card-type memory, random access memory (Random Access Memory, RAM), static random access memory (Static Random Access Memory, SRAM), programmable read-only memory (Programmable Read Only Memory, PROM), read-only memory (Read Only Memory, ROM), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory, EEPROM), magnetic memory, disk, optical disk, etc. The memory is any other medium that can be used to carry or store a desired program code in the form of an instruction or data structure and can be accessed by a computer, but is not limited thereto. The storage medium 802 in the embodiment of the present application can also be a circuit or any other device that can realize a storage function, for storing program instructions and / or data.

[0294] Optionally, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the processor performs the following steps:

[0295] Get the base map and construct the coordinate system corresponding to the base map;

[0296] Divide the base map based on the coordinate system, generate multiple sub-areas corresponding to the base map, and generate a display mark of a preset size for each sub-area;

[0297] Generate a motion effect map for representing the display effect of each frame according to preset audio properties;

[0298] According to the coordinate information of each sub-region and the motion effect map, the target sub-region to be displayed corresponding to each frame is determined, and the display identifier of each target sub-region corresponding to each frame is rendered and displayed.

[0299] In a feasible implementation manner, when the processor 801 divides the base map based on the coordinate system to generate multiple sub-areas corresponding to the base map, it is specifically used to: perform a decimal operation on each horizontal coordinate in the base map to divide the horizontal axis of the base map into multiple intervals;

[0300] Perform decimal operation on each vertical coordinate in the base map, and divide the vertical axis of the base map into multiple intervals;

[0301] A plurality of sub-regions corresponding to the base map are generated according to the plurality of intervals divided by the horizontal axis of the base map and the pairs of intervals divided by the vertical axis.

[0302] In a feasible implementation scheme, when the processor 801 generates a motion effect map for representing the display effect of each frame according to the preset audio attribute, it is specifically used to: generate a display effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0303] According to a preset first adjustment parameter, the horizontal coordinate information of each pixel point in the base map of the current frame is adjusted to generate the horizontal coordinate information of each pixel point in the base map of the next frame;

[0304] Generate a display effect map corresponding to the audio in the next frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the next frame;

[0305] A motion effect map is generated according to the display effect maps corresponding to each continuous frame.

[0306] In a feasible implementation scheme, when the processor 801 generates a display effect map corresponding to the audio in the current frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame, it is specifically used to: generate a waveform effect map corresponding to the audio in the current frame and a target peak effect map corresponding to the audio according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0307] A display effect map corresponding to the audio in the current frame is generated according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map.

[0308] In a feasible implementation scheme, the audio attributes include: an audio waveform curve and an audio peak curve; when the processor 801 generates a waveform effect map and a target peak effect map corresponding to the audio in the current frame according to the audio attributes and the horizontal coordinate information of each pixel point in the basic map in the current frame, the processor 801 is specifically used to:

[0309] Generate a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0310] Generate an initial peak effect map corresponding to the audio in the current frame according to the audio peak curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame;

[0311] Generate a reverse wave crest effect map corresponding to the initial wave crest effect map according to the initial wave crest effect map and a preset second adjustment parameter;

[0312] According to the initial peak effect map and the reverse peak effect map, a target peak effect map corresponding to the audio in the current frame is generated.

[0313] In a feasible implementation scheme, when the processor 801 generates a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame, it is specifically used to: determine the vertical coordinate information corresponding to each pixel point in the audio waveform curve according to the horizontal coordinate information of the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map; the vertical coordinate information in the audio waveform curve is used to indicate the height of the fluctuation;

[0314] Determine the brightness information of each pixel point according to the ordinate information of each pixel point in the audio waveform curve;

[0315] According to the brightness information of each pixel point, a waveform effect map corresponding to the audio in the current frame is generated. The horizontal coordinate of the waveform effect map corresponds to the horizontal coordinate of the audio waveform curve, and the vertical coordinate of the waveform effect map is used to indicate the brightness.

[0316] In a feasible implementation scheme, when the processor 801 generates a reverse peak effect map corresponding to the initial peak effect map according to the initial peak effect map and the preset second adjustment parameter, it is specifically used to: according to the initial peak effect map and the second adjustment parameter, move the horizontal coordinate of the initial peak effect map in the opposite direction to generate a reverse peak effect map corresponding to the initial peak effect map.

[0317] In a feasible implementation scheme, when the processor 801 generates a display effect map corresponding to the audio in the current frame according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map, it is specifically used to: multiply the first ordinate information and the second ordinate information corresponding to each same horizontal coordinate in the waveform effect map and the target peak effect map, to obtain new ordinate information corresponding to each horizontal coordinate;

[0318] A display effect map corresponding to the audio in the previous frame is generated according to each horizontal coordinate and the new vertical coordinate information corresponding to each horizontal coordinate.

[0319] In a feasible implementation scheme, when the processor 801 determines the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and renders the display identifier of each target sub-region corresponding to each frame, it is specifically used to: generate a simulated color map under each frame according to the information of each horizontal coordinate in the basic map, the position information of the central axis of the basic map and the preset third adjustment parameter;

[0320] According to the coordinate information of each sub-area, the coordinate information of each pixel in the display identifier of each sub-area, the motion effect map and the simulated color map under each frame, the target sub-area to be displayed corresponding to each frame and the display attributes of each target sub-area are determined, and the display identifier of each target sub-area is rendered and displayed according to the display attributes of each target sub-area.

[0321] In a feasible implementation manner, when the processor 801 generates the simulated color map in each frame according to the information of each horizontal coordinate in the base map, the position information of the central axis of the base map and the preset third adjustment parameter, it is specifically used to: determine the distance between each vertical axis and the central axis in the base map in the current frame according to the horizontal coordinate information of the base map in the current frame and the position information of the central axis of the base map;

[0322] Generate a simulated color map in the current frame according to the distance between each vertical axis and the central axis in the base map in the current frame;

[0323] According to a preset third adjustment parameter, the horizontal coordinate information of the basic map in the current frame is adjusted to generate the horizontal coordinate information of the basic map in the next frame;

[0324] The simulated color map for the next frame is generated according to the horizontal coordinate information of the base map for the next frame and the position information of the central axis.

[0325] In a feasible implementation, when the processor 801 generates the simulated color map of the current frame according to the distance between each vertical axis and the central axis in the base map of the current frame, it is specifically used to: determine the color gradient degree of each vertical axis according to the distance between each vertical axis and the central axis;

[0326] Determine the color information of each pixel point on each vertical axis according to the color gradient degree of each vertical axis and the preset first color and second color;

[0327] A simulated color map under the current frame is generated according to the horizontal coordinate information of each pixel point and the determined color information of each pixel point.

[0328] In a feasible implementation scheme, the processor 801 is specifically used to: determine the display state of the display mark in each sub-region under each frame according to the coordinate information of each sub-region, the coordinate information of each pixel point in the display mark in each sub-region, the motion effect map and the simulated color map under each frame, determine the target sub-region to be displayed and the display attributes of each target sub-region corresponding to each frame, and render and display the display mark of each target sub-region according to the display attributes of each target sub-region. The display state includes: display or non-display;

[0329] Determine the display color of the display mark in each sub-region in each frame according to the coordinate information of each pixel point in the display mark in each sub-region and the simulated color map in each frame;

[0330] According to the display state, the target sub-region to be displayed corresponding to each frame is determined, and the display color of each target sub-region is determined according to the display color, and the display identifier of each target sub-region is rendered and displayed according to the display color of each target sub-region.

[0331] In a feasible implementation scheme, when the processor 801 determines the display status of the display identifier in each sub-region under each frame according to the coordinate information of each sub-region and the display effect map under each frame, it is specifically used to: determine the brightness information corresponding to the horizontal coordinate of each sub-region in the display effect map according to the horizontal coordinate information of each sub-region and the horizontal coordinate information of the display effect map;

[0332] The display status of the display identifier in each sub-region is determined according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information in the display effect map corresponding to the abscissa of each sub-region.

[0333] In a feasible implementation manner, when the processor 801 determines the display state of the display identifier in each sub-region according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information corresponding to the abscissa of each sub-region in the display effect map, it is specifically used to: if the ordinate information corresponding to the abscissa of the sub-region is less than the brightness information corresponding to the abscissa of the sub-region in the display effect map, determine that the display state of the display identifier in the sub-region is display;

[0334] If the ordinate information corresponding to the abscissa of the sub-region is greater than or equal to the brightness information corresponding to the abscissa of the sub-region in the display effect map, it is determined that the display state of the display mark in the sub-region is not displayed.

[0335] In a feasible implementation manner, when the processor 801 determines the target sub-region to be displayed corresponding to each frame according to the display state, it is specifically used to: determine the sub-region whose display state of the display identifier in the sub-region is displayed as the target sub-region to be displayed.

[0336] In a feasible implementation manner, when the processor 801 determines the display color of the display identifier in each sub-region under each frame according to the coordinate information of each pixel point in the display identifier in each sub-region and the simulated color map under each frame, it is specifically used to: read the map color corresponding to the coordinate information of each pixel point in the display identifier in the sub-region from the simulated color map according to the coordinate information of each pixel point in the display identifier in the sub-region;

[0337] The display color of the display mark in the sub-region is determined according to the map color corresponding to the coordinate information of each pixel point in the display mark in the sub-region.

[0338] In a feasible implementation manner, when the processor 801 performs rendering and displaying the display mark of each target sub-region according to the display color of each target sub-region, it is specifically used to: determine the display brightness of the display mark in each target sub-region according to the vertical coordinate information of each target sub-region and a preset height threshold;

[0339] The display mark of each target sub-region is rendered and displayed according to the display color and display brightness of each target sub-region.

[0340] In a feasible implementation scheme, when the processor 801 determines the display brightness of the display marker in each target sub-area based on the vertical coordinate information of each target sub-area and a preset height threshold, it is specifically used to: if the vertical coordinate information of the target sub-area is greater than the height threshold, then determine that the display brightness of the display marker in the target sub-area is the target brightness.

[0341] In the embodiment of the present application, the computer program can also execute other machine-readable instructions when run by the processor to execute other methods described in the embodiment. For the specific execution method steps and principles, please refer to the description of the embodiment, which will not be repeated here.

[0342] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0343] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0344] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0345] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor (English: processor) to perform some steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (English: Read-Only Memory, abbreviated: ROM), random access memory (English: Random Access Memory, abbreviated: RAM), disk or optical disk and other media that can store program codes.

Claims

1. A method of information processing, characterized in that: include: Obtain a base map and construct a coordinate system corresponding to the base map; Dividing the basic map based on the coordinate system to generate a plurality of sub-regions corresponding to the basic map, and generating a display mark of a preset size for each sub-region; Generate a motion effect map for representing the display effect of each frame according to preset audio properties; According to the coordinate information of each sub-region and the motion effect map, the target sub-region to be displayed corresponding to each frame is determined, and the display identifier of each target sub-region corresponding to each frame is rendered and displayed.

2. The method according to claim 1, characterized in that The step of dividing the base map based on the coordinate system to generate a plurality of sub-areas corresponding to the base map includes: Performing a decimal operation on each horizontal coordinate in the base map, dividing the horizontal axis of the base map into a plurality of intervals; Performing a decimal operation on each vertical coordinate in the base map, dividing the vertical axis of the base map into a plurality of intervals; A plurality of sub-areas corresponding to the basic map are generated according to the plurality of intervals divided by the horizontal axis of the basic map and the two intervals divided by the vertical axis.

3. The method according to claim 1, characterized in that The step of generating a motion effect map for representing the display effect of each frame according to the preset audio attribute includes: Generate a display effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame; According to a preset first adjustment parameter, the horizontal coordinate information of each pixel point in the basic map in the current frame is adjusted to generate the horizontal coordinate information of each pixel point in the basic map in the next frame; Generate a display effect map corresponding to the audio in the next frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the next frame; The motion effect map is generated according to the display effect maps corresponding to each continuous frame.

4. The method according to claim 3, characterized in that Generating a display effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame includes: Generate a waveform effect map corresponding to the audio in the current frame and a target peak effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame; A display effect map corresponding to the audio in the current frame is generated according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map.

5. The method according to claim 4, characterized in that The audio attributes include: an audio waveform curve and an audio peak curve; The step of generating a waveform effect map and a target peak effect map corresponding to the audio in the current frame according to the audio attribute and the horizontal coordinate information of each pixel point in the basic map in the current frame respectively comprises: Generate a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame; Generate an initial peak effect map corresponding to the audio in the current frame according to the audio peak curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame; According to the initial wave crest effect map and the preset second adjustment parameter, a reverse wave crest effect map corresponding to the initial wave crest effect map is generated; A target peak effect map corresponding to the audio in the current frame is generated according to the initial peak effect map and the reverse peak effect map.

6. The method according to claim 5, characterized in that The step of generating a waveform effect map corresponding to the audio in the current frame according to the audio waveform curve in the current frame and the horizontal coordinate information of each pixel point in the basic map in the current frame comprises: Determine the ordinate information of each pixel point in the audio waveform curve corresponding to the audio waveform curve according to the abscissa information of the audio waveform curve in the current frame and the abscissa information of each pixel point in the basic map; the ordinate information in the audio waveform curve is used to indicate the height of the fluctuation; Determine brightness information of each pixel point according to the ordinate information of each pixel point in the audio waveform curve; According to the brightness information of each pixel point, a waveform effect map corresponding to the audio in the current frame is generated, the horizontal coordinate of the waveform effect map corresponds to the horizontal coordinate of the audio waveform curve, and the vertical coordinate of the waveform effect map is used to indicate the brightness.

7. The method according to claim 5, characterized in that The step of generating a reverse wave crest effect map corresponding to the initial wave crest effect map according to the initial wave crest effect map and a preset second adjustment parameter includes: According to the initial wave peak effect map and the second adjustment parameter, the horizontal coordinate of the initial wave peak effect map is moved in the opposite direction to generate a reverse wave peak effect map corresponding to the initial wave peak effect map.

8. The method according to claim 4, characterized in that The step of generating a display effect map corresponding to the audio in the current frame according to the waveform effect map corresponding to the audio in the current frame and the target peak effect map comprises: Multiplying the first ordinate information and the second ordinate information corresponding to each same horizontal coordinate in the waveform effect map and the target peak effect map, respectively, to obtain new ordinate information corresponding to each horizontal coordinate; A display effect map corresponding to the audio in the previous frame is generated according to each horizontal coordinate and the new vertical coordinate information corresponding to each horizontal coordinate.

9. The method according to claim 3, characterized in that: The step of determining the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and rendering and displaying the display identifier of each target sub-region corresponding to each frame, includes: Generate a simulated color map for each frame according to information of each horizontal coordinate in the base map, position information of the central axis of the base map, and a preset third adjustment parameter; According to the coordinate information of each sub-area, the coordinate information of each pixel in the display identifier of each sub-area, the motion effect map and the simulated color map under each frame, the target sub-area to be displayed corresponding to each frame and the display attributes of each target sub-area are determined, and the display identifier of each target sub-area is rendered and displayed according to the display attributes of each target sub-area.

10. The method according to claim 9, characterized in that The step of generating a simulated color map for each frame according to information of each horizontal coordinate in the base map, position information of the central axis of the base map, and a preset third adjustment parameter includes: Determine the distance between each vertical axis in the base map in the current frame and the central axis according to the horizontal coordinate information of the base map in the current frame and the position information of the central axis of the base map; Generate a simulated color map in the current frame according to the distance between each vertical axis and the central axis in the basic map in the current frame; According to the preset third adjustment parameter, adjusting the horizontal coordinate information of the basic map in the current frame to generate the horizontal coordinate information of the basic map in the next frame; A simulated color map for the next frame is generated according to the horizontal coordinate information of the basic map for the next frame and the position information of the central axis.

11. The method according to claim 10, characterized in that The step of generating a simulated color map in the current frame according to the distances between each vertical axis and the central axis in the basic map in the current frame comprises: Determining the color gradient of each vertical axis according to the distance between each vertical axis and the central axis; Determine the color information of each pixel point on each vertical axis according to the color gradient degree of each vertical axis and the preset first color and second color; A simulated color map under the current frame is generated according to the horizontal coordinate information of each pixel point and the determined color information of each pixel point.

12. The method according to claim 9, characterized in that The step of determining the target sub-region to be displayed and the display attributes of each target sub-region corresponding to each frame according to the coordinate information of each sub-region, the coordinate information of each pixel in the display identifier of each sub-region, the motion effect map, and the simulated color map under each frame, and rendering and displaying the display identifier of each target sub-region according to the display attributes of each target sub-region includes: Determine the display status of the display mark in each sub-region in each frame according to the coordinate information of each sub-region and the display effect map in each frame; the display status includes: display or non-display; Determine the display color of the display mark in each sub-region in each frame according to the coordinate information of each pixel point in the display mark in each sub-region and the simulated color map in each frame; According to the display state, the target sub-region to be displayed corresponding to each frame is determined, and the display color of each target sub-region is determined according to the display color, and the display identifier of each target sub-region is rendered and displayed according to the display color of each target sub-region.

13. The method according to claim 12, characterized in that Determining the display status of the display identifier in each sub-region in each frame according to the coordinate information of each sub-region and the display effect map in each frame includes: Determine, according to the abscissa information of each sub-region and the abscissa information of the display effect map, the brightness information in the display effect map corresponding to the abscissa of each sub-region; The display status of the display identifier in each sub-region is determined according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information in the display effect map corresponding to the abscissa of each sub-region.

14. The method according to claim 13, characterized in that The determining the display status of the display identifier in each sub-region according to the ordinate information corresponding to the abscissa of each sub-region and the brightness information in the display effect map corresponding to the abscissa of each sub-region includes: If the ordinate information corresponding to the abscissa of the sub-region is smaller than the brightness information corresponding to the abscissa of the sub-region in the display effect map, then determining that the display state of the display identifier in the sub-region is display; If the ordinate information corresponding to the abscissa of the sub-region is greater than or equal to the brightness information corresponding to the abscissa of the sub-region in the display effect map, it is determined that the display state of the display mark in the sub-region is not displayed.

15. The method according to claim 12, characterized in that The step of determining the target sub-region to be displayed corresponding to each frame according to the display state includes: The sub-region whose display status of the display identifier in the sub-region is displayed is determined as the target sub-region to be displayed.

16. The method according to claim 12, characterized in that Determining the display color of the display mark in each sub-region in each frame according to the coordinate information of each pixel point in the display mark in each sub-region and the simulated color map in each frame includes: According to the coordinate information of each pixel point in the display mark in the sub-region, reading the map color corresponding to the coordinate information of each pixel point in the display mark in the sub-region from the simulated color map; The display color of the display mark in the sub-area is determined according to the map color corresponding to the coordinate information of each pixel point in the display mark in the sub-area.

17. The method according to claim 12, characterized in that The step of rendering and displaying the display identifier of each target sub-region according to the display color of each target sub-region also includes: Determining the display brightness of the display mark in each target sub-region according to the ordinate information of each target sub-region and a preset height threshold; The display identifier of each target sub-region is rendered and displayed according to the display color and display brightness of each target sub-region.

18. The method according to claim 17, characterized in that The step of determining the display brightness of the display mark in each target sub-region according to the ordinate information of each target sub-region and a preset height threshold comprises: If the ordinate information of the target sub-region is greater than the height threshold, the display brightness of the display mark in the target sub-region is determined to be the target brightness.

19. An information processing device, characterized in that: include: Building modules, generating modules, and rendering modules; The construction module is used to obtain a base map and construct a coordinate system corresponding to the base map; The generating module is used to divide the basic map based on the coordinate system, generate a plurality of sub-regions corresponding to the basic map, and generate a display mark of a preset size for each sub-region; The generating module is used to generate a motion effect map for representing the display effect of each frame according to the preset audio attribute; The rendering module is used to determine the target sub-region to be displayed corresponding to each frame according to the coordinate information of each sub-region and the motion effect map, and render and display the display identifier of each target sub-region corresponding to each frame.

20. An electronic device, characterized in that: include: A processor, a storage medium and a bus, wherein the storage medium stores program instructions executable by the processor, and when the electronic device is running, the processor and the storage medium communicate through the bus, and the processor executes the program instructions to perform the information processing method as described in any one of claims 1 to 18.

21. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by the processor, the information processing method according to any one of claims 1 to 18 is executed.

Images