Information processing method and device, computer equipment and computer readable storage medium

Abstract

Embodiments of the present application disclose an information processing method and device, computer equipment and a computer readable storage medium. The method comprises: obtaining a music description file corresponding to target game audio in a target game and extracting a plurality of audio information; obtaining a plurality of operation prompt identifiers required to be bound by the music description file; binding the plurality of audio information and the plurality of operation prompt identifiers; playing the target game audio in the target game; and displaying operation prompt identifiers of each note element in the music description file on a game interface of the target game based on the plurality of operation prompt identifiers, the plurality of audio information, and a corresponding binding relationship. In the embodiments of the present application, corresponding operation prompt identifiers can be displayed on the game interface synchronously when the game audio is played, thereby improving the efficiency of music game production and enhancing the interactive effect of game players in the music game.

Description

Technical Field

[0001] This application relates to the field of computer technology, and more particularly to the field of game technology, specifically to an information processing method, apparatus, computer device, and computer-readable storage medium. Background Technology

[0002] To satisfy people's pursuit of spiritual enrichment, entertainment applications that can be operated on terminals have emerged. For example, games such as Multiplayer Online Battle Arena (MOBA), Massive Multiplayer Online (MMO), and music games, which are developed based on client or server architecture, are very popular among users due to their high smoothness, good operation, and real-time gameplay.

[0003] Currently, game developers creating music games typically need to ensure that the on-screen prompts and sound elements are synchronized. Existing technology usually involves exporting the time sequence of each sound element from an audio file and displaying prompts based on this sequence to guide players to tap the screen at the appropriate time to trigger the corresponding sound. However, existing methods can lead to desynchronization between sound playback and on-screen display when issues arise, such as network lag or loading errors between sound elements and prompts. This results in low production efficiency and poor player interaction in music games. Summary of the Invention

[0004] This application provides an information processing method, apparatus, computer device, and computer-readable storage medium. Game developers only need to parse the music description file of the target game audio in the music game and extract information from the music description file, thereby converting the game audio into operation prompts. This ensures that when the game audio is played, the corresponding operation prompts are displayed synchronously on the game interface, improving the efficiency of music game production and enhancing the interactive effect for game players in music games.

[0005] This application provides an information processing method, the method comprising:

[0006] Obtain the music description file corresponding to the audio of the target game;

[0007] Extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate the operation of the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation of the operation prompt icon corresponding to the note element.

[0008] Obtain the multiple operation prompt icons that need to be bound to the music description file;

[0009] The multiple audio information items are bound to the multiple operation prompt icons to determine the binding relationship between each audio information item in the music description file and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to each note element in the music description file;

[0010] In response to a playback command for the target game audio, the target game audio is played in the target game, and based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships, the operation prompt icons of each note element in the music description file are displayed on the game interface of the target game.

[0011] Accordingly, embodiments of this application also provide an information processing apparatus, which includes:

[0012] The first acquisition unit is used to acquire the music description file corresponding to the audio of the target game in the target game;

[0013] An extraction unit is used to extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate an operation on the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation on the operation prompt icon corresponding to the note element.

[0014] The second acquisition unit is used to acquire multiple operation prompt identifiers that need to be bound to the music description file;

[0015] The processing unit is used to bind the plurality of audio information with the plurality of operation prompt identifiers, determine the binding relationship between each audio information in the music description file and the corresponding operation prompt identifier, and bind the corresponding operation prompt identifier to each note element in the music description file;

[0016] The response unit is configured to respond to a playback command for the target game audio, play the target game audio in the target game, and display the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships.

[0017] Accordingly, this application also provides a computer device, including a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program, when executed by the processor, implements any of the information processing methods described above.

[0018] Accordingly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements any of the information processing methods described above.

[0019] This application provides an information processing method, apparatus, computer device, and computer-readable storage medium. The method involves: acquiring a music description file corresponding to audio in a target game; extracting multiple audio information items from the music description file, where each audio information item corresponds to a note element; the audio information item including a playback time point and a playback duration; the playback time point indicating an operation prompt corresponding to the note element; the playback duration indicating the duration of the operation prompt corresponding to the note element; acquiring multiple operation prompts to be bound to the music description file; binding the multiple audio information items to the multiple operation prompts to determine the binding relationship between each audio information item and its corresponding operation prompt, thus binding a corresponding operation prompt to each note element in the music description file; and finally, responding to a playback command for the target game audio, playing the target game audio in the target game and displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the multiple operation prompts, the multiple audio information items, and the corresponding binding relationships. In this embodiment, game developers only need to parse the music description file of the target game audio in the music game and extract information from the music description file. This allows them to convert the game audio into operation prompts, ensuring that the corresponding operation prompts are displayed synchronously on the game interface when the game audio is played. This improves the efficiency of music game production and enhances the interactive experience for game players in music games. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a schematic diagram of the information processing device provided in the embodiments of this application.

[0022] Figure 2 This is a flowchart illustrating an information processing method provided in an embodiment of this application.

[0023] Figure 3 This is a schematic diagram of a scenario of the information processing method provided in the embodiments of this application.

[0024] Figure 4 This is a schematic diagram of another scenario of the information processing method provided in the embodiments of this application.

[0025] Figure 5 This is a schematic diagram of another scenario of the information processing method provided in the embodiments of this application.

[0026] Figure 6 This is a schematic diagram of the structure of the information processing device provided in the embodiments of this application.

[0027] Figure 7 This is a schematic diagram of the structure of the computer device provided in the embodiments of this application. Detailed Implementation

[0028] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0029] In actual music game design projects, to ensure that the interactive elements displayed on the game screen are synchronized with the sound elements, game developers need to decode the signals in the music files, display them according to sample values, convert them into waveforms for visualization, calculate the beats per minute (BPM), and then align the converted waveforms using a grid before creating the score. This process often requires the technical team to develop a dedicated score editor for music games to facilitate score creation, thus consuming significant human resources, leading to high game development costs and long development cycles, resulting in low game production efficiency.

[0030] To address the aforementioned issues, embodiments of this application provide an information processing method, apparatus, computer device, and computer-readable storage medium. Game developers only need to use this information processing method to parse the music description file of the target game audio in the music game, extract information from the music description file, and thus convert the game audio into interactive game elements. These interactive game elements can then be displayed synchronously on the game interface while the game audio is playing. This eliminates the need for a large number of personnel to develop chart editing tools, reduces human resource consumption, lowers game development costs, effectively shortens the game development cycle, and thereby improves game production efficiency.

[0031] This application provides an information processing method, apparatus, computer device, and computer-readable storage medium. Specifically, the information processing method of this application can be executed by a computer device, which can be a terminal. The terminal can be a smartphone, tablet computer, laptop computer, touch screen, game console, personal computer (PC), personal digital assistant (PDA), or other terminal device. The terminal may also include a client, which can be a video application client, music application client, game application client, browser client carrying a game program, or instant messaging client, etc.

[0032] Please see Figure 1 , Figure 1This is a schematic diagram of an information processing system provided in an embodiment of this application. The system includes a computer device and may include at least one terminal, at least one server, and a network. A user-held terminal can connect to servers of different games via the network. The terminal is any device with computing hardware capable of supporting and executing software products corresponding to the game. Additionally, the terminal has one or more multi-touch screens for sensing and obtaining input from touch or swipe operations performed by the user at multiple points on one or more touch displays. Furthermore, when the system includes multiple terminals, multiple servers, and multiple networks, different terminals can connect to each other through different networks and different servers. The network can be a wireless network or a wired network, such as a wireless local area network (WLAN), local area network (LAN), cellular network, 2G network, 3G network, 4G network, 5G network, etc. Furthermore, different terminals can also connect to other terminals or servers using their own Bluetooth networks or hotspot networks.

[0033] The computer device can acquire a music description file corresponding to the audio of the target game, the music description file including audio information and display information of various game interactive elements displayed during the playback of the audio information; extract the display information of each game interactive element from the music description file, the display information including the display style, display time point, and total duration of the game interactive element; display the game interface of the target game and the interactive trigger area located in the game interface; when the playback of the target game audio is detected, display the corresponding game interactive element on the game interface according to the currently playing audio information.

[0034] It should be noted that, Figure 1 The schematic diagram of the information processing system shown is merely an example. The information processing system and scenario described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of information processing systems and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0035] This application provides an information processing method, apparatus, computer device, and computer-readable storage medium. The information processing method can be used with a terminal, such as a smartphone, tablet computer, laptop computer, or personal computer. The following provides a detailed description of the information processing method, apparatus, computer device, and storage medium. It should be noted that the order of description of the following embodiments is not intended to limit the preferred order of the embodiments.

[0036] Please see Figure 2 , Figure 2 A flowchart illustrating the information processing method provided in this application embodiment is shown. The specific process can be summarized in steps 101 to 105 as follows:

[0037] 101. Obtain the music description file corresponding to the audio of the target game.

[0038] To facilitate the extraction of music information from game audio, before the step "obtain the music description file corresponding to the target game audio", the method may include:

[0039] The target game audio is processed by audio track conversion to obtain multiple target audio tracks of the target game audio;

[0040] Based on the target audio track, generate a music description file corresponding to the target game audio.

[0041] The music description file refers to the Musical Instrument Digital Interface (MIDI) file. MIDI files use digital control signals for notes to record music and are a communication standard that enables the exchange of information and control signals between electronic audio devices. MIDI files are widely used in music production. They can be converted into visual notes using a digital audio workstation (DAW) designed for music production, allowing notation creators to directly edit notes within the DAW. Game developers can calculate the smallest time unit, "tick," of a MIDI file using beats per minute (BPM) data, and then determine the timing of each note being pressed and released through preset music events, thus converting it into the specific length of a visual note block.

[0042] Specifically, a MIDI file is a descriptive musical language that uses bytes (hexadecimal) to describe the musical information to be played. For example, it can show which instrument is used at a given moment, what note it begins with, and what tone it ends with. The MIDI file itself does not contain waveform data, making the information very concise. For instance, taking two bytes in a MIDI file as an example, in the dynamic byte "00 90 3C 64", 00 represents the dynamic byte's moment of 0, 90 represents that a note is pressed, 3C represents the note name (C4 on a piano keyboard), and 64 represents the velocity (the force at which the note is pressed is 64). In the dynamic byte "8C 18 80 3C 40", converting 8C 18 to decimal gives 1560, representing 1560 ticks. 80 indicates that note C4 is released, and 40 represents the velocity at which the note is released. From the two bytes mentioned above, we can infer that the music indicates the note C4 was pressed at time 0 and released after 1560 ticks. Therefore, by parsing the MIDI file, the occurrence time of each note can be detected, and the duration of each note block can be calculated.

[0043] In this embodiment, before the computer device obtains the music description file corresponding to the target game audio, the game developers can first use a Digital Audio Workstation (DAW) to create sheet music, calculate the beats per minute (BPM) of the music, create the sheet music based on this BPM, and finally export a standard format MIDI file. DAW software is used for recording, mixing, audio editing, and digital audio processing.

[0044] 102. Extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, the audio information includes a playback time point and a playback duration, the playback time point is used to indicate the operation of the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation of the operation prompt icon corresponding to the note element.

[0045] In this embodiment, the audio information corresponding to each note element in the game audio can be determined through the music description file, thereby determining the playback time point and playback duration of the note element corresponding to the audio information. The playback time point is used to prompt the player to trigger the operation prompt icon displayed on the graphical user interface provided by the computer device at the playback time point, and the playback duration is the duration for which the player is prompted to trigger the operation prompt icon displayed on the graphical user interface provided by the computer device at the playback time point. For example, the trigger operation can be a long press operation, and the duration is the duration for which the player performs the long press operation.

[0046] 103. Obtain the multiple operation prompt identifiers that need to be bound to the music description file.

[0047] To determine the display and motion information of operation prompt icons on the graphical user interface provided by the computer device, after the step "obtaining the multiple operation prompt icons to be bound to the music description file", the method may include:

[0048] The operation prompt icon is displayed on the game interface of the target game. The display information includes the display path length, the display time point, and the total existence duration. The display time point is the time when the operation prompt icon is displayed on the game interface of the target game. The game interface includes an interaction trigger area. The total existence duration is the total time from the initial generation of the operation prompt icon until it reaches the interaction trigger area. The interaction trigger area is used to indicate that when the operation prompt icon moves to the interaction trigger area, an operation is performed on the operation prompt icon.

[0049] Based on the display path length, the display time point, the total duration, and the playback time point of the audio information, determine the motion information of the operation prompt icon corresponding to the audio information.

[0050] In this embodiment, the computer device can display the operation prompt icons based on audio information and the display and motion information of the operation prompt icons, thereby aligning the operation prompt icons with the musical note elements. Specifically, the step "displaying the operation prompt icons of each musical note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationship" can include:

[0051] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0052] Based on the audio information, the display information and motion information corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed on the game interface of the target game, wherein the operation prompt icon moves towards the interaction trigger area on the game interface according to the corresponding display information and motion information.

[0053] Specifically, for a specific operation prompt icon, the playback time of the operation prompt icon can be set as t_start, the duration of the operation prompt icon from system start to movement to the interactive trigger area (total existence duration) can be set as t_trigger, and the duration of the operation prompt icon appearing on the game interface until movement to the interactive trigger area (display duration) can be set as t_drop. In this embodiment, t_start and t_trigger of the operation prompt icon can be obtained from the MIDI file, and t_drop can be calculated using the formula t_start = t_trigger - t_drop. Then, by obtaining the screen resolution of the terminal device currently running the target game, the path length S of the movement path of the operation prompt icon is determined based on the screen resolution. Next, the movement speed v of the operation prompt icon on the current terminal device can be calculated using the formula v = S / t_drop. Furthermore, to ensure that each operation prompt icon is deleted after moving for a certain period of time (after leaving the visible range), a `t_end` can be set, allowing the operation prompt icon to be recycled after `t_end`. Specifically, a time interval `t_add` can be added, where `t_end = t_triger + t_add`. Finally, a coordinate system can be established using the top-left corner of the terminal device as the origin, with the vertical downward direction as the positive y-axis and the horizontal rightward direction as the positive x-axis. The display position of each operation prompt icon on the game interface during movement can be calculated. For any time `t`, the operation prompt icon has its display position (X, Y) on the terminal screen. X can be the number of the moving track (e.g., ranging from 1 to 4), and the Y coordinate can be calculated using the following formula:

[0054]

[0055] Here, Y refers to the screen coordinates, and the label i (e.g., ranging from 1 to 4) represents 1 to 4 movement tracks. The operation prompt icon can move along this movement track towards the interaction trigger area. start The vertical coordinate represents the position at which the operation prompt icon is generated.

[0056] The path length S varies across devices with different resolutions due to variations in screen adaptation, resulting in slight differences in the falling speed. For example, on devices with an aspect ratio close to 1, the operation prompt icon moves faster due to the longer distance traveled. By setting different falling speeds for different devices, the movement time of the operation prompt icon is ensured to be the same across all device models. It should be noted that on the same type of device, the movement speed, distance, and time are identical for all operation prompt icons.

[0057] For example, please see Figure 3 The terminal device can display the game interface of the target game, which displays multiple operation prompt icons, movement tracks, and interactive trigger areas. The operation prompt icons may include a first operation prompt icon, a second operation prompt icon, and a third operation prompt icon. The movement tracks may include a first movement track, a second movement track, a third movement track, and a fourth movement track. The first operation prompt icon is located on the first movement track, the second operation prompt icon is located on the second movement track, and the third operation prompt icon is located on the fourth movement track.

[0058] In one specific embodiment, the computer device can handle the process of detecting whether the operation prompt icon and the interaction trigger area overlap independently from the main game thread. By creating a new thread to detect whether the operation prompt icon and the interaction trigger area overlap, it can prevent the main thread from failing to perform the above operation in time, thus preventing lag during the user's game. For example, after the step "responding to the playback command for the target game audio", it further includes:

[0059] Create an identifier detection thread;

[0060] The identifier detection thread receives and responds to the identifier detection instructions sent by the game rendering main thread, and detects in real time the operation prompt identifiers of each note element in the music description file and their positional relationship with the interaction trigger area.

[0061] For example, to ensure that the game interactive elements are synchronized with the game music when displayed on the game screen, a new thread can be opened at the bottom layer to run the update of the entire music game process. By using independent thread timing and callbacks, interference from the main thread and logic thread can be accurately avoided. For example, clock callbacks at 0.4s (with an error in the microsecond range) can achieve the most accurate logic.

[0062] In another embodiment, an absolute time timing method can be used to time the movement of each game interactive element. This means that the movement time of each game interactive element is independent, related only to the timing origin, and not based on the end of the sound effect timing of the previous game interactive element. The specific implementation code is as follows:

[0063]

[0064] In one embodiment, after the step of "obtaining the multiple operation prompt identifiers to be bound to the music description file", the method further includes:

[0065] Obtain the target display location of the operation prompt identifier on the game interface of the target game;

[0066] The step of displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes:

[0067] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0068] Based on the audio information and the target display position corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed at the target display position on the game interface of the target game.

[0069] In order to bind corresponding prompt icons to the note elements corresponding to the audio information, before the step "obtaining the multiple operation prompt icons to be bound to the music description file", the method may include:

[0070] Get multiple preset prompt icons;

[0071] Based on the note category of the note element corresponding to the audio information, the target prompt identifier is determined from the plurality of preset prompt identifiers;

[0072] The target prompt icon is adjusted based on the audio information to generate an operation prompt icon.

[0073] For example, please refer to the following: Figure 4 The computer device can acquire multiple preset prompt icons, which may include a first preset prompt icon, a second preset prompt icon, and a third preset prompt icon. Based on the note category of the note element corresponding to the first audio information, the computer device can determine the second preset prompt icon as the target prompt icon from the multiple preset prompt icons and use this target prompt icon as the operation prompt icon.

[0074] For example, please refer to the following: Figure 4 and Figure 5The computer device can acquire multiple preset prompt icons, which may include a first preset prompt icon, a second preset prompt icon, and a third preset prompt icon. Based on the note category of the note element corresponding to the first audio information, the computer device can determine the second preset prompt icon as the target prompt icon from among the multiple preset prompt icons. Then, the computer device can adjust the target prompt icon based on the audio information. Since the note element has a playback duration, the target prompt icon can be adjusted according to the playback duration, thereby generating an operation prompt icon.

[0075] 104. Bind multiple audio information in the music description file to the multiple operation prompt identifiers to determine the binding relationship between each audio information in the music description file and the corresponding operation prompt identifier, so as to bind the corresponding operation prompt identifier to each note element in the music description file.

[0076] In this embodiment of the application, the method for the step of "binding multiple audio information items in the music description file with the multiple operation prompt identifiers" may include:

[0077] The binding process is performed based on the note category of the note element corresponding to the audio information and the corresponding operation prompt icon to determine the binding relationship between the audio information and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to the note element corresponding to the audio information.

[0078] Specifically, computer devices can determine the corresponding operation prompt identifier based on the note type of the musical note element. For example, if the note type is drum beat, then the drum beat operation prompt identifier is obtained and the audio information is bound to the drum beat operation prompt identifier. Or, if the note type is piano, then the piano operation prompt identifier is obtained and the audio information is bound to the piano operation prompt identifier.

[0079] 105. In response to a playback command for the target game audio, the target game audio is played in the target game, and based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships, the operation prompt icons of each note element in the music description file are displayed on the game interface of the target game.

[0080] In this embodiment of the application, during gameplay, operation prompts can be retrieved from a cache pool, eliminating the need for real-time rendering and reducing game stuttering. Specifically, the step "responding to the playback command for the target game audio" can include:

[0081] In response to a playback command for the target game audio, the operation prompt identifiers of each note element in the music description file corresponding to the target game audio are cached in an identifier cache pool;

[0082] In the target game, determine the note element currently playing in the target game audio, and the audio information corresponding to the note element;

[0083] Based on the musical note element, the operation prompt identifier corresponding to the musical note element is obtained from the identifier cache pool;

[0084] Based on the audio information, the display information corresponding to the operation prompt icon, and the motion information, the operation prompt icon of the musical note element is displayed on the game interface of the target game.

[0085] For example, the types of operation prompt icons in a target game audio include a first type of operation prompt icon, a second type of operation prompt icon, a third type of operation prompt icon, and a fourth type of operation prompt icon. When a computer device responds to a playback command for the target game audio, it caches the first type of operation prompt icon, the second type of operation prompt icon, the third type of operation prompt icon, and the fourth type of operation prompt icon corresponding to the target game audio in an icon cache pool. The computer device can, in response to a playback command for the target game audio, retrieve the first type of operation prompt icon corresponding to the currently playing first note element from the icon cache pool, and adjust the first type of operation prompt icon accordingly based on the audio information of the first note element, the display information corresponding to the operation prompt icon, and the motion information, so as to display the adjusted first type of operation prompt icon of the first note element on the game interface of the target game. After the adjusted first type of operation prompt icon is displayed on the game interface, the computer device can restore the adjusted first type of operation prompt icon to the original first type of operation prompt icon and recycle it in the icon cache pool for subsequent processing. Alternatively, after the adjusted first-type operation prompt icon is displayed on the game interface, the computer device can recycle the adjusted first-type operation prompt icon to the icon cache pool for subsequent processing.

[0086] Specifically, before the system starts, multiple game interaction elements can be created based on the target game audio and placed in a cache pool. When the target game audio is played in the target game, these game interaction elements are retrieved from the cache pool. This allows the game interaction elements to be initialized at system startup, thus avoiding stuttering during the target game's operation. The specific implementation code is shown below:

[0087]

[0088]

[0089] Specifically, after the step "in response to a playback command for the target game audio, playing the target game audio in the target game, and displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships," the method may include:

[0090] When the display time of the operation prompt icon on the game interface reaches a specified duration, the display of the operation prompt icon on the game interface is canceled, wherein the specified duration is determined based on the total duration and the preset duration.

[0091] For example, to ensure that each operation prompt icon is deleted after a certain period of time (after it leaves the visible range), a specified duration can be set so that the operation prompt icon is recycled after the specified duration. Specifically, a preset duration can be added, and the specified duration can be calculated by calculating the preset duration and the total existence time of the operation prompt icon.

[0092] To further illustrate the information processing method provided in this application embodiment, the following description will take the application of the information processing method in a specific implementation scenario as an example. The specific application scenario is as follows:

[0093] (1) Game developers can first use a digital audio workstation (DAW) to create music scores, calculate the number of beats per minute (BPM) of the music, create music scores based on this BPM, and finally export the standard format music description file of the target game audio from the computer device.

[0094] (2) The computer device can convert information from the music description file. Specifically, it can calculate the value of the smallest unit, tick, in the music description file, and then detect the game interactive elements (i.e., the operation prompts mentioned above) corresponding to the audio in the music description file. The display information of each game interactive element is extracted from the music description file. The display information includes the display style, display time, and total duration of the game interactive element. The display time is the time when the game interactive element is displayed on the game interface of the target game. The game interface includes an interactive trigger area. The total duration of existence is the total duration from the initial generation of the game interactive element until it reaches the interactive trigger area. The interactive trigger area is used to indicate when the game interactive element moves to the interactive trigger area and an operation is performed on the game interactive element. The display style of the game interactive element is used to indicate the duration of the player's touch operation on the game interactive element. By parsing the music description file, the occurrence time of each note can be detected, and the duration of each note block can be calculated.

[0095] (3) The computer device can generate corresponding game interactive elements based on the display information of each game interactive element. When multiple game interactive elements are generated, the game interactive elements are cached in the element cache pool.

[0096] (4) The computer device can display the game interface of the target game and the interactive trigger area located in the game interface. When the target game audio is detected to be playing, the corresponding game interactive element is retrieved from the element cache pool according to the currently playing audio information, and the corresponding game interactive element is displayed on the game interface.

[0097] (5) When the display time of the game interactive element on the game interface reaches the specified duration, the display of the game interactive element on the game interface is canceled.

[0098] In summary, this application provides an information processing method that involves obtaining a music description file corresponding to the audio of a target game; then, extracting multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate an operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation prompt icon corresponding to the note element; next, obtaining multiple operation prompt icons that need to be bound to the music description file; then, binding the multiple audio information with the multiple operation prompt icons to determine the binding relationship between each audio information in the music description file and the corresponding operation prompt icon, thereby binding a corresponding operation prompt icon to each note element in the music description file; finally, in response to a playback command for the target game audio, playing the target game audio in the target game, and displaying the operation prompt icons of each note element in the music description file on the game interface of the target game based on the multiple operation prompt icons, the multiple audio information, and the corresponding binding relationship. In this embodiment, game developers only need to parse the music description file of the target game audio in the music game and extract information from the music description file. This allows them to convert the game audio into operation prompts, ensuring that the corresponding operation prompts are displayed synchronously on the game interface when the game audio is played. This improves the efficiency of music game production and enhances the interactive experience for game players in music games.

[0099] To better implement the above methods, embodiments of this application may also provide an information processing device, which may be integrated into a computer device, such as a terminal or other computer device.

[0100] Please see Figure 6 , Figure 6 This is a schematic diagram of the structure of an information processing device provided in an embodiment of this application. The device includes:

[0101] The first acquisition unit 201 is used to acquire the music description file corresponding to the audio of the target game in the target game;

[0102] Extraction unit 202 is used to extract multiple audio information from the music description file, wherein one audio information corresponds to a note element, the audio information includes a playback time point and a playback duration, the playback time point is used to indicate the operation of the operation prompt mark corresponding to the note element, and the playback duration is used to indicate the duration of the operation of the operation prompt mark corresponding to the note element.

[0103] The second acquisition unit 203 is used to acquire multiple operation prompt identifiers that need to be bound to the music description file;

[0104] The processing unit 204 is used to bind the plurality of audio information with the plurality of operation prompt identifiers, determine the binding relationship between each audio information in the music description file and the corresponding operation prompt identifier, and bind the corresponding operation prompt identifier to each note element in the music description file;

[0105] The response unit 205 is configured to respond to a playback command for the target game audio, play the target game audio in the target game, and display the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompts, the plurality of audio information, and the corresponding binding relationships.

[0106] In some embodiments, the information processing apparatus includes:

[0107] The binding process is performed based on the note category of the note element corresponding to the audio information and the corresponding operation prompt icon to determine the binding relationship between the audio information and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to the note element corresponding to the audio information.

[0108] In some embodiments, the information processing apparatus includes:

[0109] The operation prompt icon is displayed on the game interface of the target game. The display information includes the display path length, the display time point, and the total existence duration. The display time point is the time when the operation prompt icon is displayed on the game interface of the target game. The game interface includes an interaction trigger area. The total existence duration is the total time from the initial generation of the operation prompt icon until it reaches the interaction trigger area. The interaction trigger area is used to indicate that when the operation prompt icon moves to the interaction trigger area, an operation is performed on the operation prompt icon.

[0110] Based on the display path length, the display time point, the total duration, and the playback time point of the audio information, determine the motion information of the operation prompt icon corresponding to the audio information.

[0111] In some embodiments, the information processing apparatus includes:

[0112] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0113] Based on the audio information, the display information and motion information corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed on the game interface of the target game, wherein the operation prompt icon moves towards the interaction trigger area on the game interface according to the corresponding display information and motion information.

[0114] In some embodiments, the information processing apparatus includes:

[0115] Create an identifier detection thread;

[0116] The identifier detection thread receives and responds to the identifier detection instructions sent by the game rendering main thread, and detects in real time the operation prompt identifiers of each note element in the music description file and their positional relationship with the interaction trigger area.

[0117] In some embodiments, the information processing apparatus includes:

[0118] In response to a playback command for the target game audio, the operation prompt identifiers of each note element in the music description file corresponding to the target game audio are cached in an identifier cache pool;

[0119] In the target game, determine the note element currently playing in the target game audio, and the audio information corresponding to the note element;

[0120] Based on the musical note element, the operation prompt identifier corresponding to the musical note element is obtained from the identifier cache pool;

[0121] Based on the audio information, the display information corresponding to the operation prompt icon, and the motion information, the operation prompt icon of the musical note element is displayed on the game interface of the target game.

[0122] In some embodiments, the information processing apparatus includes:

[0123] Obtain the target display location of the operation prompt identifier on the game interface of the target game;

[0124] The step of displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes:

[0125] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0126] Based on the audio information and the target display position corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed at the target display position on the game interface of the target game.

[0127] In some embodiments, the information processing apparatus includes:

[0128] Get multiple preset prompt icons;

[0129] Based on the note category of the note element corresponding to the audio information, the target prompt identifier is determined from the plurality of preset prompt identifiers;

[0130] The target prompt icon is adjusted based on the audio information to generate an operation prompt icon.

[0131] In some embodiments, the information processing apparatus includes:

[0132] The target game audio is processed by audio track conversion to obtain multiple target audio tracks of the target game audio;

[0133] Based on the target audio track, generate a music description file corresponding to the target game audio.

[0134] This application discloses an information processing device. A first acquisition unit 201 acquires a music description file corresponding to the audio of a target game. An extraction unit 202 extracts multiple audio information items from the music description file, where each audio item corresponds to a note element. The audio information includes a playback time point and a playback duration. The playback time point indicates an operation to be performed on the operation prompt icon corresponding to the note element, and the playback duration indicates the duration of the operation to be performed on the operation prompt icon corresponding to the note element. A second acquisition unit 203 acquires multiple operation prompt icons to be bound to the music description file. A processing unit 204 binds the multiple audio information items to the multiple operation prompt icons, determining the binding relationship between each audio item in the music description file and its corresponding operation prompt icon, thus binding a corresponding operation prompt icon to each note element in the music description file. A response unit 205 responds to a playback command for the target game audio, plays the target game audio in the target game, and displays the operation prompt icons for each note element in the music description file on the game interface of the target game based on the multiple operation prompt icons, the multiple audio information items, and the corresponding binding relationships. In this embodiment, game developers only need to parse the music description file of the target game audio in the music game and extract information from the music description file. This allows them to convert the game audio into operation prompts, ensuring that the corresponding operation prompts are displayed synchronously on the game interface when the game audio is played. This improves the efficiency of music game production and enhances the interactive experience for game players in music games.

[0135] Accordingly, this application also provides a computer device, which can be a terminal or a server. The terminal can be a smartphone, tablet computer, laptop computer, touch screen, game console, personal computer (PC), personal digital assistant (PDA), or other terminal device. Figure 7 As shown, Figure 7 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. The computer device 300 includes a processor 301 with one or more processing cores, a memory 302 with one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 and the memory 302 are electrically connected. Those skilled in the art will understand that the computer device structure shown in the figure does not constitute a limitation on the computer device, and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0136] The processor 301 is the control center of the computer device 300. It connects various parts of the computer device 300 through various interfaces and lines. By running or loading software programs and / or modules stored in the memory 302, and calling data stored in the memory 302, it performs various functions of the computer device 300 and processes data, thereby monitoring the computer device 300 as a whole.

[0137] In this embodiment, the processor 301 in the computer device 300 loads the instructions corresponding to the processes of one or more applications into the memory 302 according to the following steps, and the processor 301 runs the applications stored in the memory 302 to achieve various functions:

[0138] Obtain the music description file corresponding to the audio of the target game;

[0139] Extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate the operation of the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation of the operation prompt icon corresponding to the note element.

[0140] Obtain the multiple operation prompt icons that need to be bound to the music description file;

[0141] The multiple audio information in the music description file are bound to the multiple operation prompt icons to determine the binding relationship between each audio information in the music description file and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to each note element in the music description file.

[0142] In response to a playback command for the target game audio, the target game audio is played in the target game, and based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships, the operation prompt icons of each note element in the music description file are displayed on the game interface of the target game.

[0143] In one embodiment, the process of binding multiple audio information items in the music description file with the multiple operation prompt identifiers includes:

[0144] The binding process is performed based on the note category of the note element corresponding to the audio information and the corresponding operation prompt icon to determine the binding relationship between the audio information and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to the note element corresponding to the audio information.

[0145] In one embodiment, after obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method further includes:

[0146] The operation prompt icon is displayed on the game interface of the target game. The display information includes the display path length, the display time point, and the total existence duration. The display time point is the time when the operation prompt icon is displayed on the game interface of the target game. The game interface includes an interaction trigger area. The total existence duration is the total time from the initial generation of the operation prompt icon until it reaches the interaction trigger area. The interaction trigger area is used to indicate that when the operation prompt icon moves to the interaction trigger area, an operation is performed on the operation prompt icon.

[0147] Based on the display path length, the display time point, the total duration, and the playback time point of the audio information, determine the motion information of the operation prompt icon corresponding to the audio information.

[0148] In one embodiment, displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes:

[0149] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0150] Based on the audio information, the display information and motion information corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed on the game interface of the target game, wherein the operation prompt icon moves towards the interaction trigger area on the game interface according to the corresponding display information and motion information.

[0151] In one embodiment, after responding to a playback command for the target game audio, the method further includes:

[0152] Create an identifier detection thread;

[0153] The identifier detection thread receives and responds to the identifier detection instructions sent by the game rendering main thread, and detects in real time the operation prompt identifiers of each note element in the music description file and their positional relationship with the interaction trigger area.

[0154] In one embodiment, the response to the playback command for the target game audio includes:

[0155] In response to a playback command for the target game audio, the operation prompt identifiers of each note element in the music description file corresponding to the target game audio are cached in an identifier cache pool;

[0156] In the target game, determine the note element currently playing in the target game audio, and the audio information corresponding to the note element;

[0157] Based on the musical note element, the operation prompt identifier corresponding to the musical note element is obtained from the identifier cache pool;

[0158] Based on the audio information, the display information corresponding to the operation prompt icon, and the motion information, the operation prompt icon of the musical note element is displayed on the game interface of the target game.

[0159] In one embodiment, after obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method further includes:

[0160] Obtain the target display location of the operation prompt identifier on the game interface of the target game;

[0161] The step of displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes:

[0162] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0163] Based on the audio information and the target display position corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed at the target display position on the game interface of the target game.

[0164] In one embodiment, before obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method further includes:

[0165] Get multiple preset prompt icons;

[0166] Based on the note category of the note element corresponding to the audio information, the target prompt identifier is determined from the plurality of preset prompt identifiers;

[0167] The target prompt icon is adjusted based on the audio information to generate an operation prompt icon.

[0168] In one embodiment, before obtaining the music description file corresponding to the target game audio in the target game, the method further includes:

[0169] The target game audio is processed by audio track conversion to obtain multiple target audio tracks of the target game audio;

[0170] Based on the target audio track, generate a music description file corresponding to the target game audio.

[0171] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0172] Optional, such as Figure 7 As shown, the computer device 300 also includes: a touch screen display 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306, and a power supply 307. The processor 301 is electrically connected to the touch screen display 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306, and the power supply 307. Those skilled in the art will understand that... Figure 7 The computer device structure shown does not constitute a limitation on the computer device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0173] The touch display screen 303 can be used to display a graphical user interface (GUI) and receive operation commands generated by the user interacting with the GUI. The touch display screen 303 may include a display panel and a touch panel. The display panel can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the computer device. These graphical user interfaces can be composed of graphics, text, icons, video, and any combination thereof. Optionally, the display panel can be configured using a liquid crystal display (LCD), organic light-emitting diode (OLED), or other similar technologies. The touch panel can be used to collect touch operations performed by the user on or near it (such as operations performed by the user using a finger, stylus, or any suitable object or accessory on or near the touch panel), generate corresponding operation commands, and execute the corresponding program according to the operation commands. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. The touch detection device detects the user's touch location and the signal generated by the touch operation, transmitting the signal to the touch controller. The touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends it to the processor 301. It can also receive and execute commands from the processor 301. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it transmits the information to the processor 301 to determine the type of touch event. Subsequently, the processor 301 provides corresponding visual output on the display panel based on the type of touch event. In this embodiment, the touch panel and the display panel can be integrated into the touch display screen 303 to achieve input and output functions. However, in some embodiments, the touch panel and the touch display screen 303 can be implemented as two independent components to achieve input and output functions. That is, the touch display screen 303 can also be used as part of the input unit 306 to achieve input functions.

[0174] In this embodiment, a graphical interface is generated on the touch display screen 303 by executing an application program through the processor 301. The touch display screen 303 is used to present the graphical interface and receive operation commands generated by the user interacting with the graphical interface.

[0175] The radio frequency circuit 304 can be used to transmit and receive radio frequency signals to establish wireless communication with network devices or other computer devices, and to transmit and receive signals with network devices or other computer devices.

[0176] Audio circuitry 305 can be used to provide an audio interface between a user and a computer device via a speaker and a microphone. Audio circuitry 305 converts received audio data into electrical signals, transmits them to the speaker, and the speaker converts them into sound signals for output. Conversely, the microphone converts collected sound signals into electrical signals, which are then received by audio circuitry 305, converted back into audio data, and output to processor 301 for processing. The audio data is then transmitted via radio frequency circuitry 304 to, for example, another computer device, or output to memory 302 for further processing. Audio circuitry 305 may also include an earphone jack to facilitate communication between peripheral headphones and the computer device.

[0177] The input unit 306 can be used to receive input numbers, characters, or user characteristic information (such as fingerprints, iris, facial information, etc.), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

[0178] Power supply 307 is used to supply power to various components of computer device 300. Optionally, power supply 307 can be logically connected to processor 301 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. Power supply 307 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0179] although Figure 7 As not shown in the diagram, computer equipment 300 may also include a camera, sensor, wireless fidelity module, Bluetooth module, etc., which will not be described in detail here.

[0180] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0181] As can be seen from the above, the computer device provided in this embodiment obtains a music description file corresponding to the audio of a target game; then, it extracts multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate an operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation prompt icon corresponding to the note element. Next, it obtains multiple operation prompt icons that need to be bound to the music description file; then, it binds the multiple audio information with the multiple operation prompt icons to determine the binding relationship between each audio information in the music description file and the corresponding operation prompt icon, so as to bind a corresponding operation prompt icon to each note element in the music description file; finally, in response to the playback command for the target game audio, it plays the target game audio in the target game, and displays the operation prompt icons of each note element in the music description file on the game interface of the target game based on the multiple operation prompt icons, the multiple audio information, and the corresponding binding relationship. In this embodiment, game developers only need to parse the music description file of the target game audio in the music game and extract information from the music description file. This allows them to convert the game audio into operation prompts, ensuring that the corresponding operation prompts are displayed synchronously on the game interface when the game audio is played. This improves the efficiency of music game production and enhances the interactive experience for game players in music games.

[0182] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0183] Therefore, embodiments of this application provide a computer-readable storage medium storing a plurality of computer programs, which can be loaded by a processor to execute the steps of any of the information processing methods provided in embodiments of this application. For example, the computer program can execute the following steps:

[0184] Obtain the music description file corresponding to the audio of the target game;

[0185] Extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate the operation of the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation of the operation prompt icon corresponding to the note element.

[0186] Obtain the multiple operation prompt icons that need to be bound to the music description file;

[0187] The multiple audio information in the music description file are bound to the multiple operation prompt icons to determine the binding relationship between each audio information in the music description file and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to each note element in the music description file.

[0188] In response to a playback command for the target game audio, the target game audio is played in the target game, and based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships, the operation prompt icons of each note element in the music description file are displayed on the game interface of the target game.

[0189] In one embodiment, the process of binding multiple audio information items in the music description file with the multiple operation prompt identifiers includes:

[0190] The binding process is performed based on the note category of the note element corresponding to the audio information and the corresponding operation prompt icon to determine the binding relationship between the audio information and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to the note element corresponding to the audio information.

[0191] In one embodiment, after obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method further includes:

[0192] The operation prompt icon is displayed on the game interface of the target game. The display information includes the display path length, the display time point, and the total existence duration. The display time point is the time when the operation prompt icon is displayed on the game interface of the target game. The game interface includes an interaction trigger area. The total existence duration is the total time from the initial generation of the operation prompt icon until it reaches the interaction trigger area. The interaction trigger area is used to indicate that when the operation prompt icon moves to the interaction trigger area, an operation is performed on the operation prompt icon.

[0193] Based on the display path length, the display time point, the total duration, and the playback time point of the audio information, determine the motion information of the operation prompt icon corresponding to the audio information.

[0194] In one embodiment, displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes:

[0195] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0196] Based on the audio information, the display information and motion information corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed on the game interface of the target game, wherein the operation prompt icon moves towards the interaction trigger area on the game interface according to the corresponding display information and motion information.

[0197] In one embodiment, after responding to a playback command for the target game audio, the method further includes:

[0198] Create an identifier detection thread;

[0199] The identifier detection thread receives and responds to the identifier detection instructions sent by the game rendering main thread, and detects in real time the operation prompt identifiers of each note element in the music description file and their positional relationship with the interaction trigger area.

[0200] In one embodiment, the response to the playback command for the target game audio includes:

[0201] In response to a playback command for the target game audio, the operation prompt identifiers of each note element in the music description file corresponding to the target game audio are cached in an identifier cache pool;

[0202] In the target game, determine the note element currently playing in the target game audio, and the audio information corresponding to the note element;

[0203] Based on the musical note element, the operation prompt identifier corresponding to the musical note element is obtained from the identifier cache pool;

[0204] Based on the audio information, the display information corresponding to the operation prompt icon, and the motion information, the operation prompt icon of the musical note element is displayed on the game interface of the target game.

[0205] In one embodiment, after obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method further includes:

[0206] Obtain the target display location of the operation prompt identifier on the game interface of the target game;

[0207] The step of displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes:

[0208] Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information;

[0209] Based on the audio information and the target display position corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed at the target display position on the game interface of the target game.

[0210] In one embodiment, before obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method further includes:

[0211] Get multiple preset prompt icons;

[0212] Based on the note category of the note element corresponding to the audio information, the target prompt identifier is determined from the plurality of preset prompt identifiers;

[0213] The target prompt icon is adjusted based on the audio information to generate an operation prompt icon.

[0214] In one embodiment, before obtaining the music description file corresponding to the target game audio in the target game, the method further includes:

[0215] The target game audio is processed by audio track conversion to obtain multiple target audio tracks of the target game audio;

[0216] Based on the target audio track, generate a music description file corresponding to the target game audio.

[0217] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0218] The storage medium may include: read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0219] Since the computer program stored in the storage medium can execute the steps of any of the information processing methods provided in the embodiments of this application, it can obtain a music description file corresponding to the audio of the target game in the target game; then, extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, the audio information includes a playback time point and a playback duration, the playback time point is used to indicate an operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation prompt icon corresponding to the note element; next, obtain multiple operation prompt icons that need to be bound to the music description file; then, bind the multiple audio information with the multiple operation prompt icons to determine the binding relationship between each audio information in the music description file and the corresponding operation prompt icon, so as to bind a corresponding operation prompt icon to each note element in the music description file; finally, in response to the playback command for the audio of the target game, play the audio of the target game in the target game, and display the operation prompt icons of each note element in the music description file on the game interface of the target game based on the multiple operation prompt icons, the multiple audio information, and the corresponding binding relationship. In this embodiment, game developers only need to parse the music description file of the target game audio in the music game and extract information from the music description file. This allows them to convert the game audio into operation prompts, ensuring that the corresponding operation prompts are displayed synchronously on the game interface when the game audio is played. This improves the efficiency of music game production and enhances the interactive experience for game players in music games.

[0220] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0221] The foregoing has provided a detailed description of an information processing method, apparatus, computer device, and computer-readable storage medium provided in the embodiments of this application. Specific examples have been used to illustrate the principles and implementation methods of this application. The descriptions of the embodiments above are only for the purpose of helping to understand the technical solutions and core ideas of this application. Those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. These modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. An information processing method, characterized in that, include: Obtain the music description file corresponding to the audio of the target game; Extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate the operation of the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation of the operation prompt icon corresponding to the note element. Obtain the multiple operation prompt icons that need to be bound to the music description file; The binding process is performed based on the note category of the note element corresponding to the audio information and the corresponding operation prompt icon to determine the binding relationship between the audio information and the corresponding operation prompt icon, so as to bind the corresponding operation prompt icon to the note element corresponding to the audio information. In response to a playback command for the target game audio, the operation prompt identifiers of each note element in the music description file corresponding to the target game audio are cached in an identifier cache pool; the currently playing note element of the target game audio and the audio information corresponding to the note element are determined in the target game; the operation prompt identifier corresponding to the note element is retrieved from the identifier cache pool based on the note element; the operation prompt identifier of the note element is displayed on the game interface of the target game based on the audio information, the display information and motion information corresponding to the operation prompt identifier; when it is detected that the display time of the operation prompt identifier on the game interface reaches a specified duration, the display of the operation prompt identifier on the game interface is canceled, and the operation prompt identifier is recycled to the identifier cache pool.

2. The information processing method according to claim 1, characterized in that, After obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method also includes: The operation prompt icon is displayed on the game interface of the target game. The display information includes the display path length, the display time point, and the total existence duration. The display time point is the time when the operation prompt icon is displayed on the game interface of the target game. The game interface includes an interaction trigger area. The total existence duration is the total time from the initial generation of the operation prompt icon until it reaches the interaction trigger area. The interaction trigger area is used to indicate that when the operation prompt icon moves to the interaction trigger area, an operation is performed on the operation prompt icon. Based on the display path length, the display time point, the total duration, and the playback time point of the audio information, determine the motion information of the operation prompt icon corresponding to the audio information.

3. The information processing method according to claim 2, characterized in that, The step of displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes: Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information; Based on the audio information, the display information and motion information corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed on the game interface of the target game, wherein the operation prompt icon moves towards the interaction trigger area on the game interface according to the corresponding display information and motion information.

4. The information processing method according to claim 3, characterized in that, Following the playback command for the target game audio, the method further includes: Create an identifier detection thread; The identifier detection thread receives and responds to the identifier detection instructions sent by the game rendering main thread, and detects in real time the operation prompt identifiers of each note element in the music description file and their positional relationship with the interaction trigger area.

5. The information processing method according to claim 1, characterized in that, After obtaining the multiple operation prompt identifiers that need to be bound to the music description file, the method also includes: Obtain the target display location of the operation prompt identifier on the game interface of the target game; The step of displaying the operation prompts for each note element in the music description file on the game interface of the target game based on the plurality of operation prompt icons, the plurality of audio information, and the corresponding binding relationships includes: Based on the binding relationship, determine the operation prompt identifier corresponding to the audio information; Based on the audio information and the target display position corresponding to the operation prompt icon, the operation prompt icon of the musical note element is displayed at the target display position on the game interface of the target game.

6. The information processing method according to claim 1, characterized in that, Before obtaining the multiple operation prompt identifiers required to bind the music description file, the process also includes: Get multiple preset prompt icons; Based on the note category of the note element corresponding to the audio information, the target prompt identifier is determined from the plurality of preset prompt identifiers; The target prompt icon is adjusted based on the audio information to generate an operation prompt icon.

7. The information processing method according to claim 1, characterized in that, Before obtaining the music description file corresponding to the target game's audio, the process also includes: The target game audio is processed by audio track conversion to obtain multiple target audio tracks of the target game audio; Based on the target audio track, generate a music description file corresponding to the target game audio.

8. An information processing device, characterized in that, include: The first acquisition unit is used to acquire the music description file corresponding to the audio of the target game in the target game; An extraction unit is used to extract multiple audio information from the music description file, wherein each audio information corresponds to a note element, and the audio information includes a playback time point and a playback duration. The playback time point is used to indicate an operation on the operation prompt icon corresponding to the note element, and the playback duration is used to indicate the duration of the operation on the operation prompt icon corresponding to the note element. The second acquisition unit is used to acquire multiple operation prompt identifiers that need to be bound to the music description file; The processing unit is used to perform binding processing based on the note category of the note element corresponding to the audio information and the corresponding operation prompt icon, to determine the binding relationship between the audio information and the corresponding operation prompt icon, and to bind the corresponding operation prompt icon to the note element corresponding to the audio information. A response unit is configured to, in response to a playback command for the target game audio, cache the operation prompt identifiers of each note element in the music description file corresponding to the target game audio in an identifier cache pool; determine the currently playing note element of the target game audio and the audio information corresponding to the note element in the target game; retrieve the operation prompt identifier corresponding to the note element from the identifier cache pool based on the note element; display the operation prompt identifier of the note element on the game interface of the target game based on the audio information, the display information and motion information corresponding to the operation prompt identifier; and cancel the display of the operation prompt identifier on the game interface and recycle the operation prompt identifier to the identifier cache pool when the display time of the operation prompt identifier on the game interface reaches a specified duration.

9. A computer device, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and capable of running on the processor, wherein the computer program, when executed by the processor, implements the information processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium, which, when executed by a processor, implements the information processing method as described in any one of claims 1 to 7.

Images