Information display methods, apparatus, computer-readable storage media, and electronic devices

The information display method addresses the lack of real-time note display in conventional systems by incorporating touch-based note acquisition and recording, improving user interaction and experience in cloud gaming environments.

JP2026123246APending Publication Date: 2026-07-29NETEASE (HANGZHOU) NETWORK CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
NETEASE (HANGZHOU) NETWORK CO LTD
Filing Date
2026-05-07
Publication Date
2026-07-29

AI Technical Summary

Technical Problem

Conventional methods fail to display recorded musical notes in real time during the recording process, limiting user interaction and experience, especially in cloud gaming environments where musical instruments' layouts differ from real instruments.

Method used

An information display method that includes displaying an interaction interface with pre-configured score controls, acquiring note information through touch events, and recording musical notes in real time in a second predetermined area of the display interface, allowing for real-time note display and editing.

Benefits of technology

Enables real-time display and editing of musical notes, improving user convenience and experience by allowing users to see input notes immediately, enhancing interaction with musical instruments in cloud gaming scenarios.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026123246000001_ABST
    Figure 2026123246000001_ABST
Patent Text Reader

Abstract

This invention provides an information display method, apparatus, computer-readable storage medium, and electronic device that display recorded musical notes in real time during recording. [Solution] The method includes: displaying an interaction interface including a pre-configured musical score control in a first predetermined area of ​​the display interface of a terminal device; acquiring musical note information of the musical score control corresponding to a touch event in response to a touch event acting on the musical score control; and displaying and recording a musical note corresponding to the musical note information in a second predetermined area of ​​the display interface.
Need to check novelty before this filing date? Find Prior Art

Description

Cross-reference to Related Applications

[0001] This disclosure claims priority to the application documents of Application No.: 202210449892.8, Application Date: April 26, 2022, Invention Title: Information Display Method and Device, Computer-readable Storage Medium, and Electronic Device, and all the contents of the Chinese patent application are incorporated herein by reference.

Technical Field

[0002] Embodiments of the present disclosure relate to the technical field of human-machine interaction, and specifically, to an information display method, an information display device, a computer-readable storage medium, and an electronic device.

Background Art

[0003] In the conventional music score generation method, the music played by the user can be automatically recorded as a music score. However, the recorded musical notes cannot be displayed in real time during recording.

Summary of the Invention

[0004] An object of the present disclosure is to provide an information display method, an information display device, a computer-readable storage medium, and an electronic device that can at least overcome to some extent the problem that the recorded musical notes cannot be displayed in real time due to the limitations and defects of the related art.

[0005] One aspect of the present disclosure provides an information display method, and the information display method includes: displaying an interaction interface including a music score control preset in a first predetermined area of the display interface of the terminal device; acquiring the musical note information of the music score control corresponding to the touch event in response to a touch event acting on the music score control; displaying and recording the musical notes corresponding to the musical note information in a second predetermined area of the display interface.

[0006] In exemplary embodiments of the present disclosure, a game screen is further displayed on the display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, wherein the video stream is formed by encoding the game screen of a game program running on the cloud server, and the game screen is a screen corresponding to a musical instrument that is displayed in response to a call command for a pre-configured musical instrument provided by the game program. Here, the information display method further includes, This includes calling a pre-configured koto music notation tool included in the cloud gaming platform, masking the pre-configured koto music notation tool and pre-configured musical instrument tools, and obtaining a display interface having a first predetermined display method. In this display interface, which has a first predetermined display method, the pre-configured koto score tool floats to the top layer of the pre-configured musical instrument tools.

[0007] In exemplary embodiments of the present disclosure, the score control is a key control of the koto tool, the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured instrument tool in the interaction interface.

[0008] In exemplary embodiments of this disclosure, displaying an interaction interface in a first predetermined area of ​​the display interface of a terminal device is: In response to a touch operation on the scene mode control, the display interface is switched from the current screen scene to the music composition scene. This includes displaying an interaction interface, including a koto music notation tool and musical instrument tools, in a first predetermined area of ​​the display interface of the terminal device.

[0009] In exemplary embodiments of this disclosure, the information display method further includes: The interaction interface includes displaying the score control corresponding to the touch event in a first display method, and displaying other score controls other than the score control corresponding to the touch event in a second display method. Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input by an external device.

[0010] In exemplary embodiments of this disclosure, the information display method further includes: This includes adjusting the score control corresponding to the touch event from a first display mode to a second display mode in response to the end of the touch event.

[0011] In exemplary embodiments of this disclosure, displaying a note corresponding to the note information in a second predetermined area of ​​the display interface is: The process includes scrolling and displaying the notes corresponding to the note information in real time in a second predetermined area of ​​the display interface at a first predetermined scrolling speed, wherein, during the scrolling display process, the position where the cursor remains is the position of the last note among the recorded notes.

[0012] In exemplary embodiments of the present disclosure, if the touch event is a first touch event entered with multiple fingers, the note display method is: This includes displaying the notes of a pre-configured musical score control corresponding to a first touch event in order, based on the front-to-back positioning order of the pre-configured musical score control corresponding to the first touch event in the interaction interface.

[0013] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the scene mode control, the display interface is switched from the score creation scene to the score editing scene, This includes editing the recorded note corresponding to a selection operation in a second display area in response to a selection operation on a recorded note, Editing the recorded notes corresponding to the aforementioned selection operation is Deleting or switching recorded notes corresponding to the aforementioned selection operation, and / or This includes inserting other notes at the positions of the recorded notes corresponding to the selection operation.

[0014] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the scene mode control, the display interface is switched from the score editing scene to the score publishing scene. In response to a selection operation on the score attribute information included in the aforementioned score issuance scene, a score details page is configured for the current score generated from the notes, This includes issuing the current score and the score details page in response to a touch operation on the issuing control included in the score issuing scene.

[0015] In exemplary embodiments of this disclosure, in response to a touch event acting on the score control, after obtaining note information of the score control corresponding to the touch event, the information display method further: The system generates note feedback information according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area, This includes determining a third display method for the score to be played according to the aforementioned note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method.

[0016] In an exemplary embodiment of the present disclosure, generating note feedback information according to the consistency between the note information of the music score control corresponding to the touch event and the performance target notes of the performance target music score displayed in the second display area includes: determining whether the note information of the music score control corresponding to the touch event matches the current performance target notes of the performance target music score displayed in the second display area; when the note information of the music score control corresponding to the touch event matches the current performance target notes, generating first note feedback information; when the note information of the music score control corresponding to the touch event does not match the current performance target notes, generating second note feedback information.

[0017] In an exemplary embodiment of the present disclosure, the current music score performance mode includes a practice performance mode or an automatic performance mode. Here, according to the note feedback information and the current music score performance mode, determining a third display method for the performance target music score and controlling the performance target music score to be displayed in the second display area in the third display method includes: when the music score performance mode is the practice performance mode and the note feedback information is the first note feedback information, displaying the next performance target note in the second display area; when the music score performance mode is the automatic performance mode, displaying the performance target music score in the second display area at a second predetermined scroll speed, and displaying the performance target notes in the performance target music score and the music score control corresponding to the performance target notes in a fourth display method.

[0018] In an exemplary embodiment of the present disclosure, when the music score performance mode is the automatic performance mode, the information display method further includes: When the note feedback information is the first note feedback information, determine the current display method of the score control corresponding to the touch event as the fifth display method, and control the score control corresponding to the touch event to be displayed in the fifth display method. When the note feedback information is the second note feedback information, determine the current display method of the score control corresponding to the touch event as the sixth display method, and control the score control corresponding to the touch event to be displayed in the sixth display method.

[0019] In an exemplary embodiment of the present disclosure, the performance target note includes the current performance target note and the next performance target note corresponding to the current performance target note Here, displaying the performance target note and the score control corresponding to the performance target note in the performance target score in the fourth display method means Displaying the current performance target note and the score control corresponding to the current performance target note in the performance target score with the first color mark Displaying the next performance target note and the score control corresponding to the next performance target note in the performance target score with the second color mark.

[0020] In an exemplary embodiment of the present disclosure, the information display method further includes In response to a touch operation on the performance target score, switching the performance target score from the first display state to the second display state, the first display state includes a thumbnail state and / or a display state, and when the first display state is the thumbnail state, the second display state is the display state, and when the first display state is the display state, the second display state is the thumbnail state.

[0021] One aspect of the present disclosure provides an information display device including a first display module, a note information acquisition module, and a second display module. The first display module is configured to display an interaction interface, including pre-configured score controls, in a first predetermined area of ​​the display interface of the terminal device. The note information acquisition module is configured to acquire note information of the score control corresponding to the touch event in response to a touch event acting on the score control. The second display module is configured to display and record musical notes corresponding to the musical note information in a second predetermined area of ​​the display interface.

[0022] In exemplary embodiments of the present disclosure, a game screen is further displayed on the display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, wherein the video stream is formed by encoding the game screen of a game program running on the cloud server, and the game screen is a screen corresponding to a musical instrument that is displayed in response to a call command for a pre-configured musical instrument provided by the game program. Here, the information display device further includes a mask module, The mask module is configured to call a pre-configured koto music notation tool included in the cloud gaming platform, mask the pre-configured koto music notation tool and pre-configured musical instruments, and obtain a display interface having a first predetermined display method. In this display interface, which has a first predetermined display method, the pre-configured koto score tool floats to the top layer of the pre-configured musical instrument tools.

[0023] In exemplary embodiments of the present disclosure, the score control is a key control of the koto tool, the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured instrument tool in the interaction interface.

[0024] In exemplary embodiments of this disclosure, displaying an interaction interface in a first predetermined area of ​​the display interface of a terminal device is: In response to a touch operation on the scene mode control, the display interface is switched from the current screen scene to the music composition scene. This includes displaying an interaction interface, including a koto music notation tool and musical instrument tools, in a first predetermined area of ​​the display interface of the terminal device.

[0025] In exemplary embodiments of the present disclosure, the information display device further includes a third display module. The third display module is configured to display the score control corresponding to the touch event on the interaction interface using a first display method, and to display other score controls other than the score control corresponding to the touch event on the interaction interface using a second display method. Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input by an external device.

[0026] In exemplary embodiments of this disclosure, the information display device further includes a display mode adjustment module, The display mode adjustment module is configured to adjust the score control corresponding to the touch event from the first display mode to the second display mode in response to the end of the touch event.

[0027] In exemplary embodiments of this disclosure, displaying a note corresponding to the note information in a second predetermined area of ​​the display interface is: The process includes scrolling and displaying the notes corresponding to the note information in real time in a second predetermined area of ​​the display interface at a first predetermined scrolling speed, wherein, during the scrolling display process, the position where the cursor remains is the position of the last note among the recorded notes.

[0028] In exemplary embodiments of the present disclosure, if the touch event is a first touch event entered with multiple fingers, the note display method is: This includes displaying the notes of a pre-configured musical score control corresponding to a first touch event in order, based on the front-to-back positioning order of the pre-configured musical score control corresponding to the first touch event in the interaction interface.

[0029] In exemplary embodiments of the present disclosure, the information display device further includes a first scene switching module and a note editing module. The first scene switching module is configured to switch the display interface from the score creation scene to the score editing scene in response to a touch operation on the scene mode control. The note editing module is configured to edit the recorded note corresponding to a selection operation in the second display area in response to the selection operation. Editing the recorded notes corresponding to the aforementioned selection operation is Deleting or switching recorded notes corresponding to the aforementioned selection operation, and / or This includes inserting other notes at the positions of the recorded notes corresponding to the selection operation.

[0030] In exemplary embodiments of the present disclosure, the information display device further includes a second scene switching module, a score detail page configuration module, and a score publishing module. The second scene switching module is configured to switch the display interface from the score editing scene to the score publishing scene in response to a touch operation on the scene mode control. The score detail page configuration module is configured to configure a score detail page for the current score generated from the notes in response to a selection operation on the score attribute information included in the score publishing scene. The score publishing module is configured to publish the current score and the score details page in response to touch operations on the publishing controls included in the score publishing scene.

[0031] In exemplary embodiments of the present disclosure, the information display device further includes a note feedback information generation module and a display method determination module, The note feedback information generation module is configured to generate note feedback information according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area. The display method determination module is configured to determine a third display method for the score to be played according to the note feedback information and the current score performance mode, and to control the display of the score to be played in the second display area according to the third display method.

[0032] In exemplary embodiments of this disclosure, note feedback information is generated according to the agreement between the note information of the score control corresponding to the touch event and the note to be played in the score to be played displayed in the second display area. The process involves determining whether the note information of the score control corresponding to the touch event matches the currently played note of the score to be played displayed in the second display area, If the note information of the score control corresponding to the aforementioned touch event matches the currently played note, first note feedback information is generated. This includes generating second note feedback information if the note information of the score control corresponding to the aforementioned touch event does not match the currently played note.

[0033] In exemplary embodiments of this disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode. Here, determining a third display method for the score to be played according to the note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method, If the aforementioned score performance mode is a practice performance mode and the aforementioned note feedback information is the first note feedback information, the next note to be played is displayed in the second display area. When the score performance mode is an automatic performance mode, the system includes displaying the score to be performed in the second display area at a second predetermined scrolling speed, and displaying the notes to be performed and the score controls corresponding to those notes in the score to be performed using a fourth display method.

[0034] In exemplary embodiments of the present disclosure, when the musical score playback mode is an automatic playback mode, the information display device further includes a fourth display module and a fifth display module. The fourth display module is configured to determine the current display method of the score control corresponding to the touch event as the fifth display method when the note feedback information is the first note feedback information, and to control the score control corresponding to the touch event to display in the fifth display method. The fifth display module is configured to determine the current display method of the score control corresponding to the touch event as the sixth display method when the note feedback information is the second note feedback information, and to control the score control corresponding to the touch event to display in the sixth display method.

[0035] In exemplary embodiments of this disclosure, the note to be played includes the current note to be played and the next note to be played corresponding to the current note to be played. Here, displaying the notes to be played and the score controls corresponding to the notes to be played in the score to be played using the fourth display method is: The first color mark displays the current note to be played in the aforementioned musical score and the musical score control corresponding to the current note to be played, This includes displaying the next note to be played and the score control corresponding to the next note to be played in the aforementioned score using a second color mark.

[0036] In exemplary embodiments of this disclosure, the information display device further includes a display state switching module. The display state switching module is configured to switch the score to be played from a first display state to a second display state in response to a touch operation on the score to be played, wherein the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state.

[0037] One aspect of this disclosure provides a computer-readable storage medium for storing a computer program that, when executed by a processor, realizes the information display method described in any of the above descriptions.

[0038] One aspect of this disclosure provides an electronic device including a processor and a memory for storing executable instructions of the processor, The processor is configured to execute the information display method described in any one of the above by executing the executable instructions.

[0039] Embodiments of this disclosure provide an information display method that, by displaying an interaction interface in a first predetermined area of ​​the display interface of a terminal device, responds to touch events acting on the score control, acquires note information of the score control corresponding to the touch event, and finally displays and records the note corresponding to the note information in a second predetermined area of ​​the display interface, thereby realizing real-time display of notes and solving the problem in the prior art that recorded notes could not be displayed in real time. On the other hand, since the note corresponding to the note information can be viewed in real time while the note information is being input, current users can see the input notes in a timely manner, improving the convenience for users when viewing input notes and further enhancing the user experience.

[0040] It should be understood that the above general explanation and the detailed explanation below are illustrative and interpretive and do not limit this disclosure. [Brief explanation of the drawing]

[0041] The drawings are incorporated herein by reference to embodiments conforming to the Disclosure and are used together with the Specification to illustrate the principles of the Disclosure. Clearly, the drawings in the following description are only a few embodiments of the Disclosure, and those skilled in the art can obtain other drawings based on these without any creative effort. [Figure 1] This is a schematic diagram showing an example of a musical instrument key. [Figure 2] This is a schematic diagram illustrating an example of musical notation. [Figure 3] This diagram schematically shows another example of a key. [Figure 4] Figure 3 schematically illustrates an example of a music score recording scene using a key. [Figure 5]This is a flowchart of an information display method in one embodiment of the present disclosure. [Figure 6] This figure schematically illustrates an example of an application scenario for cloud gaming in one embodiment of the present disclosure. [Figure 7] This figure schematically illustrates an example of a pre-configured scene of a koto music tool and musical instrument equipment in an exemplary embodiment of the present disclosure. [Figure 8] This is an illustrative diagram of an interaction interface having a first predetermined display method in an exemplary embodiment of the present disclosure. [Figure 9] This figure schematically illustrates an example of a note recording scene in one embodiment of the present disclosure. [Figure 10] This figure schematically shows an example of a musical note recording scene in one embodiment of the present disclosure. [Figure 11] This figure schematically illustrates an example scene in a note recording process according to one embodiment of the present disclosure. [Figure 12] This figure schematically illustrates an example scene of a first touch event via multi-finger input in one embodiment of the present disclosure. [Figure 13] This figure schematically illustrates an example scene in another note recording process in one embodiment of the present disclosure. [Figure 14] This figure schematically illustrates an example of a scene for editing recorded musical notes in one embodiment of the present disclosure. [Figure 15] This figure schematically illustrates another example scene of editing recorded musical notes in an exemplary embodiment of the present disclosure. [Figure 16] This is a flowchart illustrating a method for issuing a current musical score in an exemplary embodiment of the present disclosure. [Figure 17] A schematic diagram illustrating a scene that constitutes a score detail page for a current score in an exemplary embodiment of the present disclosure is shown. [Figure 18] This figure schematically illustrates an example of a musical score playing scene in an exemplary embodiment of the present disclosure. [Figure 19] This figure schematically shows an example of a thumbnail-like scene in one embodiment of the present disclosure. [Figure 20] This figure schematically illustrates an example of a display state in an exemplary embodiment of the present disclosure. [Figure 21] This figure schematically shows a block diagram of an information display device in one embodiment of the present disclosure. [Figure 22] This figure schematically shows a block diagram of an electronic device that implements an information display method in one embodiment of the present disclosure. [Modes for carrying out the invention]

[0042] Next, exemplary embodiments will be described in more detail with reference to the drawings. However, exemplary embodiments can be carried out in various forms and should not be understood as being limited to the examples described herein. In contrast, these embodiments are provided to make the disclosure more comprehensive and complete and to fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics can be incorporated into one or more embodiments in any suitable way. Many specific details are provided in the following description to provide a full understanding of the embodiments of the disclosure. However, those skilled in the art will recognize that it is possible to carry out the technical aspects of the disclosure or to employ other methods, components, apparatus, steps, etc., by omitting one or more of the specific details. In other cases, known technical ideas are not shown or described in detail to avoid ambiguity of the various aspects of the disclosure.

[0043] Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn in proportion. The same reference numerals in the drawings indicate the same or similar parts, and redundant explanations are omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software form, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0044] In some game scenarios, recording musical scores can be achieved as follows: Specifically, the game has built-in musical instruments that players can use to play music within the game. Taking one music game as an example, the buttons in the interface correspond to the keys of an instrument, with each corresponding to do, re, mi, fa, so, la, si (one set of notes), and the abbreviated notation is 1, 2, 3, 4, 5, 6, 7, with the 15 buttons corresponding to two sets of notes. Pressing a button produces the sound of the corresponding key. However, the musical instruments in games have few built-in scores, the key arrangement differs from real instruments, and there are no key markers (see Figure 1 for details), resulting in a high learning curve for beginners.

[0045] To address the above issues, the creation and performance of musical scores are implemented in other game scenes as follows: First, in a musical score creation scene (specifically, see the scene shown in Figure 2), it is possible to edit single or multiple syllables by manually inputting the score. However, this method requires manually controlling the playback bar and inputting notes one by one, making the creation process tedious and cumbersome, and resulting in low input efficiency. Second, in another musical score creation scene (specifically, see the scenes shown in Figures 3 and 4), the music played by the user can be automatically recorded into musical notation. However, it is not possible to edit single syllables, and the recorded content is not visible during recording. After recording is complete, it is not displayed in a simplified score. Also, in the case of a recording error, only re-recording is possible; editing single syllables is not possible, resulting in limited functionality and a low fault tolerance rate. Furthermore, the musical score performance scene is implemented in the following way: Users can create and share musical scores using music notation software, practice playing them, and then return to the game to play the practiced songs. However, this method has the following drawbacks: users need to use two devices when practicing the koto; one device to view the sheet music and the other to start playing the game, or to memorize the sheet music and play it in the game. However, the key layout is different from a real instrument, there are no musical note symbols, and beginners or players without musical theory knowledge will find it difficult to learn and operate.

[0046] Based on this, exemplary embodiments of the present disclosure provide an information display method configured on a terminal device, and of course, those skilled in the art can implement the methods of the present disclosure on other platforms as needed, but are not particularly limited. Exemplaryly, the display terminal may be a television, personal computer, mobile device, PC, or in-vehicle display, and the specific device form of the display terminal can be set according to the actual situation and is within the scope of protection of the present disclosure. As shown in Figure 5, the information display method may include the following steps.

[0047] In step S510, an interaction interface including pre-configured score controls is displayed in a first predetermined area of ​​the terminal device's display interface. In step S520, in response to a touch event acting on the score control, the note information of the score control corresponding to the touch event is obtained. In step S530, the musical note corresponding to the musical note information is displayed and recorded in the second predetermined area of ​​the display interface.

[0048] In the above information display method, an interaction interface is displayed in a first predetermined area of ​​the terminal device's display interface. Next, in response to a touch event acting on the score control, note information of the score control corresponding to the touch event is acquired. Finally, the note corresponding to the note information is displayed and recorded in a second predetermined area on the display interface. This realizes real-time display of notes and solves the problem in conventional technology where recorded notes could not be displayed in real time. On the other hand, because the note corresponding to the note information can be viewed in real time while the note information is being input, current users can see the input notes in a timely manner, improving the convenience for users when viewing input notes and further enhancing the user experience.

[0049] The information display method in one embodiment of this disclosure will be described in detail below with reference to the drawings.

[0050] First, the application scenarios of the embodiments of this disclosure will be described. Specifically, the information display method described in the embodiments of this disclosure can be applied to cloud gaming scenes, that is, it can be applied to music composition and playing in cloud gaming scenes, and can display the created music. Alternatively, it can display the played music, and further solves the problem that prior art cannot display created music in real time, or solves the problem that while playing music, the music being played cannot be displayed on the same display interface. At the same time, the information display method described in the exemplary embodiments of this disclosure can also automatically record koto music, instantly generate and display koto music, and after the recording of the koto music is complete, a single syllable can be arbitrarily changed. Within the game interface, instrument tools can be opened, and koto music can be created and shared. The game interface can guide the player to play the koto music they specify, improving the player's gaming experience.

[0051] Next, we will explain the cloud gaming described above. Specifically, cloud gaming is a gaming method based on cloud computing. In cloud gaming mode, all games are run on cloud servers, and the rendered game screen is compressed and encoded before being transmitted to the user via the network for operation. With the maturation of cloud computing and the gradual development of 5G communication technology, enabling high-speed transmission capabilities, cloud gaming is rapidly developing and gradually becoming more widespread. Cloud gaming adopts a "cloud computing + gaming" mode, allowing users to experience high-end gaming technology with minimal equipment. Users do not need to perform complex operations such as traditional downloads, installations, and upgrades, and can perform activities such as gaming and work from the cloud at any time, thereby achieving the goal of completely eliminating the need for hardware. In cloud gaming scenarios, the game is run not on the player's game terminal, but on a cloud server. The cloud server renders the game scene as a video and audio stream and transmits it to the player's game terminal via the network, while also sending the player's terminal operations back to the cloud server. The player's game terminal does not need to have powerful graphics processing and data processing capabilities; it only needs to have basic streaming playback capabilities and the ability to receive player input commands and send them to the cloud server.

[0052] Specifically, this cloud gaming scene can be as shown in Figure 6. In Figure 6, 600 is a terminal device, which can be a television 601, a mobile phone 602, or a PC (Personal Computer) 603. The terminal device sends game commands to a cloud server 610, which responds to these game commands by rendering the cloud game and then feeding back the game screen, including a compressed and encoded audio-video stream, to the terminal display. The current user 620 inputs corresponding operation commands via a mouse 630, keyboard 640, steering wheel 650, headphones 660, and microphone 670. Of course, the user can also input corresponding operation commands directly on the display interface of the display terminal, thereby enabling operation of the cloud game.

[0053] In the information display method provided by the exemplary embodiments of this disclosure, In step S510, an interaction interface including pre-configured score controls is displayed in a first predetermined area of ​​the terminal device's display interface.

[0054] In this embodiment, the display interface of the display terminal will be described first. Specifically, the display interface of this display terminal is a video screen obtained by playing a video stream received from a cloud server, where the video stream is formed by encoding the game screen of a game program executed on the cloud server. That is, the game screen in one embodiment of this disclosure may be a game screen under a cloud game scene, or of course a game screen under another game scene, but this example is not particularly limited to this.

[0055] Next, the process of generating the display interface will be described. Specifically, the game screen described above is a screen corresponding to a musical instrument that is displayed in response to a call instruction for a pre-configured musical instrument provided by the game program. That is, the game screen described in one embodiment of the present disclosure differs from the original video screen displayed by a video stream formed on a server. In the game screen described in one embodiment of the present disclosure, after the user enters the game via a terminal device, the game program can call a pre-configured musical instrument, and then display the pre-configured musical instrument on the original video screen. Subsequently, a koto music notation tool pre-configured within the cloud game platform can be called, and by masking the koto music notation tool and the musical instrument, a display interface having a first predetermined display method can be obtained. Here, in a display interface having a first predetermined display method, the pre-configured koto score tool floats on the top layer of the pre-configured musical instrument tools, and the score control is a key control of the koto score tool, and the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured musical instrument tools in the interaction interface.

[0056] For example, as shown in Figure 7, using XX Cloud Game as an example, first, the user opens the game program corresponding to the cloud game on the terminal device via the terminal device's client, and then touches the instrument tool control within the game program to call up the pre-configured instrument tool of the game. Next, the user touches the koto score tool control included in this cloud game platform to call up the pre-configured koto score tool included in this cloud game platform, and then masks this koto score tool and instrument tool to obtain a display interface having a first predetermined display method. Here, the obtained display interface can specifically be as shown in Figure 8. In the information display method described in the embodiments of this disclosure, the pre-configured instrument tool is provided in the game program, and the pre-configured koto score tool is provided in the cloud game platform. When it is necessary to generate a display interface, it is necessary to first call up the pre-configured instrument tool provided in the game program, then call up the pre-configured koto score tool included in the cloud game platform, and then mask both to obtain the corresponding display interface. This display interface is independent of the cloud game program, and only this display interface is displayed on a specific cloud game platform. Furthermore, all information display methods described in the embodiments of this disclosure are performed based on this display interface.

[0057] In selectable embodiments, the key control layout of the koto music tool included in the cloud gaming platform is fixed based on the key control layout of the instrument tool. For example, when a pre-configured instrument tool is invoked in the game, the game screen displays a fixed instrument tool display interface, which may include 9 or 15 grids. After the current user touches the koto music tool included in the cloud gaming platform, the koto music tool interface corresponding to the key control layout of the instrument tool can be quickly displayed by displaying a koto music tool interface that matches the pre-configured key control layout of the instrument tool.

[0058] In an optional embodiment, the key control layout of the koto music tool in the cloud game platform is dynamically determined by identifying the key control layout of the musical instrument. For example, when the current user touches a musical instrument control in the game program and invokes a pre-configured musical instrument in the game, a fixed display interface for the musical instrument is displayed on the game screen, which may include a 9-grid or 15-grid, and after the current user touches the koto music tool control included in this cloud game platform, the key control layout in the musical instrument interface on the game screen is identified, and a corresponding koto music tool interface is dynamically generated based on the identification result, thus allowing the koto music tool to be adapted to musical instruments with different key layout effects.

[0059] For example, in the interaction interface shown in Figure 9, a pre-configured koto (Japanese zither) tool and a pre-configured musical instrument tool are displayed superimposed within the same interface. That is, the koto tool is masked over the musical instrument tool, and the first layer of the koto tool is displayed in a semi-transparent form. Furthermore, this interaction interface displays notes, abbreviations, and various key presentation effects corresponding to the keys. Since the koto tool is masked over the musical instrument tool, there is a one-to-one correspondence in the position of the key controls of the koto tool and the key controls of the musical instrument tool within the interaction interface; in other words, the key controls of the koto tool are superimposed on the key controls of the musical instrument tool. In this way, it is possible to help identify notes represented by the key controls of the musical instrument tools in the game, and furthermore, the user can select the corresponding musical score control as needed during the note input process, thereby improving the efficiency of note input and enhancing the user experience. Referring to Figure 9, the first predetermined area on the display interface can be, for example, as shown in 901.

[0060] Illustratively, the display interface is shown in the first predetermined area shown in Figure 9. Pre-configured score controls, for example as shown in 802, display the notes and / or abbreviations that the score control possesses, and the instrument attributes that the score control possesses. Here, the notes and / or abbreviations are, for example, bass 1234567, middle 1234567, and treble 1234567, and the instrument attributes may be patterns that the score control possesses, such as a diamond, a circle, or a combination of a diamond and a circle, and of course they can be represented in other ways, and this example is not particularly limited. Note that bass 1234567, middle 1234567, and treble 1234567 can be set to the corresponding positions as needed, and this example is not particularly limited.

[0061] Furthermore, once the above-mentioned display interface and interaction interface are obtained, the interaction interface can be displayed in a first predetermined area on the display interface of the terminal device. Specifically, first, in response to a touch operation of the scene mode control by the current user, the display interface is switched from the current screen scene to the music score creation scene, and the interaction interface including the koto score tool and musical instrument tools is displayed in the first predetermined area on the display interface of the terminal device, where the music score creation mode control includes the music score recording control. For example, referring to Figure 10, when a touch operation by the current user on the scene mode control shown in Figure 10 (for example, the music score creation control shown in 1001) is detected, the display interface can be switched from the current screen scene to the music score creation scene, and then the user transitions to the creation mode. This method enables music score creation in cloud games, solving the problem that conventional technology could not realize the creation of koto scores in games and could only play and record existing koto scores in games, thereby further improving the user experience.

[0062] In step S520, in response to a touch event acting on the score control, note information of the score control corresponding to the touch event is obtained.

[0063] For example, referring to Figure 8, first, in response to the current user's touch operation on the recording start control shown in Figure 8, the system transitions to recording mode. Of course, before transitioning to recording mode, it is possible to set, for example, the BPM (Bytes Per Minute) value of the musical score and the number of grids in the musical score. Here, the BPM value can be used to control the scrolling speed of the musical score in the second display area, and the number of grids in the musical score can be used to control the number of grids of musical score displayed in the same grid. Once the settings are complete and the system transitions to recording mode, it is possible to receive touch events from the current user on each musical score control and obtain the note information of the musical score control corresponding to each touch event.

[0064] Furthermore, if the current user detects a touch event acting on any of the score controls in the interaction interface, the interaction interface displays the score control corresponding to the touch event in a first display method, and displays other score controls other than the one corresponding to the touch event in a second display method, where the touch event includes a first touch event entered with multiple fingers, a second touch event entered with a single finger, and a third touch event entered by an external device. Furthermore, after the touch event acting on the score control has ended, the information display method further includes adjusting the score control corresponding to the touch event from the first display method to the second display method in response to the end of the touch event.

[0065] For example, referring to Figure 11, if the musical score control corresponding to a touch event is the bass note 6, that musical score control can be displayed using the first display method, and the other musical score controls, excluding the bass note 6, can be displayed using the second display method. Here, the brightness of the first display method is not specifically limited to the second display method, such as being higher or lower. The reason for employing different display methods here is to allow the user to intuitively see the note they are currently touching, and after the user stops touching the interaction control, the display method of the interaction control can be returned from the first display method to the second display method, i.e., the original display method.

[0066] For example, the touch events described above may include a first touch event entered with multiple fingers (see Figure 12 for specifics), a second touch event entered with a single finger, and a third touch event entered with an external device, where the external device includes, but is not limited to, a mouse, keyboard, or handle.

[0067] Furthermore, in an executable embodiment, if a touch event is detected in which the current user interacts with the musical score control, the game program can play a sound that has been pre-set for the musical score control in response to the touch event in which the current user interacts with the musical score control; that is, the musical score control itself does not contain sound, and the game can play a sound corresponding to this musical score control. In another executable embodiment, the sound that the musical score control itself possesses can be played in response to a touch event in which the current user interacts with the musical score control; that is, the musical score control itself contains sound, and the sound that the musical score control itself possesses can be played directly.

[0068] Herein, regarding the interaction interface formed by masking, it is independent of the game program of the cloud game, that is, the cloud game platform itself provides the interaction interface formed by masking, and therefore, in order for the current user (i.e., the player) to realize interaction with the cloud game in the process of operating the game, they do not need to set their own voice for the score control, and of course, in an executable embodiment, a button can be set to switch whether or not to play the sound that the score control itself has, when turned on the sound that it has itself has been set, and when turned off the sound that has been set in advance for the score control in the game program has been set, but this example is not particularly limited.

[0069] In step S530, the musical note corresponding to the musical note information is displayed and recorded in the second predetermined area of ​​the display interface.

[0070] In this embodiment, displaying notes corresponding to the note information in a second predetermined area of ​​the display interface specifically includes scrolling the notes corresponding to the note information in the second predetermined area of ​​the display interface in real time at a first predetermined scrolling speed, where, during the scrolling display process, the position where the cursor remains is the position of the last note among the recorded notes.

[0071] For example, as shown in Figure 13, the current input note can be displayed in a second predetermined area, and during the process of displaying the current input note, it can be scrolled at a specific speed (first predetermined scroll speed). This first predetermined scroll speed is independent of the current user's note speed and must be set manually by the user (by manually setting the BPM value mentioned above). During the scrolling display process, the position where the cursor remains is the syllable currently being recorded, that is, the position of the last note among the currently input notes. After inputting one note, there is no need to manually drag the cursor to the next grid to input the next note. This method improves the input efficiency of the currently input note, enhances the convenience of inputting the current note, and further improves the user experience.

[0072] Furthermore, after displaying the notes corresponding to the note information, it is necessary to record and save the notes corresponding to that note information. In addition, it is possible to make it easier to generate the current musical score based on all the notes corresponding to the input note information, and to enable users to create their own musical scores.

[0073] Furthermore, if the touch event is a first touch event input with multiple fingers, the current input note display method includes displaying the notes of the pre-configured score control corresponding to the first touch event in order, based on the front-to-back positioning of the pre-configured score control corresponding to the first touch event in the interaction interface. For example, as shown in Figure 13, if the user inputs 45 in the bass range and 23 in the treble range simultaneously, 4 in the bass range is displayed, then 5 in the bass range, then 2 in the treble range, and finally 3 in the treble range. In the exemplary embodiments of this disclosure, the settings for the score controls corresponding to each note are configured in the order of bass-mid-treble, and each scale group is configured in the order of do(1), re(2), mi(3), fa(4), So(5), la(6), Si(7). Therefore, the display order of the bass region 45 and the treble region 23 is to first display bass region 4, then bass region 5, then treble region 2, and finally treble region 3. In actual application, the corresponding order can be set as needed, but this example is not particularly limited.

[0074] Furthermore, during the process of recording sheet music, you can pause recording at any time by touching the recording pause control, and you can also touch it again to resume recording, with re-recording pausing before continuing.

[0075] In an exemplary embodiment, after the recording of the score is complete, the recorded score can also be re-edited. Specifically, first, in response to a touch operation by the current user on the scene mode control, the display interface can be switched from a score creation scene to a score editing scene, and then, in response to a selection operation by the current user on a recorded note in a second display area, the recorded note corresponding to the selection operation can be edited, where editing the recorded note corresponding to the selection operation includes deleting or replacing the recorded note corresponding to the selection operation, and / or inserting another note in the place of the recorded note corresponding to the selection operation.

[0076] For example, referring to Figure 14, once the recording of the musical score is complete, it can be switched to editing mode. In editing mode, for example, the recorded musical score can be played back, and one or more recorded notes can be edited. Specific editing methods include deletion, switching, and insertion of other notes. In the specific editing process, in the second display area, a single note can be selected by clicking, and the corresponding musical score control in the interaction interface of the first display area is highlighted. Furthermore, notes can be added and deleted via the "click" and "cancel" buttons. The upper and lower areas of the first and second display areas are linked, allowing for real-time display of modifications. At the same time, if a note is not entered, it can be entered in the corresponding position, and the positions of other notes in the grid can be moved backward in sequence. Of course, this can be achieved in other ways, but this example is not particularly limited. Simultaneously, touching the play button switches the musical score in the second display area from editable to playback mode, and the score scrolls evenly. A specific example scene is shown in Figure 15.

[0077] Figure 16 is a schematic flowchart illustrating the process of issuing the current musical score. Specifically, issuing the current musical score may include the following steps.

[0078] In step S1610, in response to a touch operation on the scene mode control, the display interface is switched from the score editing scene to the score publishing scene. In step S1620, in response to a selection operation on the score attribute information included in the score issuance scene, a score details page is configured for the current score generated based on the current input note. In step S1630, the current score and the score details page are issued in response to a touch operation on the issuing control included in the score issuing scene.

[0079] The current method of publishing sheet music as shown in Figure 16 will be explained below using Figure 17. Specifically, as shown in Figure 17, after transitioning to the sheet music publishing scene, you can touch the song settings control and place attribute information for the current sheet music in the displayed song settings interface. Here, attribute information can include song title, song difficulty, background image, sheet music scrolling speed, etc., and of course, other attribute information such as author and album can also be included, and this example is not particularly limited. Furthermore, once the attribute information has been set, you can touch the publish control to publish the sheet music details page and the current sheet music. Of course, if you need to re-edit the current sheet music, you can touch the back control to return to edit mode and re-edit the current sheet music, and if you need to publish it, you can touch the corresponding control again to publish it.

[0080] An exemplary embodiment of the present disclosure provides a method for playing sheet music. Specifically, first, note feedback information is generated according to the agreement between the note information of the sheet music control corresponding to the touch event and the target note of the sheet music to be played displayed in the second display area. Next, a third display method for the sheet music to be played is determined according to the note feedback information and the current sheet music playing mode, and the sheet music to be played is controlled to be displayed in the second display area in the third display method. Here, generating note feedback information according to the agreement between the note information of the sheet music control corresponding to the touch event and the target note of the sheet music to be played displayed in the second display area specifically includes first determining whether the note information of the sheet music control corresponding to the touch event matches the current target note of the sheet music to be played displayed in the second display area, and then generating first note feedback information if the note information of the sheet music control corresponding to the touch event matches the current target note, and generating second note feedback information if the note information of the sheet music control corresponding to the touch event does not match the current target note.

[0081] In one embodiment, the current score performance mode includes either a practice performance mode or an automatic performance mode, wherein determining a third display method for the score to be performed according to the note feedback information and the current score performance mode, and controlling the display of the score to be performed in the second display area using the third display method, includes, when the score performance mode is a practice performance mode and the note feedback information is a first note feedback information, displaying the next note to be performed in the second display area; and when the score performance mode is an automatic performance mode, displaying the score to be performed in the second display area at a second predetermined scroll speed and displaying the note to be performed and the score controls corresponding to the note to be performed in the score to be performed using a fourth display method.

[0082] In one embodiment, the performance target note includes the current performance target note and the next performance target note corresponding to the current performance target note, wherein the fourth display method for displaying the performance target note and the score control corresponding to the performance target note in the performance target score includes displaying the current performance target note and the score control corresponding to the current performance target note in the performance target score with a first color mark, and displaying the next performance target note and the score control corresponding to the next performance target note in the performance target score with a second color mark.

[0083] For example, as shown in Figure 18, touching the performance controls in the koto score tool allows the user to transition to score performance mode. Here, score performance mode can include practice performance mode and automatic performance mode. Specifically, in performance practice mode, when the current user inputs the current input note into the interaction interface of the first display area, and that current input note matches the current target note in the second display area, the next target note (with a "next syllable" prompt) is displayed in the second display area. If the current input note does not match the current target note in the second display area, a prompt is given, specifically displaying the score control corresponding to the current input note in one display method, displaying the score control corresponding to the current target note in another display method, and further prompting the user, but not limited to these.

[0084] In one embodiment, when the score performance mode is an automatic performance mode, the information display method further includes determining the current display method of the score control corresponding to the touch event as a fifth display method when the note feedback information is a first note feedback information, and controlling the score control corresponding to the touch event to display in the fifth display method; and determining the current display method of the score control corresponding to the touch event as a sixth display method when the note feedback information is a second note feedback information, and controlling the score control corresponding to the touch event to display in the sixth display method.

[0085] For example, in automatic playback mode, a guide animation can be automatically played in the second display area based on a preset speed of the musical score. For instance, for the current syllable of the score (the note currently being played), the corresponding button displays an animation that grows from small to large, guiding the user to click (sound-game interaction). The system then provides feedback to the user's click, highlighting the note when played correctly and removing the highlight when played incorrectly. Specifically, if the note feedback information is the first note feedback information, the current display method of the score control corresponding to the touch event is determined to be the fifth display method (highlight), and the score control corresponding to the touch event is controlled to display in the fifth display method (highlight). If the note feedback information is the second note feedback information, the current display method of the score control corresponding to the touch event is determined to be the sixth display method (highlight removal), and the score control corresponding to the touch event is controlled to display in the sixth display method (highlight removal).

[0086] Regardless of whether it's practice mode or automatic playback mode, or whether it's the first or second display area, two styles, "blue" and "green," are displayed to distinguish between the "current syllable" and the "next syllable." Based on the color hints, the user can complete the performance by clicking the corresponding score control in the first display area.

[0087] In one embodiment, the information display method further includes switching the score to be played from a first display state to a second display state in response to a touch operation by the current user on the score to be played, wherein the first display state includes a thumbnail state and / or a display state, and if the first display state is a thumbnail state, the second display state is a display state, and if the first display state is a display state, the second display state is a thumbnail state. Exemplarily, Figure 19 shows an example of the score to be played in a thumbnail state, and Figure 20 shows an example of the score to be played in a display state, and in the actual application process, the corresponding state can be selected as needed, for example, in the process of playing back the score to be played or the currently recorded score, it is not necessary to see the notes contained in the score and it can be displayed in a thumbnail state. If it is necessary to play the score to be played or edit the currently recorded score, it can be displayed. In other words, you don't need to look at the sheet music during playback; you can view the sheet music by dragging the thumbnail area, and then you can drag the sheet music within the area to switch between visible and hidden states. Of course, you can also switch from the visible state to the thumbnail state by touching the playback / replay control.

[0088] The following are embodiments of the disclosed apparatus, which can be used to carry out embodiments of the disclosed method. For details not disclosed in the embodiments of the disclosed apparatus, refer to the embodiments of the disclosed method.

[0089] Embodiments of the present invention also provide an information display device arranged on a terminal device. As shown in Figure 21, the information display device includes a first display module 2110, a musical note information acquisition module 2120, and a second display module 2130.

[0090] The first display module 2110 is configured to display an interaction interface in a first predetermined area of ​​the terminal device's display interface, and to display an interaction interface including pre-configured score controls in a first predetermined area of ​​the terminal device's display interface. The note information acquisition module 2120 is configured to acquire note information of the score control corresponding to the touch event in response to a touch event acting on the score control. The second display module 2130 is configured to display and record musical notes corresponding to the musical note information in a second predetermined area of ​​the display interface.

[0091] In exemplary embodiments of the present disclosure, a game screen is further displayed on the display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, wherein the video stream is formed by encoding the game screen of a game program running on the cloud server, and the game screen is a screen corresponding to a musical instrument that is displayed in response to a call command for a pre-configured musical instrument provided by the game program. Here, the information display device further includes a mask module, The mask module is configured to call a pre-configured koto notation tool included in the cloud gaming platform, mask the pre-configured koto notation tool and pre-configured musical instrument tools, and obtain a display interface having a first predetermined display method. In this display interface, which has a first predetermined display method, the pre-configured koto score tool floats to the top layer of the pre-configured musical instrument tools.

[0092] In exemplary embodiments of the present disclosure, the score control is a key control of the koto tool, the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured instrument tool in the interaction interface.

[0093] In exemplary embodiments of this disclosure, displaying an interaction interface in a first predetermined area of ​​the display interface of a terminal device is: In response to a touch operation on the scene mode control, the display interface is switched from the current screen scene to the music composition scene. This includes displaying an interaction interface, including a koto music notation tool and musical instrument tools, in a first predetermined area of ​​the display interface of the terminal device.

[0094] In exemplary embodiments of the present disclosure, the information display device further includes a third display module. The third display module is configured to display the score control corresponding to the touch event on the interaction interface using a first display method, and to display other score controls other than the score control corresponding to the touch event on the interaction interface using a second display method. Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input by an external device.

[0095] In exemplary embodiments of this disclosure, the information display device further includes a display mode adjustment module, The display mode adjustment module is configured to adjust the score control corresponding to the touch event from the first display mode to the second display mode in response to the end of the touch event.

[0096] In exemplary embodiments of this disclosure, displaying a note corresponding to the note information in a second predetermined area of ​​the display interface is: The process includes scrolling and displaying the notes corresponding to the note information in real time in a second predetermined area of ​​the display interface at a first predetermined scrolling speed, wherein, during the scrolling display process, the position where the cursor remains is the position of the last note among the recorded notes.

[0097] In exemplary embodiments of the present disclosure, if the touch event is a first touch event entered with multiple fingers, the note display method is: This includes displaying the notes of a pre-configured musical score control corresponding to a first touch event in order, based on the front-to-back positioning order of the pre-configured musical score control corresponding to the first touch event in the interaction interface.

[0098] In exemplary embodiments of the present disclosure, the information display device further includes a first scene switching module and a note editing module, The first scene switching module is configured to switch the display interface from the score creation scene to the score editing scene in response to a touch operation on the scene mode control. The note editing module is configured to edit the recorded note corresponding to a selection operation in the second display area in response to the selection operation. Editing the recorded notes corresponding to the aforementioned selection operation is Deleting or switching recorded notes corresponding to the aforementioned selection operation, and / or This includes inserting other notes at the positions of the recorded notes corresponding to the selection operation.

[0099] In exemplary embodiments of the present disclosure, the information display device further includes a second scene switching module, a score detail page configuration module, and a score publishing module. The second scene switching module is configured to switch the display interface from the score editing scene to the score publishing scene in response to a touch operation on the scene mode control. The score detail page configuration module is configured to configure a score detail page for the current score generated from the notes in response to a selection operation on the score attribute information included in the score publishing scene. The score publishing module is configured to publish the current score and the score details page in response to touch operations on the publishing controls included in the score publishing scene.

[0100] In exemplary embodiments of the present disclosure, the information display device further includes a note feedback information generation module and a display method determination module, The note feedback information generation module is configured to generate note feedback information according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area. The display method determination module is configured to determine a third display method for the score to be played according to the note feedback information and the current score performance mode, and to control the display of the score to be played in the second display area according to the third display method.

[0101] In exemplary embodiments of this disclosure, note feedback information is generated according to the agreement between the note information of the score control corresponding to the touch event and the note to be played in the score to be played displayed in the second display area. The process involves determining whether the note information of the score control corresponding to the touch event matches the currently played note of the score to be played displayed in the second display area, If the note information of the score control corresponding to the aforementioned touch event matches the currently played note, first note feedback information is generated. This includes generating second note feedback information if the note information of the score control corresponding to the aforementioned touch event does not match the currently played note.

[0102] In exemplary embodiments of this disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode. Here, determining a third display method for the score to be played according to the note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method, If the aforementioned score performance mode is a practice performance mode and the aforementioned note feedback information is the first note feedback information, the next note to be played is displayed in the second display area. When the score performance mode is an automatic performance mode, the system includes displaying the score to be performed in the second display area at a second predetermined scrolling speed, and displaying the notes to be performed and the score controls corresponding to those notes in the score to be performed using a fourth display method.

[0103] In exemplary embodiments of the present disclosure, when the musical score playback mode is an automatic playback mode, the information display device further includes a fourth display module and a fifth display module. The fourth display module is configured to determine the current display method of the score control corresponding to the touch event as the fifth display method when the note feedback information is the first note feedback information, and to control the score control corresponding to the touch event to display in the fifth display method. The fifth display module is configured to determine the current display method of the score control corresponding to the touch event as the sixth display method when the note feedback information is the second note feedback information, and to control the score control corresponding to the touch event to display in the sixth display method.

[0104] In exemplary embodiments of this disclosure, the note to be played includes the current note to be played and the next note to be played corresponding to the current note to be played. Here, displaying the notes to be played and the score controls corresponding to the notes to be played in the score to be played using the fourth display method is: The first color mark displays the current note to be played in the aforementioned musical score and the musical score control corresponding to the current note to be played, This includes displaying the next note to be played and the score control corresponding to the next note to be played in the aforementioned score using a second color mark.

[0105] In exemplary embodiments of this disclosure, the information display device further includes a display state switching module, The display state switching module is configured to switch the score to be played from a first display state to a second display state in response to a touch operation on the score to be played, wherein the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state.

[0106] Details of each module in the above-mentioned information display device are described in detail in the corresponding information display method, so the explanation is omitted here.

[0107] While the detailed description above refers to several modules or units of the device for performing operations, such division is not mandatory. In practice, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in a single module or unit. Conversely, the features and functions of a single module or unit described above can be further divided and embodied in multiple modules or units.

[0108] Furthermore, while the accompanying drawings illustrate the steps of the method in this disclosure in a specific order, this does not require or imply that these steps must be performed in that specific order, or that all steps must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be merged into a single step execution, or a single step may be broken down into multiple step executions.

[0109] In exemplary embodiments of this disclosure, an electronic device capable of implementing the above method is also provided.

[0110] Those skilled in the art will understand that various aspects of the present disclosure can be implemented as systems, methods, or program products. Accordingly, various aspects of the present disclosure can be specifically implemented as complete hardware embodiments, complete software embodiments (including firmware, microcode, etc.), or embodiments combining hardware and software embodiments, which are collectively referred to here as “circuits,” “modules,” or “systems.”

[0111] The electronic device 2200 in this embodiment of the present disclosure will be described below with reference to Figure 22. The electronic device 2200 shown in Figure 22 is merely an example and does not impose any limitations on the function and scope of use of the embodiments of the present disclosure.

[0112] As shown in Figure 22, the electronic device 2200 is represented as a general-purpose computing device. The components of the electronic device 2200 may include, but are not limited to, the at least one processing unit 2210, the at least one storage unit 2220, a bus 2230 connecting different system components (including the storage unit 2220 and the processing unit 2210), and a display unit 2240.

[0113] The storage unit stores program code executable by the processing unit 2210, and the processing unit 2210 may perform steps in various embodiments of the present disclosure as described in the "Examples of Methods" section of this specification. For example, in step S510, the processing unit 2210 displays an interaction interface including a pre-configured musical score control in a first predetermined area of ​​the display interface of a terminal device; in step S520, in response to a touch event acting on the musical score control, it acquires musical note information of the musical score control corresponding to the touch event; and in step S530, it displays and records a musical note corresponding to the musical note information in a second predetermined area of ​​the display interface.

[0114] In exemplary embodiments of the present disclosure, a game screen is further displayed on the display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, wherein the video stream is formed by encoding the game screen of a game program running on the cloud server, and the game screen is a screen corresponding to a musical instrument that is displayed in response to a call command for a pre-configured musical instrument provided by the game program. Here, the information display method further includes, This includes calling a pre-configured koto music notation tool included in the cloud gaming platform, masking the pre-configured koto music notation tool and pre-configured musical instrument tools, and obtaining a display interface having a first predetermined display method. In this display interface, which has a first predetermined display method, the pre-configured koto score tool floats to the top layer of the pre-configured musical instrument tools.

[0115] In exemplary embodiments of the present disclosure, the score control is a key control of the koto tool, the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured instrument tool in the interaction interface.

[0116] In exemplary embodiments of this disclosure, displaying an interaction interface in a first predetermined area of ​​the display interface of a terminal device is: In response to a touch operation on the scene mode control, the display interface is switched from the current screen scene to the music composition scene. This includes displaying an interaction interface, including a koto music notation tool and musical instrument tools, in a first predetermined area of ​​the display interface of the terminal device.

[0117] In exemplary embodiments of this disclosure, the information display method further includes: The interaction interface includes displaying the score control corresponding to the touch event in a first display method, and displaying other score controls other than the score control corresponding to the touch event in a second display method. Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input by an external device.

[0118] In exemplary embodiments of this disclosure, the information display method further includes: This includes adjusting the score control corresponding to the touch event from a first display mode to a second display mode in response to the end of the touch event.

[0119] In exemplary embodiments of this disclosure, displaying a note corresponding to the note information in a second predetermined area of ​​the display interface is: The process includes scrolling and displaying the notes corresponding to the note information in real time in a second predetermined area of ​​the display interface at a first predetermined scrolling speed, wherein, during the scrolling display process, the position where the cursor remains is the position of the last note among the recorded notes.

[0120] In exemplary embodiments of the present disclosure, if the touch event is a first touch event entered with multiple fingers, the note display method is: This includes displaying the notes of a pre-configured musical score control corresponding to a first touch event in order, based on the front-to-back positioning order of the pre-configured musical score control corresponding to the first touch event in the interaction interface.

[0121] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the scene mode control, the display interface is switched from the score creation scene to the score editing scene, This includes editing the recorded note corresponding to a selection operation in a second display area in response to a selection operation on a recorded note, Editing the recorded notes corresponding to the aforementioned selection operation is Deleting or switching recorded notes corresponding to the aforementioned selection operation, and / or This includes inserting other notes at the positions of the recorded notes corresponding to the selection operation.

[0122] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the scene mode control, the display interface is switched from the score editing scene to the score publishing scene. In response to a selection operation on the score attribute information included in the aforementioned score issuance scene, a score details page is configured for the current score generated from the notes, This includes issuing the current score and the score details page in response to a touch operation on the issuing control included in the score issuing scene.

[0123] In exemplary embodiments of this disclosure, in response to a touch event acting on the score control, after obtaining note information of the score control corresponding to the touch event, the information display method further: The system generates note feedback information according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area, This includes determining a third display method for the score to be played according to the aforementioned note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method.

[0124] In exemplary embodiments of this disclosure, note feedback information is generated according to the agreement between the note information of the score control corresponding to the touch event and the note to be played in the score to be played displayed in the second display area. The process involves determining whether the note information of the score control corresponding to the touch event matches the currently played note of the score to be played displayed in the second display area, If the note information of the score control corresponding to the aforementioned touch event matches the currently played note, first note feedback information is generated. This includes generating second note feedback information if the note information of the score control corresponding to the aforementioned touch event does not match the currently played note.

[0125] In exemplary embodiments of this disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode. Here, determining a third display method for the score to be played according to the note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method, If the aforementioned score performance mode is a practice performance mode and the aforementioned note feedback information is the first note feedback information, the next note to be played is displayed in the second display area. When the score performance mode is an automatic performance mode, the system includes displaying the score to be performed in the second display area at a second predetermined scrolling speed, and displaying the notes to be performed and the score controls corresponding to those notes in the score to be performed using a fourth display method.

[0126] In exemplary embodiments of this disclosure, when the musical score playback mode is an automatic playback mode, the information display method further includes: If the aforementioned note feedback information is the first note feedback information, the current display method of the score control corresponding to the touch event is determined to be the fifth display method, and the score control corresponding to the touch event is controlled to display in the fifth display method. If the aforementioned note feedback information is second note feedback information, the current display method of the score control corresponding to the touch event is determined as the sixth display method, and the score control corresponding to the touch event is controlled to display in the sixth display method.

[0127] In exemplary embodiments of this disclosure, the note to be played includes the current note to be played and the next note to be played corresponding to the current note to be played. Here, displaying the notes to be played and the score controls corresponding to the notes to be played in the score to be played using the fourth display method is: The first color mark displays the current note to be played in the aforementioned musical score and the musical score control corresponding to the current note to be played, This includes displaying the next note to be played and the score control corresponding to the next note to be played in the aforementioned score using a second color mark.

[0128] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the musical score to be played, the musical score to be played is switched from a first display state to a second display state, wherein the first display state includes a thumbnail state and / or a display state, and if the first display state is a thumbnail state, the second display state is a display state, and if the first display state is a display state, the second display state is a thumbnail state.

[0129] The specific details of the information display method operating in this embodiment are also applicable to the previously described embodiments of the information display method, so a detailed explanation is omitted here.

[0130] The above embodiment achieves real-time display of musical notes by, on the one hand, displaying an interaction interface in a first predetermined area on the display interface of a terminal device, and in response to a touch event acting on the musical score control, acquiring musical note information of the musical score control corresponding to the touch event, and finally displaying and recording the musical note corresponding to the musical note information in a second predetermined area on the display interface, thereby solving the problem in conventional technology where recorded musical notes could not be viewed in real time. On the other hand, since the musical note corresponding to the input musical note information can be viewed in real time while inputting the musical note information, current users can see the input musical notes in a timely manner, improving the convenience for users when viewing input musical notes and further enhancing the user experience.

[0131] The memory unit 2220 may include a readable medium in the form of a volatile memory unit such as a random access memory unit (RAM) 22201 and / or a cache memory unit 22202, and may also include a read-only memory unit (ROM) 22203.

[0132] The memory unit 2220 also includes an operating system, one or more applications, other program modules, and program data, but each or some combination of these examples may include, but is not limited to, a program / utility 22204 having a set (at least one) of program modules 22205 which may include an implementation of a network environment.

[0133] Bus 2230 can represent one or more of several classes of bus structures, including a memory cell bus or memory cell controller, peripheral bus, graphical acceleration port, processing unit, or local bus that uses any of the bus structures among a plurality of bus structures.

[0134] The electronic device 2200 can also communicate with one or more external devices 2300, such as a keyboard, pointing device, and Bluetooth device; it can communicate with one or more devices that allow a user to interact with the electronic device 2200; and / or it can communicate with any device (such as a router or modem) that allows the electronic device 2200 to communicate with one or more other computing devices. This communication can be done via the input / output (I / O) interface 2250. The electronic device 2200 can also communicate with one or more networks, such as a local area network (LAN), a wide area network (WAN), and / or the internet, via the network adapter 2260. As shown in the figure, the network adapter 2260 communicates with other modules of the electronic device 2200 via the bus 2230. It should be understood that other hardware and / or software modules, including but not limited to microcode, device drives, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, can be used in combination with the electronic device 2200, although these are not shown.

[0135] As will be readily apparent to those skilled in the art based on the above description of embodiments, the exemplary embodiments described herein can be implemented by software and by combining the necessary hardware with the software. Accordingly, the technical aspects of the embodiments of this disclosure may be embodied in the form of a software product which may be stored on a single non-volatile storage medium (which may be a CD-ROM, USB disk, mobile hard disk, etc.) and include a plurality of instructions for performing the methods of the embodiments of this disclosure.

[0136] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided that stores a program product capable of implementing the methods described herein. In some possible embodiments, various aspects of this disclosure can also be implemented in the form of program code, which includes a program product that causes a terminal device to perform the following steps, when executed on the terminal device, according to the various embodiments of this disclosure described in the “Method” section herein: In step S510, an interaction interface including a pre-configured musical score control is displayed in a first predetermined area of ​​the display interface of the terminal device; in step S520, in response to a touch event acting on the musical score control, note information of the musical score control corresponding to the touch event is obtained; and in step S530, a note corresponding to the note information is displayed and recorded in a second predetermined area of ​​the display interface.

[0137] In exemplary embodiments of the present disclosure, a game screen is further displayed on the display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, wherein the video stream is formed by encoding the game screen of a game program running on the cloud server, and the game screen is a screen corresponding to a musical instrument that is displayed in response to a call command for a pre-configured musical instrument provided by the game program. Here, the information display method further includes, This includes calling a pre-configured koto music notation tool included in the cloud gaming platform, masking the pre-configured koto music notation tool and pre-configured musical instrument tools, and obtaining a display interface having a first predetermined display method. In this display interface, which has a first predetermined display method, the pre-configured koto score tool floats to the top layer of the pre-configured musical instrument tools.

[0138] In exemplary embodiments of the present disclosure, the score control is a key control of the koto tool, the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured instrument tool in the interaction interface.

[0139] In exemplary embodiments of this disclosure, displaying an interaction interface in a first predetermined area of ​​the display interface of a terminal device is: In response to a touch operation on the scene mode control, the display interface is switched from the current screen scene to the music composition scene. This includes displaying an interaction interface, including a koto music notation tool and musical instrument tools, in a first predetermined area of ​​the display interface of the terminal device.

[0140] In exemplary embodiments of this disclosure, the information display method further includes: The interaction interface includes displaying the score control corresponding to the touch event in a first display method, and displaying other score controls other than the score control corresponding to the touch event in a second display method. Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input by an external device.

[0141] In exemplary embodiments of this disclosure, the information display method further includes: This includes adjusting the score control corresponding to the touch event from a first display mode to a second display mode in response to the end of the touch event.

[0142] In exemplary embodiments of this disclosure, displaying a note corresponding to the note information in a second predetermined area of ​​the display interface is: The process includes scrolling and displaying the notes corresponding to the note information in real time in a second predetermined area of ​​the display interface at a first predetermined scrolling speed, wherein, during the scrolling display process, the position where the cursor remains is the position of the last note among the recorded notes.

[0143] In exemplary embodiments of the present disclosure, if the touch event is a first touch event entered with multiple fingers, the note display method is: This includes displaying the notes of a pre-configured musical score control corresponding to a first touch event in order, based on the front-to-back positioning order of the pre-configured musical score control corresponding to the first touch event in the interaction interface.

[0144] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the scene mode control, the display interface is switched from the score creation scene to the score editing scene, This includes editing the recorded note corresponding to a selection operation in a second display area in response to a selection operation on a recorded note, Editing the recorded notes corresponding to the aforementioned selection operation is Deleting or switching recorded notes corresponding to the aforementioned selection operation, and / or This includes inserting other notes at the positions of the recorded notes corresponding to the selection operation.

[0145] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the scene mode control, the display interface is switched from the score editing scene to the score publishing scene. In response to a selection operation on the score attribute information included in the aforementioned score issuance scene, a score details page is configured for the current score generated from the notes, This includes issuing the current score and the score details page in response to a touch operation on the issuing control included in the score issuing scene.

[0146] In exemplary embodiments of this disclosure, in response to a touch event acting on the score control, after obtaining note information of the score control corresponding to the touch event, the information display method further: The system generates note feedback information according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area, This includes determining a third display method for the score to be played according to the aforementioned note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method.

[0147] In exemplary embodiments of this disclosure, note feedback information is generated according to the agreement between the note information of the score control corresponding to the touch event and the note to be played in the score to be played displayed in the second display area. The process involves determining whether the note information of the score control corresponding to the touch event matches the currently played note of the score to be played displayed in the second display area, If the note information of the score control corresponding to the aforementioned touch event matches the currently played note, first note feedback information is generated. This includes generating second note feedback information if the note information of the score control corresponding to the aforementioned touch event does not match the currently played note.

[0148] In exemplary embodiments of this disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode. Here, determining a third display method for the score to be played according to the note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method, If the aforementioned score performance mode is a practice performance mode and the aforementioned note feedback information is the first note feedback information, the next note to be played is displayed in the second display area. When the score performance mode is an automatic performance mode, the system includes displaying the score to be performed in the second display area at a second predetermined scrolling speed, and displaying the notes to be performed and the score controls corresponding to those notes in the score to be performed using a fourth display method.

[0149] In exemplary embodiments of this disclosure, when the musical score playback mode is an automatic playback mode, the information display method further includes: If the aforementioned note feedback information is the first note feedback information, the current display method of the score control corresponding to the touch event is determined to be the fifth display method, and the score control corresponding to the touch event is controlled to display in the fifth display method. If the aforementioned note feedback information is second note feedback information, the current display method of the score control corresponding to the touch event is determined as the sixth display method, and the score control corresponding to the touch event is controlled to display in the sixth display method.

[0150] In exemplary embodiments of this disclosure, the note to be played includes the current note to be played and the next note to be played corresponding to the current note to be played. Here, displaying the notes to be played and the score controls corresponding to the notes to be played in the score to be played using the fourth display method is: The first color mark displays the current note to be played in the aforementioned musical score and the musical score control corresponding to the current note to be played, This includes displaying the next note to be played and the score control corresponding to the next note to be played in the aforementioned score using a second color mark.

[0151] In exemplary embodiments of this disclosure, the information display method further includes: In response to a touch operation on the musical score to be played, the musical score to be played is switched from a first display state to a second display state, wherein the first display state includes a thumbnail state and / or a display state, and if the first display state is a thumbnail state, the second display state is a display state, and if the first display state is a display state, the second display state is a thumbnail state.

[0152] The specific details of the information display method operating in this embodiment are also applicable to the previously described embodiments of the information display method, so a detailed explanation is omitted here.

[0153] The above embodiment enables real-time viewing of musical notes by, on the one hand, displaying an interaction interface in a first predetermined area on the display interface of a terminal device, and in response to a touch event acting on the musical score control, acquiring musical note information of the musical score control corresponding to the touch event, and finally displaying and recording the musical note corresponding to the musical note information in a second predetermined area on the display interface, thereby solving the problem in conventional technology where recorded musical notes could not be viewed in real time. On the other hand, since the musical note corresponding to the input musical note information can be viewed in real time while inputting that information, current users can view the input musical notes in a timely manner, improving the convenience for users when viewing input musical notes and further enhancing the user experience.

[0154] In one embodiment of the present disclosure, a program product for implementing the method described above employs a portable compact disc read-only memory (CD-ROM), includes program code, and can run on a terminal device such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this file, the readable storage medium may be any tangible medium that includes or stores a program that instructs the execution of a system, apparatus, or device, or can be used in combination with them.

[0155] A program product may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. The readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of more than one. More specific examples (a non-exclusive list) of readable storage media include electrical connections, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0156] A computer-readable signaling medium may include data signals that are contained within a baseband carrying readable program code or propagated as part of a carrier wave. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination described above. The readable signaling medium may be any readable medium other than a readable storage medium capable of transmitting, propagating, or transmitting programs used by or in combination with instruction execution systems, apparatus, or devices.

[0157] Program code contained in a readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, optical cable, RF, or any suitable combination thereof.

[0158] The program code for performing the operations of this disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java and C++, as well as traditional procedural programming languages ​​such as the "C" language, or similar programming languages. The program code can run entirely on a user computing device, partially on a user computing device, run as a standalone package, run partially on a user computing device and partially on a remote computing device, or run entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device can connect to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or can connect to an external computing device (for example, one that can be connected via the Internet using an Internet service provider).

[0159] Furthermore, the aforementioned drawings are a schematic description of the processes included in the methods of exemplary embodiments of this disclosure and are not intended to limit them. It is also easy to understand that the processes shown in the aforementioned drawings do not represent or limit the timeline of these processes. It is also easy to understand that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0160] Those skilled in the art will readily conceive of other embodiments of the present disclosure. This application aims to cover any variations, uses, or adaptability changes of the present disclosure, including common or conventional means known in the art that are not inventive of the present disclosure, in accordance with the general principles of the present disclosure. The specification and embodiments are for illustrative purposes only, and the true scope and spirit of the present disclosure are indicated by the claims.

Claims

1. Displaying an interaction interface including pre-configured musical score controls in a first predetermined area of ​​the terminal device's display interface, In response to a touch event acting on the aforementioned score control, the note information of the score control corresponding to the touch event is obtained, This includes displaying and recording a musical note corresponding to the musical note information in a second predetermined area of ​​the display interface. A method for displaying information characterized by the following features.

2. The terminal device's display interface further displays a game screen, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding the game screen of a game program running on the cloud server, and the game screen being a screen corresponding to a musical instrument that is displayed in response to a pre-configured call command for a musical instrument provided by the game program. The aforementioned information display method further includes, This includes calling a pre-configured koto music notation tool included in the cloud gaming platform, masking the pre-configured koto music notation tool and pre-configured musical instrument tools, and obtaining a display interface having a first predetermined display method. In a display interface equipped with a first predetermined display method, the pre-configured koto score tool floats to the top layer of the pre-configured musical instrument tools. The information display method according to feature 1.

3. The aforementioned score control is a key control of the koto score tool, and the score control displays the notes and / or abbreviations and instrument attributes of the score control, and the score control corresponds one-to-one with the position of the key control of the pre-configured instrument tool in the interaction interface. The information display method according to feature 2.

4. Displaying an interaction interface in a first predetermined area of ​​the terminal device's display interface is, In response to a touch operation on the scene mode control, the display interface is switched from the current screen scene to the music composition scene. This includes displaying an interaction interface, including a koto music notation tool and musical instrument tools, in a first predetermined area of ​​the display interface of the terminal device. The information display method according to feature 2.

5. The aforementioned information display method further includes, The interaction interface includes displaying the score control corresponding to the touch event in a first display method, and displaying other score controls other than the score control corresponding to the touch event in a second display method. The touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input by an external device. The information display method according to feature 1.

6. The aforementioned information display method further includes, This includes adjusting the score control corresponding to the touch event from a first display method to a second display method in response to the end of the touch event. The information display method according to feature 5.

7. Displaying and recording the musical notes corresponding to the musical note information in the second predetermined area of ​​the display interface is: The process includes scrolling and displaying notes corresponding to the note information in real time in a second predetermined area of ​​the display interface at a first predetermined scrolling speed, wherein the cursor remains at the position of the last note among the recorded notes. The information display method according to feature 6.

8. If the aforementioned touch event is a first touch event input with multiple fingers, the note display method is: This includes displaying the notes of a pre-configured musical score control corresponding to a first touch event in order, based on the front-to-back positioning order of the pre-configured musical score control corresponding to the first touch event in the interaction interface. The information display method according to feature 7.

9. The aforementioned information display method further includes, In response to a touch operation on the scene mode control, the display interface is switched from the score creation scene to the score editing scene, This includes editing the recorded note corresponding to a selection operation in a second display area in response to a selection operation on a recorded note, Editing the recorded notes corresponding to the aforementioned selection operation is To delete or switch the recorded notes corresponding to the selection operation, and / or, This includes inserting other notes at the location of the recorded notes corresponding to the selection operation. The information display method according to feature 1.

10. The aforementioned information display method further includes, In response to a touch operation on the scene mode control, the display interface is switched from the score editing scene to the score publishing scene. In response to a selection operation on the score attribute information included in the aforementioned score issuance scene, a score details page is configured for the current score generated from the notes, This includes issuing the current score and the score details page in response to a touch operation on the issuing control included in the score issuing scene. The information display method according to feature 1.

11. In response to a touch event acting on the aforementioned score control, after obtaining the note information of the score control corresponding to the touch event, the information display method further: Note feedback information is generated according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area. This includes determining a third display method for the score to be played according to the aforementioned note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method. The information display method according to feature 1.

12. The generation of note feedback information according to the correspondence between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area is as follows: The process involves determining whether the note information of the score control corresponding to the touch event matches the currently played note of the score to be played displayed in the second display area, If the note information of the score control corresponding to the aforementioned touch event matches the currently played note, first note feedback information is generated. This includes generating second note feedback information if the note information of the score control corresponding to the aforementioned touch event does not match the currently played note. The information display method according to feature 11.

13. The aforementioned current score playback mode includes practice playback mode or automatic playback mode, Determining a third display method for the score to be played according to the aforementioned note feedback information and the current score performance mode, and controlling the score to be played to be displayed in the second display area using the third display method, If the aforementioned score performance mode is a practice performance mode and the aforementioned note feedback information is the first note feedback information, the next note to be played is displayed in the second display area. When the aforementioned score performance mode is an automatic performance mode, the performance includes displaying the score to be performed in the second display area at a second predetermined scrolling speed, and displaying the notes to be performed and the score controls corresponding to the notes to be performed in the score to be performed using a fourth display method. The information display method according to claim 12, characterized by its features.

14. If the aforementioned score playback mode is the automatic playback mode, the information display method further includes: If the note feedback information is the first note feedback information, the current display method of the score control corresponding to the touch event is determined as the fifth display method, and the score control corresponding to the touch event is controlled to display in the fifth display method. If the aforementioned note feedback information is second note feedback information, the current display method of the score control corresponding to the touch event is determined as the sixth display method, and the score control corresponding to the touch event is controlled to display in the sixth display method. The information display method according to claim 12, characterized by its features.

15. The aforementioned note to be played includes the current note to be played and the next note to be played that corresponds to the current note to be played. Displaying the target notes and the corresponding score controls in the target musical score in the fourth display method is: The first color mark displays the current note to be played in the aforementioned musical score and the musical score control corresponding to the current note to be played, This includes displaying the next note to be played and the score control corresponding to the next note to be played in the aforementioned musical score using a second color mark. The information display method according to feature 13.

16. The aforementioned information display method further includes, In response to a touch operation on the musical score to be played, the musical score to be played is switched from a first display state to a second display state, the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state includes a thumbnail state. The information display method according to any one of claims 11 to 15.

17. An information display device including a first display module, a musical note information acquisition module, and a second display module, The first display module is configured to display an interaction interface, including a pre-configured musical score control, in a first predetermined area of ​​the display interface of the terminal device. The note information acquisition module is configured to acquire note information of the score control corresponding to the touch event in response to a touch event acting on the score control. The second display module is configured to display and record musical notes corresponding to the musical note information in a second predetermined area of ​​the display interface. An information display device characterized by the following features.

18. When executed by the processor, it stores a computer program that implements the information display method described in any one of claims 1 to 16. A computer-readable storage medium characterized by the following features.

19. An electronic device comprising a processor and a memory for storing executable instructions of the processor, The processor is configured to execute the information display method described in any one of claims 1 to 16 by executing the executable instructions. An electronic device characterized by the following features.