Information display method, apparatus, computer-readable storage medium and electronic device
By displaying the interactive interface on the display interface of the terminal device and obtaining the music note information in the touch event, real-time display and recording of music notes is realized, solving the problem that real-time recording cannot be displayed and recorded in the prior art, and improving the user experience.
Patent Information
- Application Number
- JP2024563228
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-04-26
- Filing Date
- 2022-09-06
- Publication Date
- 2025-05-09
- Estimated Expiration
- 2042-09-06
AI Technical Summary
The prior art cannot display recorded music notes in real time, resulting in users being unable to view input music notes instantly.
By displaying an interactive interface on the display interface of the terminal device, including preset score control, the music note information corresponding to the score control is obtained when a touch event occurs, and these notes are displayed and recorded in real time in the second predetermined area of the interface.
Real-time display and recording of music notes is realized, solving the problem that users cannot view input notes instantly, and improving user experience and operation convenience.
Smart Images

Figure 2025514854000001_ABST
Abstract
Description
Cross-references to related applications
[0001] This disclosure claims priority to the application documents of Application No. 202210449892.8, filing date: April 26, 2022, title: Information display method and apparatus, computer-readable storage medium, and electronic device, the entire contents of which are incorporated herein by reference. [Technical field]
[0002] The embodiments of the present disclosure relate to the technical field of human-machine interaction, and in particular to an information display method, an information display device, a computer-readable storage medium, and an electronic device. [Background technology]
[0003] Conventional music notation generation methods can automatically record the music played by the user onto a koto score, but they cannot display the recorded notes in real time during recording. Summary of the Invention
[0004] The objective of the present disclosure is to provide an information display method, an information display device, a computer-readable storage medium and an electronic device that can overcome, at least to some extent, the problem of being unable to display recorded musical notes in real time due to limitations and deficiencies in the related art.
[0005] One aspect of the present disclosure provides an information display method, the information display method comprising: Displaying an interaction interface including predefined musical score controls in a first predetermined area of a display interface of the terminal device; In response to a touch event acting on the score control, obtaining note information of the score control corresponding to the touch event; and displaying and recording notes corresponding to the note information in a second predetermined area of the display interface.
[0006] In an exemplary embodiment of the present disclosure, a game screen is further displayed on a display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding a game screen of a game program executed on the cloud server, and the game screen being a screen corresponding to a musical instrument tool displayed in response to a call command for a preset musical instrument tool provided from the game program; Here, the information display method further includes: Invoking a preset string tool included in the cloud gaming platform, masking the preset string tool and the preset musical instrument tool, and obtaining a display interface having a first predetermined display manner; Here, in a display interface having a first predetermined display manner, the pre-defined zither score tool appears on the top layer of the pre-defined musical instrument tools.
[0007] In an exemplary embodiment of the present disclosure, the score control is a key control of the koto score tool, the score control displays the notes and / or abbreviated staves of the score control and the instrument attributes of the score control, and the score control has a one-to-one correspondence with the position of the key control of the pre-set musical instrument tool in the interaction interface.
[0008] In an exemplary embodiment of the present disclosure, displaying an interaction interface in a first predetermined area of a display interface of a terminal device includes: switching the display interface from a current screen scene to a score creation scene in response to a touch operation on a scene mode control; Displaying an interaction interface including a koto score tool and a musical instrument tool in a first predetermined area of a display interface of the terminal device.
[0009] In an exemplary embodiment of the present disclosure, the information display method further comprises: Displaying a score control corresponding to the touch event on the interaction interface in a first display manner, and displaying other score controls than the score control corresponding to the touch event on the interaction interface in a second display manner; Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input from an external device.
[0010] In an exemplary embodiment of the present disclosure, the information display method further comprises: In response to the touch event terminating, adjusting a sheet music control corresponding to the touch event from a first display format to a second display format.
[0011] In an exemplary embodiment of the present disclosure, displaying notes corresponding to the note information in a second predetermined area of the display interface includes: The method includes scrolling and displaying notes corresponding to the note information in a second predetermined area of the display interface in real time at a first predetermined scroll speed, wherein, during the scrolling process, the position where the cursor remains is the position where the last note of the recorded notes is located.
[0012] In an exemplary embodiment of the present disclosure, when the touch event is a first touch event inputted by multiple fingers, the display method of the musical note is The method includes sequentially displaying notes of a preset score control corresponding to the first touch event based on the front-to-back order of placement positions in the interaction interface of the preset score control corresponding to the first touch event.
[0013] In an exemplary embodiment of the present disclosure, the information display method further comprises: switching the display interface from a score creation scene to a score editing scene in response to a touch operation on a scene mode control; in response to a selection operation on a recorded note in the second display area, editing the recorded note corresponding to the selection operation; Editing the recorded note corresponding to the selection operation includes: deleting or switching the recorded note corresponding to said selection operation; and / or and inserting another note at the position of the recorded note that corresponds to said selection operation.
[0014] In an exemplary embodiment of the present disclosure, the information display method further comprises: Switching the display interface from a score editing scene to a score publishing scene in response to a touch operation on a scene mode control; In response to a selection operation on score attribute information included in the score publishing scene, constructing a score detail page for a current score generated from the musical notes; and publishing the current score and the score detail page in response to a touch operation on a publishing control included in the score publishing scene.
[0015] In an exemplary embodiment of the present disclosure, in response to a touch event acting on the musical score control, after obtaining musical note information of the musical score control corresponding to the touch event, the information display method further includes: generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area; The method includes determining a third display method of the target score according to the note feedback information and the current score performance mode, and controlling the display of the target score in the second display area in the third display method.
[0016] In an exemplary embodiment of the present disclosure, generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area includes: determining whether note information of a musical score control corresponding to the touch event matches a currently-played note of a musical score to be played displayed in the second display area; When the note information of the musical score control corresponding to the touch event matches the currently played note, generating a first note feedback information; and generating second note feedback information when the note information of the score control corresponding to the touch event does not match the currently played note.
[0017] In an exemplary embodiment of the present disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode; Here, determining a third display manner of the target score according to the note feedback information and the current score playing mode, and controlling to display the target score in the second display area in the third display manner, When the score performance mode is a practice performance mode and the note feedback information is a first note feedback information, displaying a next note to be performed in the second display area; When the score performance mode is an automatic performance mode, the method includes displaying the target score in the second display area at a second predetermined scroll speed, and displaying the target notes in the target score and score controls corresponding to the target notes in a fourth display method.
[0018] In an exemplary embodiment of the present disclosure, when the score performance mode is an automatic performance mode, the information display method further includes: When the note feedback information is a first note feedback information, a current display mode of a score control corresponding to the touch event is determined as a fifth display mode, and the score control corresponding to the touch event is controlled to be displayed in the fifth display mode; When the note feedback information is second note feedback information, a current display mode of the score control corresponding to the touch event is determined as a sixth display mode, and the score control corresponding to the touch event is controlled to be displayed in the sixth display mode.
[0019] In an exemplary embodiment of the present disclosure, the performance target notes include a current performance target note and a next performance target note corresponding to the current performance target note, Here, displaying the target notes in the target musical score and the musical score controls corresponding to the target notes in the fourth display format includes: displaying a current target note and a score control corresponding to the current target note in the target score with a first color mark; and displaying the next target note in the target musical score and a musical score control corresponding to the next target note with a second color mark.
[0020] In an exemplary embodiment of the present disclosure, the information display method further comprises: In response to a touch operation on the musical score to be performed, the musical score to be performed is switched from a first display state to a second display state, the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state.
[0021] One aspect of the present disclosure provides an information display device including a first display module, a musical note information acquisition module, and a second display module; The first display module is configured to display an interaction interface including a preset score control in a first predetermined area of a display interface of the terminal device; The note information acquisition module is configured to acquire note information of the score control corresponding to a touch event in response to the touch event acting on the score control; The second display module is configured to display and record musical notes corresponding to the musical note information in a second predetermined area of the display interface.
[0022] In an exemplary embodiment of the present disclosure, a game screen is further displayed on a display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding a game screen of a game program executed on the cloud server, and the game screen being a screen corresponding to a musical instrument tool displayed in response to a call command for a preset musical instrument tool provided from the game program; Here, the information display device further includes a mask module, The mask module is configured to call a preset string tool included in the cloud game platform, mask the preset string tool and the preset musical instrument tool, and obtain a display interface having a first predetermined display manner; Here, in a display interface having a first predetermined display manner, the pre-defined zither score tool appears on the top layer of the pre-defined musical instrument tools.
[0023] In an exemplary embodiment of the present disclosure, the score control is a key control of the koto score tool, the score control displays the notes and / or abbreviated staves of the score control and the instrument attributes of the score control, and the score control has a one-to-one correspondence with the position of the key control of the pre-set musical instrument tool in the interaction interface.
[0024] In an exemplary embodiment of the present disclosure, displaying an interaction interface in a first predetermined area of a display interface of a terminal device includes: switching the display interface from a current screen scene to a score creation scene in response to a touch operation on a scene mode control; Displaying an interaction interface including a musical instrument tool and a musical instrument tool in a first predetermined area of a display interface of the terminal device.
[0025] In an exemplary embodiment of the present disclosure, the information display device further includes a third display module, a third display module configured to display a score control corresponding to the touch event on the interaction interface in a first display manner, and display other score controls than the score control corresponding to the touch event on the interaction interface in a second display manner; Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input from an external device.
[0026] In an exemplary embodiment of the present disclosure, the information display device further includes a display method adjustment module; The display scheme adjustment module is configured to adjust, in response to an end of the touch event, a score control corresponding to the touch event from a first display scheme to a second display scheme.
[0027] In an exemplary embodiment of the present disclosure, displaying notes corresponding to the note information in a second predetermined area of the display interface includes: The method includes scrolling and displaying notes corresponding to the note information in a second predetermined area of the display interface in real time at a first predetermined scroll speed, wherein the position where the cursor remains during the scrolling process is the position where the last note among the recorded notes is located.
[0028] In an exemplary embodiment of the present disclosure, when the touch event is a first touch event inputted by multiple fingers, the display method of the musical note is The method includes sequentially displaying notes of a preset score control corresponding to the first touch event based on the front-to-back order of placement positions in the interaction interface of the preset score control corresponding to the first touch event.
[0029] In an exemplary embodiment of the present disclosure, the information display device further includes a first scene switching module and a note editing module; a first scene switching module configured to switch the display interface from a score creation scene to a score editing scene in response to a touch operation on a scene mode control; the note editing module is configured to, in response to a selection operation on a recorded note in the second display area, edit the recorded note corresponding to the selection operation; Editing the recorded note corresponding to the selection operation includes: deleting or switching the recorded note corresponding to said selection operation; and / or and inserting another note at the position of the recorded note that corresponds to said selection operation.
[0030] In an exemplary embodiment of the present disclosure, the information display device further includes a second scene switching module, a score detail page configuration module, and a score publishing module; the second scene switching module is configured to switch the display interface from a score editing scene to a score publishing scene in response to a touch operation on a scene mode control; The score details page configuration module is configured to configure a score details page for a current score generated from the musical notes in response to a selection operation on the score attribute information included in the score publishing scene; A score publishing module is configured to publish the current score and the score details page in response to a touch operation on a publishing control included in the score publishing scene.
[0031] In an exemplary embodiment of the present disclosure, the information display device further includes a note feedback information generation module and a display method determination module; The musical note feedback information generation module is configured to generate musical note feedback information according to a consistency between the musical note information of the musical score control corresponding to the touch event and the performance target note of the performance target musical score displayed in the second display area; The display method determination module is configured to determine a third display method of the target score according to the note feedback information and the current score performance mode, and control the display of the target score in the second display area in the third display method.
[0032] In an exemplary embodiment of the present disclosure, generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area includes: determining whether note information of a musical score control corresponding to the touch event matches a currently-played note of a musical score to be played displayed in the second display area; When the note information of the musical score control corresponding to the touch event matches the currently played note, generating a first note feedback information; and generating second note feedback information when the note information of the score control corresponding to the touch event does not match the currently played note.
[0033] In an exemplary embodiment of the present disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode; Here, determining a third display manner of the target score according to the note feedback information and the current score playing mode, and controlling to display the target score in the second display area in the third display manner, When the score performance mode is a practice performance mode and the note feedback information is a first note feedback information, displaying a next note to be performed in the second display area; When the score performance mode is an automatic performance mode, the method includes displaying the target score in the second display area at a second predetermined scroll speed, and displaying the target notes in the target score and score controls corresponding to the target notes in a fourth display method.
[0034] In an exemplary embodiment of the present disclosure, when the score playing mode is an automatic playing mode, the information display device further includes a fourth display module and a fifth display module; the fourth display module is configured to determine a current display manner of the score control corresponding to the touch event as a fifth display manner when the note feedback information is first note feedback information, and control the score control corresponding to the touch event to be displayed in the fifth display manner; The fifth display module is configured to determine a current display manner of the musical score control corresponding to the touch event as a sixth display manner when the musical note feedback information is second musical note feedback information, and control the musical score control corresponding to the touch event to be displayed in the sixth display manner.
[0035] In an exemplary embodiment of the present disclosure, the performance target notes include a current performance target note and a next performance target note corresponding to the current performance target note, Here, displaying the target notes in the target musical score and the musical score controls corresponding to the target notes in the fourth display format includes: displaying a current target note and a score control corresponding to the current target note in the target score with a first color mark; and displaying the next target note in the target musical score and a musical score control corresponding to the next target note with a second color mark.
[0036] In an exemplary embodiment of the present disclosure, the information display device further includes a display state switching module, The display state switching module is configured to switch the target score from a first display state to a second display state in response to a touch operation on the target score, the first display state including a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state.
[0037] One aspect of the present disclosure provides a computer-readable storage medium storing a computer program which, when executed by a processor, realizes any of the information display methods described above.
[0038] One aspect of the present disclosure provides an electronic device including a processor and a memory storing executable instructions for the processor, The processor is configured to execute the executable instructions to perform any one of the methods for displaying information described above.
[0039] An embodiment of the present disclosure provides an information display method, by displaying an interaction interface in a first predetermined area of a display interface of a terminal device, in response to a touch event acting on a musical score control, obtaining note information of the musical score control corresponding to the touch event, and finally displaying and recording notes corresponding to the note information in a second predetermined area of the display interface, thereby realizing real-time display of notes, and solving the problem in the prior art that recorded notes cannot be displayed in real time; on the other hand, since the notes corresponding to the note information can be viewed in real time while inputting note information, current users can view the input notes in a timely manner, which improves the convenience of users when viewing the input notes, and further improves the user experience.
[0040] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. [Brief description of the drawings]
[0041] The drawings herein are incorporated into the specification, show embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure. Obviously, the drawings in the following description are merely some embodiments of the present disclosure, and those skilled in the art can obtain other drawings based on these drawings without paying creative labor. [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a key for a musical instrument. [Diagram 2] FIG. 2 is a diagram illustrating an example of recording a musical score. [Diagram 3] FIG. 13 is a schematic diagram illustrating another example of a key. [Figure 4] FIG. 4 is a diagram showing a schematic example of a musical score recording scene using the keys shown in FIG. 3. [Diagram 5]1 is a flowchart of an information display method according to an embodiment of the present disclosure. [Figure 6] FIG. 1 is a diagram illustrating an example of an application scene of a cloud game according to an embodiment of the present disclosure. [Figure 7] FIG. 1 is a schematic diagram illustrating an example scene of pre-configured koto score tools and musical instrument implements according to an exemplary embodiment of the present disclosure. [Figure 8] FIG. 2 is an exemplary diagram of an interaction interface having a first predetermined display scheme in an exemplary embodiment of the present disclosure. [Figure 9] FIG. 2 is a diagram illustrating an example of a musical note recording scene according to an embodiment of the present disclosure. [Figure 10] FIG. 2 is a diagram illustrating an example of a musical note recording scene according to an embodiment of the present disclosure. [Figure 11] 1A-1C are schematic diagrams illustrating example scenes in a musical note recording process according to an embodiment of the present disclosure. [Figure 12] FIG. 2 is a diagram illustrating an example scene of a first touch event caused by multi-finger input according to an embodiment of the present disclosure. [Figure 13] 13A-13C are schematic diagrams illustrating example scenes in another musical note recording process according to an embodiment of the present disclosure. [Figure 14] FIG. 2 is a diagram illustrating an example scene for editing recorded notes according to an embodiment of the present disclosure. [Figure 15] FIG. 13 is a schematic diagram illustrating another example scene for editing recorded notes in an exemplary embodiment of the present disclosure. [Figure 16] 1 is a flowchart of a method for publishing a current musical score in an exemplary embodiment of the present disclosure. [Figure 17] 1A-1C are schematic diagrams illustrating exemplary views of a scene constituting a score details page for a current score in an exemplary embodiment of the present disclosure; [Figure 18] FIG. 2 is a diagram illustrating an example of a musical score playing scene according to an exemplary embodiment of the present disclosure. [Figure 19] FIG. 10 is a diagram illustrating an example of a scene in a thumbnail state according to an embodiment of the present disclosure. [Figure 20] FIG. 2 is a diagram illustrating an example of a scene in a display state according to an exemplary embodiment of the present disclosure. [Figure 21] FIG. 1 is a diagram illustrating a block diagram of an information display device according to an embodiment of the present disclosure. [Figure 22] FIG. 1 is a schematic block diagram of an electronic device implementing an information display method according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0042] Next, the exemplary embodiments will be described in more detail with reference to the drawings. However, the exemplary embodiments can be implemented in various forms and should not be understood to be limited to the examples described herein. On the contrary, these embodiments are provided to make the present disclosure more comprehensive and complete, and to fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics can be incorporated in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will recognize that the technical aspects of the present disclosure can be implemented or other methods, components, devices, steps, etc. can be adopted without omitting one or more of the specific details. In other cases, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.
[0043] In addition, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings indicate the same or similar parts, and therefore repeated explanations are omitted. Some of the block diagrams shown in the drawings are functional entities that do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software form, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.
[0044] In some game scenes, the recording of musical scores can be realized as follows. Specifically, the game has built-in musical instruments, and players can use the instruments to play music in the game. Take a music game as an example. In the interface, the buttons correspond to the musical instrument keys, which are do, re, mi, fa, so, la, and si (one set of musical scales), and the abbreviated scores are 1, 2, 3, 4, 5, 6, and 7. The 15 buttons correspond to two sets of musical scales. When a button is pressed, the sound of the corresponding key is emitted. However, the musical instruments in the game have few built-in musical scores, the key arrangement is different from that of real instruments, and there are no key marks (see Figure 1 for details), which makes it difficult for beginners to learn.
[0045] In order to solve the above problems, in other game scenes, the creation and performance of musical scores is realized as follows. First, in a certain musical score creation scene (specifically, the scene shown in FIG. 2 can be referred to), single or multiple syllables can be edited by manually inputting musical scores. However, this method requires manually controlling the playback bar and inputting notes one by one, which makes the creation process tedious and complicated, and the input efficiency is low. In another musical score creation scene (specifically, the scenes shown in FIG. 3 and FIG. 4 can be referred to), the music played by the user can be automatically recorded into the zither, and single syllables cannot be edited, but this method makes the recorded content invisible during recording. After the recording is completed, it is not displayed in the abbreviated score. In addition, in the case of a recording error, only re-recording is possible, and single syllables cannot be edited, with a single function and low fault tolerance rate. In addition, in the musical score performance scene, the following method is realized. The user can create and share zither scores with the musical score software, practice playing, and then return to the game to play the practiced song. However, this method has the following drawbacks: users need to use two devices when practicing the koto, one to look at the score on one device and start playing the game on the other device, or memorize the score and play it in the game. However, the arrangement of the keys is different from that of a real instrument and there are no note marks, so beginners and players with no knowledge of music theory have high learning costs and are inconvenient to operate.
[0046] Based on this, the exemplary embodiment of the present disclosure provides an information display method configured in a terminal device, and of course, those skilled in the art can also implement the method of the present disclosure in other platforms as necessary, but are not particularly limited. Exemplarily, the display terminal may be a television, a personal computer, a mobile terminal, a PC, or a vehicle-mounted display, and the specific device form of the display terminal can be set by itself according to the actual situation, and falls within the scope of protection of the present disclosure. As shown in FIG. 5, the information display method may include the following steps:
[0047] In step S510, display an interaction interface including a preset musical score control in a first predetermined area of a display interface of a terminal device; In step S520, in response to a touch event acting on the musical score control, note information of the musical score control corresponding to the touch event is obtained; In step S530, the musical notes corresponding to the musical note information are displayed and recorded in a second predetermined area of the display interface.
[0048] In the above information display method, an interaction interface is displayed in a first predetermined area of the display interface of the terminal device, and then, in response to a touch event acting on the score control, note information of the score control corresponding to the touch event is obtained, and finally, notes corresponding to the note information are displayed and recorded in a second predetermined area on the display interface, thereby realizing real-time display of notes and solving the problem in the prior art that recorded notes cannot be displayed in real time. Meanwhile, since the notes corresponding to the note information can be viewed in real time while inputting note information, current users can view the input notes in a timely manner, which improves the convenience of users when viewing the input notes, and further improves the user experience.
[0049] Hereinafter, an information display method according to an embodiment of the present disclosure will be described in detail with reference to the drawings.
[0050] First, the application scenario of the embodiment of the present disclosure will be described. Specifically, the information display method described in the embodiment of the present disclosure can be applied to the cloud game scene, that is, it can be applied to the creation and playing of musical scores in the cloud game scene, and can display the created musical score. Or display the played musical score, and further solve the problem that the created musical score cannot be displayed in real time in the prior art, or solve the problem that the played musical score cannot be displayed in the same display interface while playing the musical score. At the same time, the information display method described in the exemplary embodiment of the present disclosure can also automatically record the koto score, generate and display the koto score in real time, and after the recording of the koto score is completed, a single syllable can be changed at will. In the game interface, the instrument tool can be opened to create and share the koto score. In the game interface, the player can be guided to play the specified koto score, improving the game experience of the player.
[0051] Next, the above-mentioned cloud game will be described and explained. Specifically, cloud game is a game method based on cloud computing. In the cloud game mode, all games are executed on the cloud server, and the rendered game screen is compressed and encoded, and then transmitted to the user for operation through the network. With the maturity of cloud computing and the high-speed transmission capability due to the gradual development of 5G communication technology, cloud game is rapidly developing and gradually popularizing. Cloud game adopts the "cloud computing + game" mode, and users can experience high-end game technology with only crude equipment, and users can play games, work and other activities from the cloud at any time without the need for traditional complex operations such as downloading, installing and upgrading, thereby achieving the goal of thoroughly not requiring hardware. In the cloud game scene, the game to be executed is not the player game terminal, but the cloud server, and the game scene is rendered as a video and audio stream by the cloud server and sent to the player game terminal through the network, and the player's terminal operation is returned to the cloud server. The player game terminal does not need to have powerful graphic calculation and data processing capabilities, but only needs to have basic streaming playback capabilities and the ability to obtain the player's input commands and send them to the cloud server.
[0052] Specifically, this cloud game scene can be specifically shown in Fig. 6. In Fig. 6, 600 is a terminal device, which uses a TV 601, a mobile phone 602 and a PC (Personal Computer) 603 as a medium, and the terminal device sends a game command to a cloud server 610, and the cloud server can respond to the game command to render the cloud game and then feed back and display the game screen including the compressed and encoded audio-video stream on the terminal display. Then, the current user 620 inputs corresponding operation commands through a mouse 630, a keyboard 640, a handle 650, a headphone 660 and a microphone 670, but of course, the user can also directly input corresponding operation commands on the display interface of the display terminal, thus realizing the operation of the cloud game.
[0053] An exemplary embodiment of the present disclosure provides an information display method, comprising: In step S510, an interaction interface including a preset musical score control is displayed in a first predetermined area of a display interface of the terminal device.
[0054] In this embodiment, the display interface of the display terminal will be described first. Specifically, the display interface of the display terminal is a video screen obtained by playing a video stream received from a cloud server, where the video stream is formed by encoding a game screen of a game program executed on the cloud server, that is, the game screen in one embodiment of the present disclosure may be a game screen under a cloud game scene, or of course a game screen under other game scenes, but this example is not particularly limited thereto.
[0055] Next, the process of generating the display interface will be described. Specifically, the game screen is a screen corresponding to a musical instrument displayed in response to a call instruction of a preset musical instrument provided by a game program. That is, the game screen described in an embodiment of the present disclosure is different from the original video screen displayed by the video stream formed in the server, and in the game screen described in an embodiment of the present disclosure, after a user enters a game through a terminal device, the user can call a preset musical instrument provided by the game program, and further display the preset musical instrument on the original video screen, and then call a zither tool preset in the cloud game platform, and mask the zither tool and the musical instrument, thereby obtaining a display interface having a first predetermined display manner. Here, in a display interface having a first predetermined display manner, the preset koto score tool appears at the top layer of the preset musical instrument tool, and further, the musical score control is a key control possessed by the koto score tool, and the musical score control displays the notes and / or abbreviated scores possessed by the musical score control and the musical instrument attributes possessed by the musical score control, and the musical score control has a one-to-one correspondence with a position of the key control possessed by the preset musical instrument tool in the interaction interface.
[0056] Illustratively, as shown in FIG. 7, take the XX cloud game as an example. First, the user opens the game program corresponding to the cloud game on the terminal device by the client of the terminal device, and then touches the musical instrument tool control in the game program to call the pre-set musical instrument tool of the game. Next, touch the koto tool control included in the cloud game platform to call the pre-set koto tool included in the cloud game platform, and further mask the koto tool and the musical instrument tool to obtain a display interface having a first predetermined display manner. Here, the obtained display interface can be specifically as shown in FIG. 8. It should be noted that in the information display method described in the embodiment of the present disclosure, the pre-set musical instrument tool is provided in the game program, and the pre-set koto tool is provided in the cloud game platform. When it is necessary to generate a display interface, it is necessary to first call the pre-set musical instrument tool provided in the game program, then call the pre-set koto tool included in the cloud game platform, and further mask both to obtain the corresponding display interface. This display interface is independent of the cloud game program, and only this display interface is displayed on a specific cloud game platform. In addition, all of the information display methods described in the embodiment of the present disclosure are performed based on this display interface.
[0057] In an alternative embodiment, the key control layout of the instrument score tool included in the cloud gaming platform is preset according to the key control layout of the instrument score tool. For example, when a preset instrument score tool is called in the game, the game screen displays a fixed instrument score tool display interface, and the instrument score tool display interface may include 9 grids or 15 grids. After the current user touches the instrument score tool included in the cloud gaming platform, the instrument score tool interface that matches the preset instrument score tool key control layout is displayed, so that the instrument score tool interface corresponding to the instrument score tool key control layout can be quickly displayed.
[0058] In an optional embodiment, the key control layout of the koto music tool in the cloud game platform is dynamically determined by identifying the key control layout of the musical instrument tool. For example, when the current user touches the musical instrument tool control in the game program to call up the preset musical instrument tool in the game, a fixed musical instrument tool display interface is displayed in the game screen, and the musical instrument tool display interface can include 9 grids or 15 grids, etc., after the current user touches the koto music tool control included in the cloud game platform, the key control layout in the musical instrument tool interface in the game screen is identified, and the corresponding koto music tool interface is dynamically generated according to the identification result, thus the koto music tool can be adapted to musical instrument tools with different key layout effects.
[0059] Illustratively, in the interaction interface shown in FIG. 9, a preset score tool and a preset musical instrument tool are displayed overlapping in the same interface. That is, the score tool is covered on the musical instrument tool as a mask, and the first layer score tool is displayed in a semi-transparent form, and the interaction interface displays the notes corresponding to the keys, the abbreviated scores, and various presentation effects of the keys. Since the score tool is covered on the musical instrument tool as a mask, the key control of the score tool and the key control of the musical instrument tool have a one-to-one correspondence in position in the interaction interface, that is, the key control of the score tool is overlapped on the key control of the musical instrument tool. In this way, it can be helped to identify the musical notes represented by the key control of the musical instrument tool in the game, and further, in the process of inputting the musical notes, the user can select the corresponding score control according to the actual needs, and further, the efficiency of inputting the musical notes can be improved and the user experience can be improved. Here, referring to FIG. 9, the first predetermined area on the display interface can be, for example, as shown in 901.
[0060] Illustratively, the display interface is displayed in the first predetermined area shown in FIG. 9, and the preset score control is, for example, as shown in 802, in each preset score control, the notes and / or abbreviations of the score control and the instrument attributes of the score control are displayed, where the notes and / or abbreviations are, for example, 1234567 for bass, 1234567 for mid-tone, and 1234567 for treble, and the instrument attributes may be, for example, a diamond, a circle, or a combination of diamond and circle, and may of course be represented in other ways, and this example is not particularly limited. Note that, the bass 1234567, the mid-tone 1234567, and the treble 1234567 may be set to the corresponding positions according to actual needs, and this example is not particularly limited.
[0061] Furthermore, when the display interface and the interaction interface are obtained, the interaction interface can be displayed in a first predetermined area on the display interface of the terminal device. Specifically, first, in response to the touch operation of the scene mode control by the current user, the display interface is switched from the current screen scene to the score creation scene, and an interaction interface including a koto score tool and a musical instrument tool is displayed in the first predetermined area on the display interface of the terminal device, where the score creation mode control includes a score record control. For example, referring to FIG. 10, when the touch operation of the current user on the scene mode control shown in FIG. 10 (for example, the create score control shown in 1001) is detected, the display interface can be switched from the current screen scene to the score creation scene, and transition to the creation mode. This method realizes the creation of music scores in cloud games, solving the problem that the prior art cannot realize the creation of koto scores in games and can only play and record existing koto scores in games, and further improving the user experience.
[0062] In step S520, in response to a touch event acting on the score control, note information of the score control corresponding to the touch event is obtained.
[0063] For example, referring to FIG. 8, first, in response to a touch operation of the current user on the recording start control shown in FIG. 8, a recording mode is entered. Of course, before entering the recording mode, for example, the BPM (Byte Per Minute) value of the score and the number of grids of the score can be set, where the BPM value can be used to control the scrolling speed of the score in the second display area, and the number of grids of the score can be used to control the number of grids of the score displayed in the same grid. After the settings are completed and the recording mode is entered, touch events of each score control by the current user can be received, and note information of the score control corresponding to each touch event can be obtained.
[0064] Furthermore, when a touch event acting on any score control of an interaction interface is detected by a current user, the score control corresponding to the touch event is displayed in the interaction interface in a first display manner, and other score controls than the score control corresponding to the touch event are displayed in the interaction interface in a second display manner, where the touch events include a first touch event input by multi-finger, a second touch event input by simple finger, and a third touch event input by an external device, and after the touch event acting on the score control is terminated, the information display method further includes adjusting the score control corresponding to the touch event from the first display manner to the second display manner in response to the termination of the touch event.
[0065] For example, referring to FIG. 11, if the musical score control corresponding to the touch event is a bass note 6, the musical score control can be displayed in a first display manner, and other musical score controls except the bass note 6 can be displayed in a second display manner. Here, the brightness of the first display manner can be higher than that of the second display manner, or the brightness of the first display manner can be lower than that of the second display manner, and is not particularly limited to this example. Here, the reason for adopting different display manners is that the note currently touched by the current user can be intuitively seen, and after the current user no longer touches the interaction control, the display manner of the interaction control can be returned from the first display manner to the second display manner, that is, the original display manner.
[0066] Exemplarily, the above-mentioned touch events may include a first touch event inputted with multi-fingers (see FIG. 12 for details), a second touch event inputted with a simple finger, and a third touch event inputted by an external device, where the external device may include a mouse, a keyboard, a steering wheel, etc., but this example is not particularly limited.
[0067] In addition, when a touch event acting on the score control by the current user is detected, in a viable embodiment, in response to the touch event acting on the score control by the current user, a sound that has been pre-set in the game program for the score control can be played, i.e., the score control itself does not contain sound, and a sound corresponding to the score control can be played in the game; in another viable embodiment, in response to a touch event acting on the score control by the current user, a sound that the score control itself possesses can be played, i.e., the score control itself contains sound, and the sound that the score control itself possesses can be played directly.
[0068] Here, it should be noted that the masked interaction interface is independent of the game program of the cloud game, that is, the masked interaction interface is provided by the cloud game platform itself, and therefore the current user (i.e., the player) does not need to set his / her own voice for the score control in order to realize interaction with the cloud game in the process of operating the game. Of course, in a feasible embodiment, a button can be set to switch whether or not to play the sound that the score control itself has, and when it is turned on, the sound that the score control itself has is played, and when it is turned off, the sound that has been set in advance for the score control in the game program is played, but this example is not particularly limited.
[0069] In step S530, the musical notes corresponding to the musical note information are displayed and recorded in a second predetermined area of the display interface.
[0070] In this embodiment, displaying notes corresponding to the note information in a second predetermined area of the display interface specifically includes scrolling and displaying notes corresponding to the note information in real time in the second predetermined area of the display interface at a first predetermined scroll speed, where in the scrolling display process, the position where the cursor remains is the position where the last note among the recorded notes is located.
[0071] For example, as shown in Fig. 13, the current input notes can be displayed in the second predetermined area, and in the process of displaying the current input notes, the notes can be scrolled at a certain speed (first predetermined scroll speed), and this first predetermined scroll speed is unrelated to the speed of the current notes of the user and needs to be manually set by the user (manually set the above BPM value), and in the process of scrolling, the position where the cursor stays is the syllable currently being recorded, that is, the position where the last note of the currently input notes is located, and after inputting one note, there is no need to manually drag the cursor to the next grid to input the next note. This method can improve the input efficiency of the currently input notes, improve the convenience of inputting the current notes, and further improve the user experience.
[0072] In addition, after displaying the notes corresponding to the note information, it is necessary to further record and save the notes corresponding to the note information, which facilitates generating a current musical score based on all the notes corresponding to the input note information, and further realizes the creation of musical scores by users.
[0073] Furthermore, when the touch event is a first touch event input by multi-fingering, the manner of displaying the currently input note includes sequentially displaying notes of the preset score control corresponding to the first touch event according to the order of the placement position of the preset score control corresponding to the first touch event in the interaction interface. For example, as shown in FIG. 13, when a user simultaneously inputs 45 in the bass region and 23 in the treble region, the display will first display 4 in the bass region, then display 5 in the bass region, then display 2 in the treble region, and finally display 3 in the treble region. In the exemplary embodiment of the present disclosure, the musical score control corresponding to each note is set in the order of low note-middle note-high note, and each scale group is set in the order of do(1), re(2), mi(3), fa(4), So(5), la(6), and Si(7), so the display order of 45 in the low note area and 23 in the high note area is to first display 4 in the low note area, then display 5 in the low note area, then display 2 in the high note area, and finally display 3 in the high note area. In actual application, a corresponding order can be set as necessary, but is not particularly limited in this example.
[0074] Furthermore, specifically, during the process of recording a musical score, the recording pause control can be touched at any time to pause the recording, and can also be touched to continue recording and re-record, which requires pausing the recording before continuing.
[0075] In an exemplary embodiment, after the recording of the score is completed, the recorded score can also be re-edited. Specifically, first, in response to a touch operation on a scene mode control by a current user, the display interface can be switched from a score creation scene to a score editing scene, and then, in response to a selection operation on a recorded note in a second display area by the current user, the recorded note corresponding to the selection operation can be edited, where editing the recorded note corresponding to the selection operation includes deleting or switching the recorded note corresponding to the selection operation, and / or inserting another note at the position of the recorded note corresponding to the selection operation.
[0076] For example, referring to FIG. 14, when the recording of the score is completed, it can transition to an edit mode, for example, in the edit mode, the recorded score can be played back and one or more recorded notes can be edited, and specific editing methods include deleting, switching, inserting other notes, etc. In a specific editing process, in the second display area, a single note can be selected by clicking, and the score control corresponding to that note in the interaction interface of the first display area is highlighted, and further, notes can be added or deleted through the "click" and "cancel" buttons, and the linkage of the upper and lower areas between the first display area and the second display area can be realized and the correction can be displayed in real time, and at the same time, if a certain note is not input, the not-inputted note can be input in the corresponding position, and the positions of the other notes in the grid can be moved backward in sequence, of course, it can also be realized in other ways, but this example is not particularly limited. At the same time, when the play button is touched, the score in the second display area switches from an editable state to a playback state, and the koto scrolls evenly, and a specific scene example is shown in FIG. 15.
[0077] 16 is a schematic diagram of a flowchart for publishing a current score. Specifically, publishing a current score can include the following steps:
[0078] In step S1610, in response to a touch operation on a scene mode control, the display interface is switched from a score editing scene to a score publishing scene; In step S1620, in response to a selection operation on score attribute information included in the score publishing scene, construct a score detail page for the current score generated based on the current input note; In step S1630, in response to a touch operation on a publishing control included in the score publishing scene, the current score and the score details page are published.
[0079] Hereinafter, the current score publishing method in FIG. 16 will be described with reference to FIG. 17. Specifically, as shown in FIG. 17, after transitioning to the score publishing scene, the song setting control is touched, and attribute information can be arranged for the current score in the displayed song setting interface. Here, the attribute information can include song name, song difficulty, background image, score scroll speed, etc., and of course, other attribute information such as author, belonging album, etc. can also be included, and this example is not particularly limited. Furthermore, after the attribute information setting is completed, the publishing control can be touched, and the score details page and the publishing of the current score can be further realized. Of course, if the current score needs to be re-edited, the back control can be touched to return to the editing mode to re-edit the current score, and if it needs to be published, the corresponding control can be re-touched to publish.
[0080] An exemplary embodiment of the present disclosure provides a score playing method. Specifically, first, generate note feedback information according to the consistency between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area, then determine a third display manner of the score to be played according to the note feedback information and a current score playing mode, and control the score to be played to be displayed in the second display area in the third display manner. Here, generating note feedback information according to the consistency between the note information of the score control corresponding to the touch event and the target note of the score to be played displayed in the second display area specifically includes: first, determine whether the note information of the score control corresponding to the touch event matches the current target note of the score to be played displayed in the second display area; then, if the note information of the score control corresponding to the touch event matches the current target note, generate first note feedback information; if the note information of the score control corresponding to the touch event does not match the current target note, generate second note feedback information.
[0081] In one example embodiment, the current score performance mode includes a practice performance mode or an auto-play mode, wherein determining a third display manner of the score to be performed according to the note feedback information and the current score performance mode, and controlling to display the score to be performed in the second display area in the third display manner includes, when the score performance mode is a practice performance mode and the note feedback information is first note feedback information, displaying the next note to be performed in the second display area at a second predetermined scroll speed and displaying the note to be performed in the score to be performed and a score control corresponding to the note to be performed in the score to be performed in a fourth display manner, when the score performance mode is a practice performance mode and the note feedback information is first note feedback information.
[0082] In one embodiment, the notes to be performed include a current note to be performed and a next note to be performed corresponding to the current note to be performed, and wherein displaying the note to be performed and a score control corresponding to the note to be performed in the score to be performed in a fourth display manner includes displaying the current note to be performed and a score control corresponding to the current note to be performed in the score to be performed with a first color mark, and displaying the next note to be performed and a score control corresponding to the next note to be performed in the score to be performed with a second color mark.
[0083] For example, as shown in FIG. 18, the score playing mode can be transitioned to by touching the playing control in the koto score tool. Here, the score playing mode can include a practice playing mode and an automatic playing mode. Specifically, in the playing practice mode, when the current user inputs a current input note into the interaction interface of the first display area, and the current input note matches the current target note in the second display area, the next target note to be played (the "next syllable" presentation is displayed) is displayed in the second display area; when the current input note does not match the current target note in the second display area, a presentation is made, specifically, the score control corresponding to the current input note is displayed in one display manner, and the score control corresponding to the current target note is displayed in another display manner, and further plays the role of presenting the user, but is not limited thereto.
[0084] In one embodiment, when the score performance mode is an automatic performance mode, the information display method further includes: when the note feedback information is first note feedback information, determining a current display method of the score control corresponding to the touch event as a fifth display method, and controlling the score control corresponding to the touch event to be displayed in the fifth display method; and when the note feedback information is second note feedback information, determining a current display method of the score control corresponding to the touch event as a sixth display method, and controlling the score control corresponding to the touch event to be displayed in the sixth display method.
[0085] For example, in the automatic playing mode, in the second display area, a guide animation can be automatically played based on the preset speed of the koto score. For example, for the current syllable (currently played note) of the score, a corresponding button displays an animation that grows from small to large to guide the user to click (sound-game interaction), and provides feedback to the user's clicking action, highlighting the correct play and removing the highlighting if the incorrect play is made. That is, when the note feedback information is the first note feedback information, the current display method of the score control corresponding to the touch event is determined as the fifth display method (highlighting), and the score control corresponding to the touch event is controlled to be displayed in the fifth display method (highlighting); when the note feedback information is the second note feedback information, the current display method of the score control corresponding to the touch event is determined as the sixth display method (highlighting removal), and the score control corresponding to the touch event is controlled to be displayed in the sixth display method (highlighting removal).
[0086] Regardless of the practice play mode, the automatic play mode, the first display area, and the second display area, two styles of "blue, green" are displayed to distinguish the "current syllable" from the "next syllable". Based on the color hint, the user can click the corresponding music score control in the first display area to complete the performance.
[0087] In an embodiment, the information display method further includes switching the target score from a first display state to a second display state in response to a touch operation on the target score by the current user, the first display state including a thumbnail state and / or a display state, when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state. Illustratively, FIG. 19 shows an example of the target score in a thumbnail state, and FIG. 20 shows an example of the target score in a display state, and in the actual application process, the corresponding state can be selected according to the actual needs, for example, in the process of playing the target score or the recorded current score, it is not necessary to see the notes included in the score, and it can be in the thumbnail state. When it is necessary to play the target score or edit the recorded current score, it can be in the display state. That is, instead of needing to look at the abbreviated score when playing, you can thumbnail the area of the score and drag to view the score, where you can drag the score within the area and then switch to display state, and of course you can also switch from display state to thumbnail state by touching the play / replay control.
[0088] The following are embodiments of the disclosed apparatus, which can be used to implement the disclosed method embodiments. For details not disclosed in the disclosed apparatus embodiments, please refer to the disclosed method embodiments.
[0089] The embodiment of the present application also provides an information display device disposed in a terminal device. As shown in Fig. 21, the information display device includes a first display module 2110, a note information acquisition module 2120, and a second display module 2130.
[0090] The first display module 2110 is configured to display an interaction interface in a first predetermined area of the display interface of the terminal device, and display the interaction interface including a preset score control in the first predetermined area of the display interface of the terminal device; The note information acquisition module 2120 is configured to acquire note information of the score control corresponding to a touch event acting on the score control in response to the touch event; The second display module 2130 is configured to display and record musical notes corresponding to the musical note information in a second predetermined area of the display interface.
[0091] In an exemplary embodiment of the present disclosure, a game screen is further displayed on a display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding a game screen of a game program executed on the cloud server, and the game screen being a screen corresponding to a musical instrument tool displayed in response to a call command for a preset musical instrument tool provided from the game program; Here, the information display device further includes a mask module, The mask module is configured to call a preset string tool included in the cloud gaming platform, mask the preset string tool and the preset musical instrument tool, and obtain a display interface having a first predetermined display manner; Here, in a display interface having a first predetermined display manner, the pre-defined zither score tool appears on the top layer of the pre-defined musical instrument tools.
[0092] In an exemplary embodiment of the present disclosure, the score control is a key control of the koto score tool, the score control displays the notes and / or abbreviated staves of the score control and the instrument attributes of the score control, and the score control has a one-to-one correspondence with the position of the key control of the pre-set musical instrument tool in the interaction interface.
[0093] In an exemplary embodiment of the present disclosure, displaying an interaction interface in a first predetermined area of a display interface of a terminal device includes: switching the display interface from a current screen scene to a score creation scene in response to a touch operation on a scene mode control; Displaying an interaction interface including a koto score tool and a musical instrument tool in a first predetermined area of a display interface of the terminal device.
[0094] In an exemplary embodiment of the present disclosure, the information display device further includes a third display module, a third display module configured to display a score control corresponding to the touch event on the interaction interface in a first display manner, and display other score controls than the score control corresponding to the touch event on the interaction interface in a second display manner; Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input from an external device.
[0095] In an exemplary embodiment of the present disclosure, the information display device further includes a display method adjustment module; The display scheme adjustment module is configured to adjust, in response to an end of the touch event, a score control corresponding to the touch event from a first display scheme to a second display scheme.
[0096] In an exemplary embodiment of the present disclosure, displaying notes corresponding to the note information in a second predetermined area of the display interface includes: The method includes scrolling and displaying notes corresponding to the note information in a second predetermined area of the display interface in real time at a first predetermined scroll speed, wherein the position where the cursor remains during the scrolling process is the position where the last note among the recorded notes is located.
[0097] In an exemplary embodiment of the present disclosure, when the touch event is a first touch event inputted by multiple fingers, the display method of the musical note is The method includes sequentially displaying notes of a preset score control corresponding to the first touch event based on the front-to-back order of placement positions in the interaction interface of the preset score control corresponding to the first touch event.
[0098] In an exemplary embodiment of the present disclosure, the information display device further includes a first scene switching module and a musical note editing module; a first scene switching module configured to switch the display interface from a score creation scene to a score editing scene in response to a touch operation on a scene mode control; the note editing module is configured to, in response to a selection operation on a recorded note in the second display area, edit the recorded note corresponding to the selection operation; Editing the recorded note corresponding to the selection operation includes: deleting or switching the recorded note corresponding to said selection operation; and / or and inserting another note at the position of the recorded note that corresponds to said selection operation.
[0099] In an exemplary embodiment of the present disclosure, the information display device further includes a second scene switching module, a score detail page configuration module, and a score publishing module; the second scene switching module is configured to switch the display interface from a score editing scene to a score publishing scene in response to a touch operation on a scene mode control; The score details page configuration module is configured to configure a score details page for a current score generated from the musical notes in response to a selection operation on score attribute information included in the score publishing scene; A score publishing module is configured to publish the current score and the score details page in response to a touch operation on a publishing control included in the score publishing scene.
[0100] In an exemplary embodiment of the present disclosure, the information display device further includes a note feedback information generation module and a display method determination module; The note feedback information generation module is configured to generate note feedback information according to a consistency between note information of a score control corresponding to the touch event and a target note of a target score displayed in the second display area; The display method determination module is configured to determine a third display method of the target score according to the note feedback information and the current score performance mode, and control the display of the target score in the second display area in the third display method.
[0101] In an exemplary embodiment of the present disclosure, generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area includes: determining whether note information of a musical score control corresponding to the touch event matches a currently-played note of a musical score to be played displayed in the second display area; When the note information of the musical score control corresponding to the touch event matches the currently played note, generating a first note feedback information; and generating second note feedback information when the note information of the score control corresponding to the touch event does not match the currently played note.
[0102] In an exemplary embodiment of the present disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode; Here, determining a third display manner of the target score according to the note feedback information and the current score playing mode, and controlling to display the target score in the second display area in the third display manner, When the score performance mode is a practice performance mode and the note feedback information is a first note feedback information, displaying a next note to be performed in the second display area; When the score performance mode is an automatic performance mode, the method includes displaying the target score in the second display area at a second predetermined scroll speed, and displaying the target notes in the target score and score controls corresponding to the target notes in the target score in a fourth display method.
[0103] In an exemplary embodiment of the present disclosure, when the score playing mode is an automatic playing mode, the information display device further includes a fourth display module and a fifth display module; the fourth display module is configured to determine a current display manner of the score control corresponding to the touch event as a fifth display manner when the note feedback information is first note feedback information, and control the score control corresponding to the touch event to be displayed in the fifth display manner; The fifth display module is configured to determine a current display manner of the musical score control corresponding to the touch event as a sixth display manner when the musical note feedback information is second musical note feedback information, and control the musical score control corresponding to the touch event to be displayed in the sixth display manner.
[0104] In an exemplary embodiment of the present disclosure, the performance target notes include a current performance target note and a next performance target note corresponding to the current performance target note, Here, displaying the target notes in the target musical score and the musical score controls corresponding to the target notes in the fourth display format includes: displaying a current target note and a score control corresponding to the current target note in the target score with a first color mark; and displaying the next target note in the target musical score and a musical score control corresponding to the next target note with a second color mark.
[0105] In an exemplary embodiment of the present disclosure, the information display device further includes a display state switching module, The display state switching module is configured to switch the target score from a first display state to a second display state in response to a touch operation on the target score, the first display state including a thumbnail state and / or a display state, and when the first display state is the thumbnail state, the second display state is a display state, and when the first display state is the display state, the second display state is a thumbnail state.
[0106] The details of each module in the information display device are explained in detail in the corresponding information display method, so that the explanation will be omitted here.
[0107] It should be noted that, although the above detailed description refers to several modules or units of an apparatus for performing operations, such division is not mandatory. In fact, according to an embodiment of the present disclosure, features and functions of two or more of the above-mentioned modules or units may be embodied in one module or unit. Conversely, features and functions of one of the above-mentioned modules or units may be further divided and embodied in multiple modules or units.
[0108] Also, although the accompanying figures describe steps of the methods in this disclosure in a particular order, this does not require or imply that the steps must be performed in that particular order, or that all steps must be performed to achieve a desired result. Additionally or alternatively, some steps may be omitted, multiple steps may be merged into a single step execution, or a step may be broken down into multiple step executions.
[0109] Exemplary embodiments of the present disclosure also provide an electronic device capable of implementing the above methods.
[0110] Those skilled in the art will appreciate that various aspects of the present disclosure may be embodied as a system, method, or program product. Accordingly, various aspects of the present disclosure may be specifically embodied as an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.), or an embodiment combining hardware and software aspects, which may be collectively referred to herein as a "circuit," "module," or "system."
[0111] Hereinafter, an electronic device 2200 in this embodiment of the present disclosure will be described with reference to Fig. 22. The electronic device 2200 shown in Fig. 22 is merely an example and does not impose any limitation on the function and scope of use of the embodiment of the present disclosure.
[0112] 22, the electronic device 2200 is depicted as a general-purpose computing device. Components of the electronic device 2200 may include, but are not limited to, the at least one processing unit 2210, the at least one storage unit 2220, a bus 2230 connecting different system components (including the storage unit 2220 and the processing unit 2210), and a display unit 2240.
[0113] The storage unit may store program codes executable by the processing unit 2210, and the processing unit 2210 may execute steps in various embodiments of the present disclosure described in the "Example Method" section of this specification. For example, the processing unit 2210 displays an interaction interface including a predefined score control in a first predetermined area of a display interface of a terminal device in step S510, obtains note information of the score control corresponding to the touch event in response to a touch event acting on the score control in step S520, and displays and records notes corresponding to the note information in a second predetermined area of the display interface in step S530.
[0114] In an exemplary embodiment of the present disclosure, a game screen is further displayed on a display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding a game screen of a game program executed on the cloud server, and the game screen being a screen corresponding to a musical instrument tool displayed in response to a call command for a preset musical instrument tool provided from the game program; Here, the information display method further includes: Invoking a preset string tool included in the cloud gaming platform, masking the preset string tool and the preset musical instrument tool, and obtaining a display interface having a first predetermined display manner; Here, in a display interface having a first predetermined display manner, the pre-defined zither score tool appears on the top layer of the pre-defined musical instrument tools.
[0115] In an exemplary embodiment of the present disclosure, the score control is a key control of the koto score tool, the score control displays the notes and / or abbreviated staves of the score control and the instrument attributes of the score control, and the score control has a one-to-one correspondence with the position of the key control of the pre-set musical instrument tool in the interaction interface.
[0116] In an exemplary embodiment of the present disclosure, displaying an interaction interface in a first predetermined area of a display interface of a terminal device includes: switching the display interface from a current screen scene to a score creation scene in response to a touch operation on a scene mode control; Displaying an interaction interface including a koto score tool and a musical instrument tool in a first predetermined area of a display interface of the terminal device.
[0117] In an exemplary embodiment of the present disclosure, the information display method further comprises: Displaying a score control corresponding to the touch event on the interaction interface in a first display manner, and displaying other score controls than the score control corresponding to the touch event on the interaction interface in a second display manner; Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input from an external device.
[0118] In an exemplary embodiment of the present disclosure, the information display method further comprises: In response to the touch event terminating, adjusting a sheet music control corresponding to the touch event from a first display format to a second display format.
[0119] In an exemplary embodiment of the present disclosure, displaying notes corresponding to the note information in a second predetermined area of the display interface includes: The method includes scrolling and displaying notes corresponding to the note information in a second predetermined area of the display interface in real time at a first predetermined scroll speed, wherein, during the scrolling process, the position where the cursor remains is the position where the last note of the recorded notes is located.
[0120] In an exemplary embodiment of the present disclosure, when the touch event is a first touch event inputted by multiple fingers, the display method of the musical note is The method includes sequentially displaying notes of a preset score control corresponding to the first touch event based on the front-to-back order of placement positions in the interaction interface of the preset score control corresponding to the first touch event.
[0121] In an exemplary embodiment of the present disclosure, the information display method further comprises: switching the display interface from a score creation scene to a score editing scene in response to a touch operation on a scene mode control; in response to a selection operation on a recorded note in the second display area, editing the recorded note corresponding to the selection operation; Editing the recorded note corresponding to the selection operation includes: deleting or switching the recorded note corresponding to said selection operation; and / or and inserting another note at the position of the recorded note that corresponds to said selection operation.
[0122] In an exemplary embodiment of the present disclosure, the information display method further comprises: Switching the display interface from a score editing scene to a score publishing scene in response to a touch operation on a scene mode control; In response to a selection operation on score attribute information included in the score publishing scene, constructing a score detail page for a current score generated from the musical notes; and publishing the current score and the score detail page in response to a touch operation on a publishing control included in the score publishing scene.
[0123] In an exemplary embodiment of the present disclosure, in response to a touch event acting on the musical score control, after obtaining musical note information of the musical score control corresponding to the touch event, the information display method further includes: generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area; The method includes determining a third display method of the target score according to the note feedback information and the current score performance mode, and controlling the display of the target score in the second display area in the third display method.
[0124] In an exemplary embodiment of the present disclosure, generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area includes: determining whether note information of a musical score control corresponding to the touch event matches a currently-played note of a musical score to be played displayed in the second display area; When the note information of the musical score control corresponding to the touch event matches the currently played note, generating a first note feedback information; and generating second note feedback information when the note information of the score control corresponding to the touch event does not match the currently played note.
[0125] In an exemplary embodiment of the present disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode; Here, determining a third display manner of the target score according to the note feedback information and the current score playing mode, and controlling to display the target score in the second display area in the third display manner, When the score performance mode is a practice performance mode and the note feedback information is a first note feedback information, displaying a next note to be performed in the second display area; When the score performance mode is an automatic performance mode, the method includes displaying the target score in the second display area at a second predetermined scroll speed, and displaying the target notes in the target score and score controls corresponding to the target notes in a fourth display method.
[0126] In an exemplary embodiment of the present disclosure, when the score performance mode is an automatic performance mode, the information display method further includes: When the note feedback information is a first note feedback information, a current display mode of a score control corresponding to the touch event is determined as a fifth display mode, and the score control corresponding to the touch event is controlled to be displayed in the fifth display mode; When the note feedback information is second note feedback information, a current display mode of the score control corresponding to the touch event is determined as a sixth display mode, and the score control corresponding to the touch event is controlled to be displayed in the sixth display mode.
[0127] In an exemplary embodiment of the present disclosure, the performance target notes include a current performance target note and a next performance target note corresponding to the current performance target note, Here, displaying the target notes in the target musical score and the musical score controls corresponding to the target notes in the fourth display format includes: displaying a current target note and a score control corresponding to the current target note in the target score with a first color mark; and displaying the next target note in the target musical score and a musical score control corresponding to the next target note with a second color mark.
[0128] In an exemplary embodiment of the present disclosure, the information display method further comprises: In response to a touch operation on the musical score to be performed, the musical score to be performed is switched from a first display state to a second display state, the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state.
[0129] The specific embodiment of the information display method that operates in this embodiment is similarly applied to the embodiment of the information display method described above, and therefore a description thereof will be omitted here.
[0130] According to the above embodiment, on the one hand, by displaying an interaction interface in a first predetermined area on the display interface of the terminal device, and in response to a touch event acting on the score control, obtaining the note information of the score control corresponding to the touch event, and finally displaying and recording the notes corresponding to the note information in a second predetermined area on the display interface, realizing real-time display of notes, and solving the problem of not being able to view recorded notes in real time in the prior art; on the other hand, since the notes corresponding to the note information can be viewed in real time while inputting note information, current users can view the input notes in a timely manner, which improves the convenience for users when viewing the input notes, and further improves the user experience.
[0131] The memory unit 2220 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 22201 and / or a cache storage unit 22202, and may also include a read only memory unit (ROM) 22203.
[0132] The storage unit 2220 may also include, but is not limited to, programs / utilities 22204 having a set (at least one) of program modules 22205, including an operating system, one or more applications, other program modules, and program data, each or some combination of these examples may include the implementation of a network environment.
[0133] Bus 2230 may represent one or more of several classes of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphical acceleration port, a processing unit, or a local bus using any of a number of bus structures.
[0134] The electronic device 2200 may also communicate with one or more external devices 2300, such as a keyboard, a pointing device, a Bluetooth device, one or more devices that allow a user to interact with the electronic device 2200, and / or any device (router, modem, etc.) that allows the electronic device 2200 to communicate with one or more other computing devices. This communication may occur via an input / output (I / O) interface 2250. The electronic device 2200 may also communicate with one or more networks, such as a local area network (LAN), a wide area network (WAN), and / or the Internet, via a network adapter 2260. As shown, the network adapter 2260 communicates with other modules of the electronic device 2200 via a bus 2230. Although not shown, it should be understood that other hardware and / or software modules may be used in combination with the electronic device 2200, including, but not limited to, microcode, device drives, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0135] From the above description of the embodiments, it is easy for a person skilled in the art to understand that the exemplary embodiments described herein can be realized by software, and can be realized by combining necessary hardware with software. Therefore, the technical aspects of the embodiments of the present disclosure can be embodied in the form of a software product that can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB disk, a mobile hard disk, etc.) and includes a plurality of instructions for executing the methods of the embodiments of the present disclosure.
[0136] In an exemplary embodiment of the present disclosure, a computer-readable storage medium storing a program product capable of implementing the method described herein is also provided. In some possible embodiments, various aspects of the present disclosure may also be implemented as a form of program code including a program product, which, when executed on a terminal device, causes the terminal device to execute the following steps according to various embodiments of the present disclosure described in the above "Method" of this specification: In step S510, an interaction interface including a pre-set score control is displayed in a first predetermined area of a display interface of the terminal device; in step S520, in response to a touch event acting on the score control, note information of the score control corresponding to the touch event is obtained; and in step S530, a note corresponding to the note information is displayed and recorded in a second predetermined area of the display interface.
[0137] In an exemplary embodiment of the present disclosure, a game screen is further displayed on a display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding a game screen of a game program executed on the cloud server, and the game screen being a screen corresponding to a musical instrument tool displayed in response to a call command for a preset musical instrument tool provided from the game program; Here, the information display method further includes: Invoking a preset string tool included in the cloud gaming platform, masking the preset string tool and the preset musical instrument tool, and obtaining a display interface having a first predetermined display manner; Here, in a display interface having a first predetermined display manner, the pre-defined zither score tool appears on the top layer of the pre-defined musical instrument tools.
[0138] In an exemplary embodiment of the present disclosure, the score control is a key control of the koto score tool, the score control displays the notes and / or abbreviated staves of the score control and the instrument attributes of the score control, and the score control has a one-to-one correspondence with the position of the key control of the pre-set musical instrument tool in the interaction interface.
[0139] In an exemplary embodiment of the present disclosure, displaying an interaction interface in a first predetermined area of a display interface of a terminal device includes: switching the display interface from a current screen scene to a score creation scene in response to a touch operation on a scene mode control; Displaying an interaction interface including a koto score tool and a musical instrument tool in a first predetermined area of a display interface of the terminal device.
[0140] In an exemplary embodiment of the present disclosure, the information display method further comprises: Displaying a score control corresponding to the touch event on the interaction interface in a first display manner, and displaying other score controls than the score control corresponding to the touch event on the interaction interface in a second display manner; Here, the touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input from an external device.
[0141] In an exemplary embodiment of the present disclosure, the information display method further comprises: In response to the touch event terminating, adjusting a sheet music control corresponding to the touch event from a first display format to a second display format.
[0142] In an exemplary embodiment of the present disclosure, displaying notes corresponding to the note information in a second predetermined area of the display interface includes: The method includes scrolling and displaying notes corresponding to the note information in a second predetermined area of the display interface in real time at a first predetermined scroll speed, wherein the position where the cursor remains during the scrolling process is the position where the last note among the recorded notes is located.
[0143] In an exemplary embodiment of the present disclosure, when the touch event is a first touch event inputted by multiple fingers, the display method of the musical note is The method includes sequentially displaying notes of a preset score control corresponding to the first touch event based on the front-to-back order of placement positions in the interaction interface of the preset score control corresponding to the first touch event.
[0144] In an exemplary embodiment of the present disclosure, the information display method further comprises: switching the display interface from a score creation scene to a score editing scene in response to a touch operation on a scene mode control; in response to a selection operation on a recorded note in the second display area, editing the recorded note corresponding to the selection operation; Editing the recorded note corresponding to the selection operation includes: deleting or switching the recorded note corresponding to said selection operation; and / or and inserting another note at the position of the recorded note that corresponds to said selection operation.
[0145] In an exemplary embodiment of the present disclosure, the information display method further comprises: Switching the display interface from a score editing scene to a score publishing scene in response to a touch operation on a scene mode control; In response to a selection operation on score attribute information included in the score publishing scene, constructing a score detail page for a current score generated from the musical notes; and publishing the current score and the score detail page in response to a touch operation on a publishing control included in the score publishing scene.
[0146] In an exemplary embodiment of the present disclosure, in response to a touch event acting on the musical score control, after obtaining musical note information of the musical score control corresponding to the touch event, the information display method further includes: generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area; The method includes determining a third display method of the target score according to the note feedback information and the current score performance mode, and controlling the display of the target score in the second display area in the third display method.
[0147] In an exemplary embodiment of the present disclosure, generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area includes: determining whether note information of a musical score control corresponding to the touch event matches a currently-played note of a musical score to be played displayed in the second display area; When the note information of the musical score control corresponding to the touch event matches the currently played note, generating a first note feedback information; and generating second note feedback information when the note information of the score control corresponding to the touch event does not match the currently played note.
[0148] In an exemplary embodiment of the present disclosure, the current score playing mode includes a practice playing mode or an automatic playing mode; Here, determining a third display manner of the target score according to the note feedback information and the current score playing mode, and controlling to display the target score in the second display area in the third display manner, When the score performance mode is a practice performance mode and the note feedback information is a first note feedback information, displaying a next note to be performed in the second display area; When the score performance mode is an automatic performance mode, the method includes displaying the target score in the second display area at a second predetermined scroll speed, and displaying the target notes in the target score and score controls corresponding to the target notes in the target score in a fourth display method.
[0149] In an exemplary embodiment of the present disclosure, when the score performance mode is an automatic performance mode, the information display method further includes: When the note feedback information is a first note feedback information, a current display mode of a score control corresponding to the touch event is determined as a fifth display mode, and the score control corresponding to the touch event is controlled to be displayed in the fifth display mode; When the note feedback information is second note feedback information, a current display mode of the score control corresponding to the touch event is determined as a sixth display mode, and the score control corresponding to the touch event is controlled to be displayed in the sixth display mode.
[0150] In an exemplary embodiment of the present disclosure, the performance target notes include a current performance target note and a next performance target note corresponding to the current performance target note, Here, displaying the target notes in the target musical score and the musical score controls corresponding to the target notes in the fourth display format includes: displaying a current target note and a score control corresponding to the current target note in the target score with a first color mark; and displaying the next target note in the target musical score and a musical score control corresponding to the next target note with a second color mark.
[0151] In an exemplary embodiment of the present disclosure, the information display method further comprises: In response to a touch operation on the musical score to be performed, the musical score to be performed is switched from a first display state to a second display state, the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state.
[0152] The specific embodiment of the information display method that operates in this embodiment is similarly applied to the embodiment of the information display method described above, and therefore a description thereof will be omitted here.
[0153] According to the above embodiment, on the one hand, by displaying an interaction interface in a first predetermined area on the display interface of the terminal device, and in response to a touch event acting on the score control, obtaining the note information of the score control corresponding to the touch event, and finally displaying and recording the notes corresponding to the note information in a second predetermined area on the display interface, real-time viewing of notes is realized, and the problem of not being able to view recorded notes in real time in the prior art is solved; on the other hand, since the notes corresponding to the note information can be viewed in real time while inputting the note information, current users can view the input notes in a timely manner, which improves the convenience for users when viewing the input notes, and further improves the user experience.
[0154] In one embodiment of the present disclosure, a program product for implementing the above-mentioned method employs a portable compact disk read-only memory (CD-ROM), includes a program code, and can run on a terminal device such as a personal computer. However, the program product of the present disclosure is not limited thereto, and in this file, a readable storage medium may be any tangible medium that includes or stores a program that can be used in conjunction with or to direct the execution of a system, apparatus, or device.
[0155] The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of more than one. More specific examples (non-limiting list) of readable storage media include an electrical connection, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0156] A computer-readable signal medium may include a data signal propagated either in baseband or as part of a carrier wave carrying readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A readable signal medium may be any readable medium other than a readable storage medium that can transmit, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device.
[0157] The program code contained in the readable medium may be transmitted over any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the above.
[0158] Program code for carrying out the operations of the present disclosure can be written in any combination of one or more programming languages, including object-oriented programming languages, such as Java, C++, and the like, as well as conventional procedural programming languages, such as "C" or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, as an independent package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. When referring to a remote computing device, the remote computing device can be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., can be connected via the Internet using an Internet Service Provider).
[0159] It is also understood that the above-mentioned drawings are schematic illustrations of the processes included in the method in the exemplary embodiment of the present disclosure, and are not intended to be limiting. It is also understood that the processes shown in the above-mentioned drawings do not indicate or limit the time sequence of these processes. It is also understood that these processes may be performed, for example, synchronously or asynchronously in multiple modules.
[0160] Those skilled in the art will easily envision other embodiments of the present disclosure. This application is intended to cover any variations, uses, or adaptations of the present disclosure, including those that are within the scope of the general principles of the present disclosure and that are within the scope of the common knowledge or customary means in the art of the present disclosure. The specification and embodiments are to be treated as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.
Claims
1. Displaying an interaction interface including predefined musical score controls in a first predetermined area of a display interface of the terminal device; In response to a touch event acting on the score control, obtaining note information of the score control corresponding to the touch event; and displaying and recording the musical notes corresponding to the musical note information in a second predetermined area of the display interface.
13. An information display method comprising:
2. further displaying a game screen on a display interface of the terminal device, the game screen being a video screen obtained by the terminal device playing a video stream received from a cloud server, the video stream being formed by encoding a game screen of a game program executed in the cloud server, the game screen being a screen corresponding to a musical instrument tool displayed in response to a call command for a preset musical instrument tool provided from the game program; The information display method further includes: Invoking a preset string tool included in the cloud gaming platform, masking the preset string tool and the preset musical instrument tool, and obtaining a display interface having a first predetermined display manner; In the display interface having a first predetermined display manner, the pre-defined zither tool appears on the top layer of the pre-defined musical instrument tool.
2. The information display method according to claim 1,
3. The musical score control is a key control of the koto score tool, and the musical score control displays the notes and / or abbreviations of the musical score control and the musical instrument attributes of the musical score control, and the musical score control has a one-to-one correspondence with the position of the key control of the preset musical instrument tool in the interaction interface.
3. The information display method according to claim 2.
4. Displaying the interaction interface in a first predetermined area of a display interface of the terminal device includes: switching the display interface from a current screen scene to a score creation scene in response to a touch operation on a scene mode control; and displaying an interaction interface including a koto score tool and a musical instrument tool in a first predetermined area of a display interface of the terminal device.
3. The information display method according to claim 2.
5. The information display method further includes: Displaying a score control corresponding to the touch event on the interaction interface in a first display manner, and displaying other score controls than the score control corresponding to the touch event on the interaction interface in a second display manner; The touch event includes at least one of a first touch event input with multiple fingers, a second touch event input with a single finger, and a third touch event input with an external device.
2. The information display method according to claim 1,
6. The information display method further includes: and adjusting, in response to the touch event terminating, a musical score control corresponding to the touch event from a first display format to a second display format.
6. The information display method according to claim 5,
7. Displaying and recording notes corresponding to the note information in a second predetermined area of the display interface includes: and scrolling and displaying notes corresponding to the note information in a second predetermined area of the display interface in real time at a first predetermined scroll speed, wherein a position where a cursor stays during the scrolling and displaying process is a position where the last note of the recorded notes is located.
7. The information display method according to claim 6.
8. When the touch event is a first touch event input by multiple fingers, the display method of the note is and sequentially displaying notes of the preset score control corresponding to the first touch event based on a front-to-back order of arrangement positions in the interaction interface of the preset score control corresponding to the first touch event.
8. The information display method according to claim 7,
9. The information display method further includes: switching the display interface from a score creation scene to a score editing scene in response to a touch operation on a scene mode control; in response to a selection operation on a recorded note in the second display area, editing the recorded note corresponding to the selection operation; Editing the recorded note corresponding to the selection operation includes: deleting or switching the recorded note corresponding to said selection operation; and / or and inserting another note into the location of the recorded note corresponding to said selection operation.
2. The information display method according to claim 1,
10. The information display method further includes: Switching the display interface from a score editing scene to a score publishing scene in response to a touch operation on a scene mode control; In response to a selection operation on score attribute information included in the score publishing scene, constructing a score detail page for a current score generated from the musical notes; and publishing the current score and the score detail page in response to a touch operation on a publishing control included in the score publishing scene.
2. The information display method according to claim 1,
11. In response to a touch event acting on the score control, after obtaining note information of the score control corresponding to the touch event, the information display method further comprises: generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area; determining a third display format of the target score according to the note feedback information and a current score playing mode, and controlling the display of the target score in the second display area in the third display format.
2. The information display method according to claim 1,
12. generating note feedback information according to a consistency between note information of a musical score control corresponding to the touch event and a target note of a target musical score displayed in the second display area; determining whether note information of a musical score control corresponding to the touch event matches a currently-played note of a musical score to be played displayed in the second display area; When the note information of the musical score control corresponding to the touch event matches the currently played note, generating a first note feedback information; generating second note feedback information when the note information of the score control corresponding to the touch event does not match the currently played note.
12. The method of claim 11, wherein the information display method is a method for displaying information on a display screen.
13. The current score playing mode includes a practice playing mode or an automatic playing mode, determining a third display format of the target score according to the note feedback information and a current score playing mode, and controlling to display the target score in the second display area in the third display format; When the score performance mode is a practice performance mode and the note feedback information is the first note feedback information, displaying a next note to be performed in the second display area; and when the score performance mode is an automatic performance mode, displaying the target score in the second display area at a second predetermined scroll speed, and displaying the target notes in the target score and score controls corresponding to the target notes in a fourth display manner.
13. The method of claim 12.
14. When the musical score performance mode is an automatic performance mode, the information display method further includes: When the note feedback information is first note feedback information, a current display manner of a score control corresponding to the touch event is determined as a fifth display manner, and the score control corresponding to the touch event is controlled to be displayed in the fifth display manner; If the note feedback information is second note feedback information, a current display manner of the score control corresponding to the touch event is determined as a sixth display manner, and the score control corresponding to the touch event is controlled to be displayed in the sixth display manner.
13. The method of claim 12.
15. the performance target notes include a current performance target note and a next performance target note corresponding to the current performance target note, Displaying the target notes in the target score and the score control corresponding to the target notes in the fourth display manner, displaying a current target note and a score control corresponding to the current target note in the target score with a first color mark; and displaying a next target note and a score control corresponding to the next target note in the target score with a second color mark.
14. The method of claim 13,
16. The information display method further includes: In response to a touch operation on the target score, the target score is switched from a first display state to a second display state, the first display state includes a thumbnail state and / or a display state, and when the first display state is a thumbnail state, the second display state is a display state, and when the first display state is a display state, the second display state is a thumbnail state. The information display method according to any one of claims 11 to 15.
17. An information display device including a first display module, a musical note information acquisition module, and a second display module, The first display module is configured to display an interaction interface including a preset score control in a first predetermined area of a display interface of a terminal device; The note information acquisition module is configured to acquire, in response to a touch event acting on the score control, note information of the score control corresponding to the touch event; The second display module is configured to display and record musical notes corresponding to the musical note information in a second predetermined area of the display interface.
1. An information display device comprising:
18. A computer program is stored which, when executed by a processor, implements the method for displaying information according to any one of claims 1 to 16. A computer-readable storage medium comprising:
19. 1. An electronic device comprising a processor and a memory storing executable instructions for said processor, The processor is configured to execute the executable instructions to perform the method of displaying information according to any one of claims 1 to 16.
1. An electronic device comprising:
Citation Information
Patent Citations
Game program, game device and game control method
JP2007151640A
Electronic music device and program for realizing control method thereof
JP2013037237A
Musical sound reproducing device
JP2015008842A
Composition device and methods of use
US20110023688A1