Keyboard screen display program and system thereof
The keyboard screen display program and system simplifies piano simulation by allowing users to touch key images on a fixed hand position, using music data to guide display switching and sound output, making it accessible for beginners.
Patent Information
- Application Number
- JP2024005411
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-17
- Publication Date
- 2025-01-24
AI Technical Summary
Beginners and inexperienced users find it challenging to enjoy simulated piano performances with ease on screen-based applications.
A keyboard screen display program and system that allows users to simulate piano playing by fixing their hand position and touching key images on the screen with their fingers, using music data to guide the display switching and sound output based on finger operations.
Enables beginners to perform pseudo piano playing with simple operations, enhancing the ease of use and enjoyment of simulated piano performances.
Smart Images
Figure 2025013126000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a keyboard screen display program and a system thereof that can provide the enjoyment of playing the piano or organ through operations on the screen. [Background technology]
[0002] 2. Description of the Related Art There is an application that displays a piano keyboard screen on the screen of a terminal device such as a PDA (Personal Digital Assistant), and when a key image on the keyboard is designated with a finger, a sound corresponding to the designated key image is output. In such applications, the user moves the position of his or her hands in accordance with the music and brings certain fingers into contact with key images, just as when playing the keys of a real piano with his or her fingers. Summary of the Invention [Problem to be solved by the invention]
[0003] However, even beginners and users who have never played the piano before have a demand for an experience of playing the piano more easily.
[0004] The present invention has been made in consideration of the above-mentioned circumstances, and its object is to provide a keyboard screen display program and system that allows even beginners to enjoy simulated piano playing with simple operations on the screen. [Means for solving the problem]
[0005] The present invention is a program for displaying a keyboard image on a screen, which causes a computer to execute a finger identification process for identifying the finger that will next designate and operate a key image based on music data when positions on the screen at which at least five fingers will each be in contact with the screen are assumed, a key image identification process for identifying the key image that will next be designated and operated with a finger based on the music data, and a display switching process for switching to a screen where the identified key image can be designated and operated with the identified finger at the assumed position.
[0006] Preferably, the display switching step switches the display of the screen based on the music data before the timing at which the next designation operation is to be performed.
[0007] Preferably, the music data is configured by defining an order of a plurality of basic elements, the basic elements being key image identification information for identifying the key image, finger identification information for identifying the finger that will designate the key image, and sound duration information indicating the length of a sound to be output in response to the designation operation of the key image, and the finger specifying step sequentially specifies the finger that will be designated next based on the music data, and the key image specifying step sequentially specifies the key image that will be designated next based on the music data.
[0008] Preferably, the display switching step determines a timing for switching the screen display based on the note duration information of the music data.
[0009] Preferably, the display switching step displays, after the screen is switched, the keyboard image shifted according to the distance between the identified finger position and the identified key image position at the timing before the screen is switched.
[0010] Preferably, in response to a designation operation of the key image with the finger, a sound assigned to the key image is output.
[0011] Preferably, the number of positions on the screen of the key image designated by each of the at least five fingers is one or more.
[0012] Preferably, the key image to be next designated and operated with a finger is displayed as a visually identifiable image.
[0013] Preferably, the identifiable image is an illustrated image of a finger.
[0014] The present invention also provides a keyboard image display system for displaying a keyboard image on a screen, comprising: a finger identification means for identifying the finger that will next designate and operate a key image based on music data when positions on the screen at which at least five fingers will each be in contact with the screen are assumed; a key image identification means for identifying the key image that will next be designated and operated with a finger based on the music data; and a display switching means for switching to a screen where the identified key image can be designated and operated with the identified finger at the assumed position. Effect of the Invention
[0015] According to the present invention, there is provided a keyboard screen display program and a system thereof that allows even a beginner to enjoy simulated piano playing with simple operations on the screen. [Brief description of the drawings]
[0016] [Figure 1] FIG. 1 is a diagram for explaining a network environment of a performance system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a functional block diagram of the terminal device 3 shown in FIG. [Diagram 3] FIG. 3 is a functional block diagram of the server device 6 shown in FIG. [Figure 4] FIG. 4 is a diagram for explaining the screen 23 of the keyboard image displayed on the display 51 of the terminal device 3 shown in FIG. [Diagram 5] FIG. 5 is a diagram for explaining the assumed positions of the user's hands and fingers on the keyboard image on the screen 23 shown in FIG. [Figure 6] FIG. 6 is a diagram for explaining the state after the keyboard image is shifted on the screen 23 shown in FIG. [Figure 7] FIG. 7 is a diagram for explaining the format of music data. [Figure 8] FIG. 8 is a flowchart for explaining a display process of the screen 23 of the keyboard image by the terminal device 3 shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0017] A performance system according to an embodiment of the present invention will be described below. FIG. 1 is a diagram for explaining a network environment of a performance system according to an embodiment of the present invention. As shown in FIG. 1, a performance system 1 is capable of communicating with a plurality of terminal devices 3 and a server device 6 via a network 7.
[0018] In the performance system 1 of this embodiment, the user can touch the appropriate key image with his / her fingers without moving his / her hands from the expected positions by moving the keyboard image left and right on the screen 23 in accordance with the music data in the terminal device 3. This makes playing easier and allows even beginners to enjoy playing.
[0019] <Terminal device 3> FIG. 2 is a functional block diagram of the terminal device 3 shown in FIG. As shown in FIG. 2, the terminal device 3 includes, for example, a display 51, a speaker 52, an operation unit 53, a communication unit 55, a Bluetooth (registered trademark) communication unit 57, a memory 59, and a processing unit 61. The terminal device 3 is a PDA such as a notebook computer.
[0020] The display 51 displays an image based on a signal from the processing unit 61. The display 51 has a touch panel function. The speaker 52 outputs sound under the control of the processing unit 61 . The operation unit 53 is an operation means such as a touch panel, a keyboard, or a mouse. The communication unit 55 communicates with the server device 6 . The Bluetooth communication unit 57 performs Bluetooth communication with the infrared controller 19 . The memory 59 stores the program executed by the processing unit 61 . The processing unit 61 executes the application program PRG1 stored in the memory 59 to perform the processing of the terminal device 3 defined in this embodiment.
[0021] The terminal device 3 downloads the application program PRG 1 from the communication unit 55 via the network 9 and stores it in the memory 59 .
[0022] <Server device 6> FIG. 3 is a functional block diagram of the server device 6 shown in FIG. As shown in FIG. 3, the server device 6 includes a communication unit 55, a memory 59, and a processing unit 61. The communication unit 55 communicates with the terminal device 3 . The memory 59 stores a program PRG2 that the processing unit 61 executes. The processing unit 61 executes the program PRG2 stored in the memory 59 to perform the processing of the server device 6 defined in this embodiment.
[0023] In response to a request from the terminal device 3, the server device 6 downloads the application program PRG1 from the communication unit 55 via the network 9 to the terminal device 3.
[0024] The following describes screens displayed on the display 51 of the terminal device 3, which are realized by the processing based on the application program PRG1 by the terminal device 3 and the processing based on the program PRG2 by the server device 6. FIG. 4 is a diagram for explaining the screen 23 of the keyboard image displayed on the display 51 of the terminal device 3 shown in FIG. As shown in FIG. 4, a keyboard image is displayed on the screen 23. A plurality of key images are displayed within the keyboard image, and in the example of FIG. 4, key images with key image identification information x5 to x13 are displayed.
[0025] FIG. 5 is a diagram for explaining the assumed positions of the user's hands and fingers on the keyboard image on the screen 23 shown in FIG. As shown in FIG. 5, a process described later is performed so that the user can touch the key images (play a piece of music) while keeping the assumed hand position fixed (without moving). 5, for example, the user touches the key image X7 with finger A. A sound corresponding to this is output from the speaker 52.
[0026] FIG. 6 is a diagram for explaining the state after the keyboard image on the screen 23 shown in FIG. 5 has been shifted. When the user next touches the key image X12 with the finger D on the screen 23 shown in FIG. 5 in accordance with the progress of the song based on the music data, the processing unit 61 of the terminal device 3 switches and displays on the display 51 the keyboard image shown in FIG. 6, which is obtained by shifting the keyboard image by two keys to the left. This allows the user to perform a designation operation by touching the key image X12 with the finger D without moving the position of the hand or fingers at all.
[0027] FIG. 7 is a diagram for explaining the format of music data. As shown in FIG. 7, the music data is composed of basic elements, such as key image identification information that identifies a key image, finger identification information that identifies the finger that designates the key image, and note length information that indicates the length (such as quarter note or eighth note) of the sound that corresponds to the designation operation of the key image, and the order of a number of basic elements is specified.
[0028] The display process of the keyboard image on the screen 23 by the terminal device 3 shown in FIG. 2 will be described below. FIG. 8 is a flowchart for explaining a display process of the screen 23 of the keyboard image by the terminal device 3 shown in FIG. The processing described below is carried out by the terminal device 3 executing an application program PRG1 and the server device 6 executing a program PRG2 in cooperation with each other. Moreover, the following process may be executed based on only either the application program PRG1 or the program PRG2.
[0029] STEP ST11: Music data designated by the user of the terminal device 3 is, for example, downloaded from the server device 6 to the terminal device 3 and stored in the memory 59 shown in FIG. The processing unit 61 of the terminal device 3 reads the music data from the memory 59 .
[0030] STEP ST12: The processing unit 61 of the terminal device 3 obtains finger identification information of the finger that will perform the first designation operation from the music data read out in step ST11.
[0031] STEP ST13: The processing unit 61 of the terminal device 3 obtains key image identification information of the key image to be specified first from the music data read out in step ST11.
[0032] STEP ST14: The processing unit 61 displays on the display 51 a screen 23 on which the key image of the key image identification information identified in step ST13 can be designated and operated with the finger of the finger identification information identified in step ST12 at a predetermined hand position.
[0033] STEP ST15: The processing unit 61 of the terminal device 3 obtains finger identification information of the finger that will perform the next designation operation from the music data read out in step ST11.
[0034] STEP ST16: The processing unit 61 of the terminal device 3 obtains key image identification information of the key image to be next specified from the music data read out in step ST11.
[0035] STEP ST17: The processing unit 61 judges whether or not it is time to display the screen 23 according to the next finger designation operation, and if it is judged that it is time, the process proceeds to step ST18. The timing is determined based on the note duration data of the music data in FIG. 7 that is currently being specified. This timing is the timing before the next designation operation is performed with a finger.
[0036] STEP ST18: The processing unit 61 displays (switches) on the display 51 a screen 23 on which the key image of the key image identification information identified in step ST17 can be specified and operated with the finger of the finger identification information identified in step ST16 at the above-mentioned assumed hand and finger position.
[0037] The above actions are actions on the screen, and when a key image on the screen 23 is touched by the user's finger, a sound corresponding to that key image is output from the speaker 52.
[0038] As described above, according to this embodiment, by moving the keyboard image left and right on the screen 23 in accordance with the music data, the user can touch the appropriate key image with his / her fingers while keeping the hand position fixed, without moving the hand or finger from the expected position. This makes playing easier, and even beginners can enjoy playing.
[0039] In the above-described embodiment, as shown in Figs. 5 and 6, each of the five fingers A to E is associated with an area (position) on the screen 23 corresponding to one key image, but one finger may be associated with an area on the screen 23 corresponding to two or more key images.
[0040] In that case, for example, on the screen 23 shown in FIG. 5, the finger is used to associate areas (positions) on the screen 23 that correspond to the two key images X10 and X11, and when the next key image to be specified and operated with the finger D based on the music data is X11, the same screen 23 as shown in FIG. 5 is displayed as is (the keyboard image is not shifted). In this way, the user can specify and operate the key image X11 with his / her finger D without shifting the keyboard image.
[0041] In the above-described embodiment, when it is time to designate the next key image with a finger, the next key image to be designated is displayed as an image that is visually identifiable by the user. For example, an illustrated image of a finger may be displayed within the key image. This allows the user to easily know the next key image to be designated.
[0042] The present invention is not limited to the above-described embodiments. In other words, those skilled in the art may make various modifications, combinations, sub-combinations, and substitutions of the components of the above-described embodiment within the technical scope of the present invention or an equivalent scope. In the above embodiment, the case where one hand is positioned at the assumed position has been exemplified, but assumed positions may be determined for each of the hands, and key images corresponding to the assumed positions may be displayed. [Industrial Applicability]
[0043] The present invention is applicable to a system that provides the enjoyment of playing the piano or organ through on-screen operations. [Explanation of symbols]
[0044] 1. Performance system 3...Terminal device 6. Server equipment 23…Screen 51…Display
Claims
1. A program for displaying a keyboard image on a screen, When a position on the screen where at least five fingers are in contact with the screen is assumed, a finger specifying step of specifying a finger that will next specify a key image based on the music data; a key image specifying step of specifying a key image to be next specified and operated with a finger based on the music data; a display switching step of switching and displaying the specified key image on a screen on which the specified key image can be specified and operated by the specified finger at the assumed position; A keyboard screen display program that causes a computer to execute the above.
2. The display switching step switches the display of the screen based on the music data before the timing at which the next designation operation is to be performed.
2. The keyboard screen display program according to claim 1.
3. the music data includes basic elements including key image identification information for identifying the key image, finger identification information for identifying a finger for designating the key image, and sound duration information indicating a duration of a sound to be output in response to the designation operation of the key image, and the order of the basic elements is defined; the finger specifying step includes sequentially specifying a finger to be next operated based on the music data; The key image specifying step sequentially specifies the key image to be next specified based on the music data.
3. The keyboard screen display program according to claim 2.
4. The display switching step determines a timing for switching and displaying the screen based on the note duration information of the music data.
4. The keyboard screen display program according to claim 3.
5. The display switching step includes: The keyboard image is displayed after the screen is switched, the keyboard image being shifted according to the distance between the specified finger position and the specified key image at the timing before the screen is switched.
5. The keyboard screen display program according to claim 4.
6. In response to a designation operation of the key image with the finger, a sound assigned to the key image is output.
6. The keyboard screen display program according to claim 5.
7. The number of positions on the screen of the key image designated by each of the at least five fingers is one or more.
7. The keyboard screen display program according to claim 6.
8. Next, the key image designated by the finger is displayed as a visually identifiable image.
8. The keyboard screen display program according to claim 7.
9. The identifiable image is an illustrated image of a finger.
9. The keyboard screen display program according to claim 8.
10. A keyboard image display system for displaying a keyboard image on a screen, comprising: When a position on the screen where at least five fingers are in contact with the screen is assumed, a finger specifying means for specifying a finger that will next specify a key image based on music data; a key image specifying means for specifying a key image to be next specified and operated with a finger based on the music data; a display switching means for switching and displaying the specified key image on a screen that can be specified and operated by the specified finger at the assumed position; A keyboard screen display system having the above configuration.