Musical score processing device, program and musical score processing method
The music score processing device addresses the limited display range of existing sheet music processing devices by adding a moving destination mark to the destination indicated by repeating symbols, enhancing user convenience and performance.
Patent Information
- Application Number
- JP2023144805
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-06
- Publication Date
- 2025-03-18
AI Technical Summary
Existing sheet music processing devices have a limited range of display, making it difficult for users to perform while viewing the music effectively.
A music score processing device and method that includes an acquisition unit for acquiring music score data and a display control unit for adding a moving destination mark to the destination indicated by repeating symbols in the music score, enhancing display and usability.
The solution allows for improved user convenience by clearly indicating the moving destination within the sheet music, enabling more effective performance while viewing the displayed music.
Smart Images

Figure 2025037708000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a score processing device, a program, and a score processing method. [Background technology]
[0002] 2. Description of the Related Art Conventionally, there is known a music score processing device that processes and displays music score data.
[0003] For example, the method of creating music scores disclosed in Patent Document 1 divides music score data consisting of multiple pages into bars, and judges the complexity of the performance of each bar on a page-by-page basis. The part that is easy to play based on the judgment result is set as the position of the page break, and the layout of the music score is changed based on the position of the page break, and the music score with the changed layout is output. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2009-151712 A Summary of the Invention [Problem to be solved by the invention]
[0005] However, the amount of music that can be displayed at one time is limited, so there is a demand for improved display for users who want to play while viewing the displayed music. [Means for solving the problem]
[0006] The present disclosure relates to a score processing device that includes an acquisition unit that acquires score data, and a display control unit that adds and displays a destination mark at a destination indicated by a repeat symbol included in the score.
[0007] The present disclosure is a program executed by a processor possessed by a music score processing device, causing the processor to function as an acquisition unit that acquires music score data, and a display control unit that adds and displays destination marks at the destinations indicated by repeat symbols included in the music score.
[0008] The present disclosure is a musical score processing method including an acquisition step in which a musical score processing device acquires musical score data, and a display control step in which the musical score processing device adds and displays a destination mark at a destination indicated by a repeat symbol included in the musical score. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing a configuration of a display device. [Diagram 2] FIG. 4 is a diagram showing an example of a first thumbnail image bundle. [Diagram 3] FIG. 13 is a diagram showing an example of a list screen. [Figure 4] FIG. 4 is a diagram showing an example of a viewing screen. [Diagram 5] FIG. 4 is a diagram showing a musical score image displayed on a touch panel. [Figure 6] FIG. 4 is a diagram showing a musical score image displayed on a touch panel. [Figure 7] FIG. 4 is a diagram showing a musical score image displayed on a touch panel. [Figure 8] FIG. 4 is a diagram showing a musical score image displayed on a touch panel. [Figure 9] FIG. 4 is a diagram showing a musical score image displayed on a touch panel. [Figure 10] FIG. 4 is a diagram showing a musical score image displayed on a touch panel. [Figure 11] 4 is a flowchart showing the operation of the display device. [Figure 12] 4 is a flowchart showing the operation of the display device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0011] [1. Display device configuration] FIG. 1 is a block diagram showing the configuration of a display device 100 that corresponds to a score processing device. The display device 100 includes a wireless communication interface 110, an input interface 120, a display unit 130, and a control unit 150. Hereinafter, the interface will be abbreviated as I / F.
[0012] The wireless communication I / F 110 is an interface for communicating with other devices. The wireless communication I / F 110 includes a wireless communication module that complies with standards such as Wi-Fi and Bluetooth. Wi-Fi and Bluetooth are registered trademarks.
[0013] The input I / F 120 includes a connection port and an interface circuit that are compliant with standards such as USB (Universal Serial Bus). To the input I / F 120, for example, other devices that supply image files and document files to the display device 100 and input devices that accept user operations are connected. For example, a pedal-type input device is used as the input device. When the input device is placed under the user's feet and the user steps on the pedal, an operation signal corresponding to the operation is input to the control unit 150 via the input I / F 120.
[0014] The display unit 130 includes a touch panel 131 including a display panel and a touch sensor. For example, a liquid crystal panel or an organic EL (Electro Luminescence) panel is used for the display panel. The touch sensor detects a touch operation on the display panel. The touch sensor detects a touch position, which is a position on the touch panel 131 that is touched by a pointing object such as an electronic pen or a user's finger. The touch sensor outputs an operation signal including the detected touch position to the control unit 150. The touch position is indicated by coordinates in a coordinate system preset on the display panel.
[0015] The control unit 150 includes a memory unit 160 and a processor 170 .
[0016] The storage unit 160 includes at least a non-volatile storage device. The storage unit 160 may also include a volatile storage device. The non-volatile storage device may be, for example, a Read Only Memory (ROM), a flash memory, or an Electrically Erasable Programmable Read-Only Memory (EEPROM).
[0017] The storage unit 160 is used as a calculation area for the processor 170. The storage unit 160 also stores an OS 161 and application programs 163 executed by the processor 170, setting data 167 which is settings related to the operation of the display device 100, and the like. Hereinafter, the application program 163 will be referred to as APP163.
[0018] The storage unit 160 also stores files 165. The files 165 include, but are not limited to, image files and document files. The image files are files to which an image-related extension, such as "jpg", "png", "bmp", "tif", and "gif", has been added. The document files are files to which a document-related extension, such as "txt", "doc", "docx", "ppt", "pptx", "xls", "xlsx", "htm", "html", "xps", and "pdf", has been added. These files 165 may be files 165 received by the wireless communication I / F 110 from another device such as a server, or may be files 165 read by a scanner connected to the input I / F 120.
[0019] The processor 170 is an arithmetic processing device including a processor such as a CPU (Central Processing Unit) or an MPU (Micro-Processing Unit). The processor 170 may be configured with a single processor, or may be configured with multiple processors. The processor 170 may be configured with a SoC integrated with a part or all of the storage unit 160 or other circuits. The processor 170 may be configured with a combination of a CPU that executes a program and a DSP (Digital Signal Processor) that executes a predetermined arithmetic processing. Furthermore, the processor 170 may be configured with all of its functions implemented in hardware, or may be configured using a programmable device.
[0020] The control unit 150 includes, as functional blocks, an acquisition unit 171, a detection unit 173, a thumbnail image bundle generation unit 175, a recognition unit 177, and a display control unit 177.
[0021] The acquisition unit 171 acquires the file 165 and outputs the acquired file 165 to the display control unit 177. The file 165 corresponds to data. The acquisition unit 171 acquires the file 165 by reading it from the storage unit 160. The acquisition unit 171 also acquires the file 165 by controlling the wireless communication I / F 110 to connect to another device such as a server and receiving the file 165 from the other connected device. The acquisition unit 171 also acquires the file 165 by receiving it from another device connected to the input I / F 120.
[0022] Based on an operation signal input from the touch sensor, detection unit 173 detects an operation on touch panel 131. The operations detected by detection unit 173 include a touch operation, a swipe operation, and a fling operation.
[0023] FIG. 2 is a diagram showing an example of the thumbnail image bundle 21. As shown in FIG. The thumbnail image bundle generating unit 175 generates thumbnail images 211 by reducing the images of each page of the file 165 acquired by the acquiring unit 171. The thumbnail image bundle generating unit 175 generates an overhead image of the thumbnail image bundle 21 based on the thumbnail image bundle 21, which is a bundle of the generated thumbnail images 211. The overhead image is an image visually recognized by an observer when the observer views the thumbnail image bundle 21 arranged in a virtual space from any viewpoint in the virtual space.
[0024] The thumbnail image bundle generation unit 175 arranges multiple thumbnail images 211 along a first virtual axis Q that is parallel to the horizontal direction of the touch panel 131. The multiple thumbnail images 211 can be moved along the first virtual axis Q by a touch operation by the user. Furthermore, the thumbnail image bundle generation unit 175 rotates the multiple thumbnail images 211 around an axis that is parallel to the vertical direction of the touch panel 131 and is parallel to a second virtual axis M that intersects with the first virtual axis Q. Furthermore, the thumbnail image bundle generation unit 175 generates an overhead image of the thumbnail image bundle 21 by rotating around an axis that is parallel to the first virtual axis Q.
[0025] The recognition unit 177 executes an OCR (Optical Character Recognition) process on the file 165 selected by the operation detected by the detection unit 173. The recognition unit 177 executes the OCR process to determine whether or not the file 165 includes an image of a musical score (hereinafter, referred to as a musical score image 27). For example, the recognition unit 177 detects an image of a musical staff by the OCR process, thereby determining that the file 165 includes the musical score image 27.
[0026] Furthermore, when the file 165 includes a musical score image 27, the recognition unit 177 detects musical symbols such as repeat symbols included in the file 165. For example, the recognition unit 177 detects repeat symbols such as a repeat symbol, a first bracket and a second bracket, Da Capo and Fine, Segno 37 and Dal Segno 35, Coda 33 and To Coda 31, etc.
[0027] The display control unit 179 generates an application screen 20 to be displayed on the touch panel 131 based on the thumbnail image bundle 21 generated by the thumbnail image bundle generation unit 175 and the file 165. The application screen 20 includes a list screen 20A and a browsing screen 20B shown in Fig. 3 and Fig. 4, respectively.
[0028] The application screen 20 will be described with reference to FIGS. 3 and 4, the direction going upward in the figure is indicated by the symbol UP as up, the direction going downward in the figure is indicated by the symbol DW as down, the direction going left in the figure is indicated by the symbol L as leftward, and the direction going right in the figure is indicated by the symbol R as rightward.
[0029] FIG. 3 is a diagram showing an example of the list screen 20A. The list screen 20A is a screen that displays a list of files 165. On the list screen 20A, a combination of thumbnail image bundle 21 and main thumbnail image 23 is displayed for each file 165. In the following, it is assumed that files 165A, 165B, 165C, . . . , 165N are stored in the storage unit 160, and a case will be described in which the thumbnail image bundle 21 and main thumbnail image 23 of these files 165A, 165B, 165C, . . . , 165N are displayed. The thumbnail image bundle 21 of the file 165A is displayed as thumbnail image bundle 21A, and the main thumbnail image 23 is represented as main thumbnail image 23A. The same applies to files 165B, . . . , 165N.
[0030] On the list screen 20A, a combination of a thumbnail image bundle 21A based on the file 165A and a main thumbnail image 23A is displayed at a predetermined position. Also displayed on the list screen 20A is a combination of a thumbnail image bundle 21B and a main thumbnail image 23B based on the file 165B. The combination of the thumbnail image bundle 21B and the main thumbnail image 23B is displayed below the combination of the thumbnail image bundle 21A and the main thumbnail image 23A. Also displayed on the list screen 20A is a combination of a thumbnail image bundle 21C and a main thumbnail image 23C based on the file 165C. The combination of the thumbnail image bundle 21C and the main thumbnail image 23C is displayed below the combination of the thumbnail image bundle 21B and the main thumbnail image 23B.
[0031] The thumbnail image bundle 21 is a group of images in which a plurality of thumbnail images 211 are arranged in the left-right direction. Each of the thumbnail images 211 included in the thumbnail image bundle 21 is displayed in a state in which it appears as if viewed from a predetermined viewpoint. One thumbnail image 211 included in the thumbnail image bundle 21 corresponds to one page of the corresponding file 165.
[0032] The main thumbnail image 23 is a thumbnail image corresponding to a representative page of the file 165. An example of the representative page is the top page of the file 165. On the list screen 20A, a part of the thumbnail image 211 of a predetermined page may be displayed as the main thumbnail image 23, or the entire thumbnail image 211 of a predetermined page may be displayed as the main thumbnail image 23.
[0033] On the list screen 20A, a selection operation can be input by a touch operation to select a combination of the thumbnail image bundle 21 and the main thumbnail image 23. When the combination is selected on the list screen 20A, the display control unit 179 displays a viewing screen 20B related to the selected file 165.
[0034] 4 is a diagram showing an example of viewing screen 20 B. Viewing screen 20 B includes first display area 221 and second display area 223.
[0035] The first display area 221 is an area for displaying the thumbnail image bundle 21 selected on the list screen 20A. When a combination of a main thumbnail image 23 and a thumbnail image bundle 21 is selected on the list screen 20A, the thumbnail image bundle 21 included in the selected combination is displayed in the first display area 221.
[0036] The display control unit 179 changes the display mode of the thumbnail image bundle 21 when a predetermined touch operation, such as a swipe operation, is performed by the pointer within the first display region 221.
[0037] When a rightward swipe operation is performed in the first display region 221, the multiple thumbnail images 211 move from left to right in the first display region 221 according to the amount of rightward movement of the indicator. When a leftward swipe operation is performed in the first display region 221, the multiple thumbnail images 211 move from right to left in the first display region 221 according to the amount of leftward movement of the indicator.
[0038] The second display area 223 is an area for displaying the page image 25 of the page corresponding to the thumbnail image 211 selected in the first display area 221. In the explanation of Fig. 3 and Fig. 4, a case will be explained in which the display control unit 179 processes data included in the file 165 and displays it in the second display area 223, thereby displaying the page image 25. The page image 25B-111 shown in Fig. 4 indicates the page image 25 corresponding to the 111th page of the file 165B.
[0039] In the second display area 223, the page image 25 to be displayed is switched by performing a predetermined touch operation, such as a swipe operation, with the pointer.
[0040] When file 165 is a left-opening document, and a predetermined touch operation is performed to the right in second display area 223, page image 25 of the page preceding the page corresponding to page image 25 displayed before the touch operation is displayed in second display area 223. When a predetermined touch operation is performed to the left in second display area 223, page image 25 of the page following the page corresponding to page image 25 displayed before the touch operation is displayed in second display area 223.
[0041] 4, when a rightward swipe operation is performed in the second display area 223, a page image 25B-110, which is the page immediately preceding the page image 25B-111, is displayed in the second display area 223. Illustration of the page image 25B-110 is omitted. 4, when a swipe operation in the left direction is performed in the second display area 223, a page image 25B-112, which is the page immediately following the page image 25B-111, is displayed in the second display area 223. Illustration of the page image 25B-112 is omitted.
[0042] [2. Displaying the music score image] Furthermore, when the file 165 contains a musical score image 27 and a repeat symbol is detected from the musical score image 27, the display control unit 179 displays a first destination mark 41 or a second destination mark 43 indicating the destination position of the performance, and a specific image 50 indicating the destination page. The first destination mark 41 corresponds to the destination mark and the first destination mark, and the second destination mark 43 corresponds to the destination mark and the second destination mark.
[0043] When the recognition unit 177 detects a repeat symbol, the display control unit 179 determines the page that includes the origin position and destination position of the performance indicated by the repeat symbol detected by the recognition unit 177. Next, the display control unit 179 judges whether the page of the origin position of the performance indicated by the repeat symbol and the page of the destination position of the performance are the same page. For example, when Dal Segno 35 and Segno 37 are detected as repeat symbols, the display control unit 179 judges whether Dal Segno 35, which is the musical symbol indicating the origin, and Segno 37, which is the musical symbol indicating the destination, are detected on the same page. In addition, when ToCoda 31 and Coda 33 are detected as repeat symbols, the display control unit 170 judges whether ToCoda 31, which is the musical symbol indicating the origin, and Coda 33, which is the musical symbol indicating the destination, are detected on the same page.
[0044] 5 to 10 are diagrams showing a state in which a musical score image 27 is displayed on the touch panel 131. FIG. When the display control unit 179 determines that the musical symbol indicating the source and the musical symbol indicating the destination are included in the same page, it displays the first destination mark 41 on the staff. The display control unit 179 displays a first destination mark 41 indicating the destination of the performance at the beginning of the musical staff where a musical symbol Coda33 indicating the destination is displayed, as shown in Fig. 5, for example. In this embodiment, the first destination mark 41 is a sticky note image, but the first destination mark 41 may be, for example, a shape such as a circle, a rectangle, or an arrow, a stamp, a speech bubble, etc. Furthermore, the display control unit 179 may display the first destination mark 41 by superimposing it on the musical symbol Coda33 indicating the destination, or by displaying a sticky note image near the musical symbol indicating the destination, as shown in Fig. 6.
[0045] When the user wants to move the position of the first destination mark 41 displayed on the musical staff, the user presses and holds the first destination mark 41 by a touch operation. The display control unit 179 changes the display position of the first destination mark 41 based on the touch operation detected after the long press operation. The control unit 150 moves the display position of the first destination mark 41, which is displayed at the position of the touch panel 131 touched by the user's finger, to a position away from the touch panel 131 where the user's finger is.
[0046] In addition, when the musical symbol indicating the source and the musical symbol indicating the destination are not contained on the same page but on different pages, the display control unit 179 displays the second destination mark 43 on the musical staff and displays the specific image 50 in the thumbnail image 211.
[0047] Fig. 7 shows a state in which Dal Segno (DS) 35 is displayed as the musical symbol indicating the source of movement. Fig. 8 shows a state in which Segno 37 is displayed as the musical symbol indicating the destination of movement. The display control unit 179 displays a second destination mark 43 indicating the destination at the beginning of the staff where the musical symbol Segno 37 indicating the destination is displayed. The display control unit 179 may also display the second destination mark 43 superimposed on or near Segno 37, which is the musical symbol indicating the destination.
[0048] In this embodiment, the second destination mark 43 is the same sticky note image as the first destination mark 41, but the first destination mark 41 and the second destination mark 43 differ in at least one of the color, shape, and size of the sticky note image. The second destination mark 43 may also be, for example, a shape such as a circle, a rectangle, or an arrow, or a stamp or a speech bubble. For example, the shape of the first destination mark 41 may be a circle, and the shape of the second destination mark 43 may be a rectangle.
[0049] Furthermore, the user can also change the display position of the second destination mark 43, similarly to the first destination mark 41. In this case as well, the second destination mark 43 is selected by a long press operation, and the second destination mark 43 is moved to a desired position by a touch operation.
[0050] Furthermore, when the musical symbol indicating the source and the musical symbol indicating the destination are included on different pages, the display control unit 179 displays the specific image 50 in the thumbnail image 211 that includes the musical symbol indicating the destination. The specific image 50 is displayed at the beginning of the staff where the musical symbol indicating the destination of the thumbnail image 211 is displayed, or at a position corresponding to the display position of the musical symbol indicating the destination. The user can recognize the destination of the performance by referring to the specific image 50 displayed in the first display area 221.
[0051] In this embodiment, the specific image 50 is the same sticky note image as the first destination mark 41 and the second destination mark 43, but the specific image 50 is different from the first destination mark 41 and the second destination mark 43 in at least one of the color, shape, and size of the sticky note image. The specific image 50 may also be, for example, a figure such as a circle, a rectangle, or an arrow, a stamp, a speech bubble, or the like. For example, the shape of the first destination mark 41 may be a circle, the shape of the second destination mark 43 may be a square, and the shape of the specific image 50 may be a triangle.
[0052] Next, the operation of the display control unit 179 when an operation signal indicating that the input device has been operated is input from the input I / F 120 will be described. For example, assume that file 165 is in a state in which a musical symbol indicating the source and a musical symbol indicating the destination are included on different pages, and a sheet music image 27 including the musical symbol indicating the source is displayed in second display area 223. When an operation signal indicating that the input device has been operated is input in this state, display control unit 179 causes sheet music image 27 including second destination mark 43 to be displayed in second display area 223. The user can cause sheet music image 27 including second destination mark 43 to be displayed in second display area 223 by operating an input device such as a pedal.
[0053] Next, the operation of the display control unit 179 in the case where the musical symbol indicating the move source and the musical symbol indicating the move destination are included on the same page, or where the file 165 does not include a repeat symbol, will be described. Each time an operation signal is input from the input device via the input I / F 120, the display control unit 179 scrolls the sheet music image 27 displayed in the second display area 223 by a predetermined amount. This allows the area of the same page that could not be displayed in the second display area 223 to be displayed.
[0054] When an operation signal is input from the input I / F 120 while the sheet music image 27 is displayed in the second display area 223, the display control unit 179 changes the display mode of the area of the sheet music image 27 displayed before scrolling and the area of the sheet music image 27 newly displayed after scrolling for a predetermined period of time. For example, the display control unit 179 displays the hatched display 60 over the area of the score image 27 to be newly displayed after scrolling as shown in Fig. 9. This makes it easier for the user to distinguish between the area of the score image 27 that was displayed before scrolling, which is the area currently being played, and the area of the score image 27 to be played next, which is displayed with the hatched display 60 overlaid on it.
[0055] Conversely, the display control unit 179 may display a shaded display 60 over the area of the score image 27 that was displayed before scrolling, as shown in Fig. 10. Even with this display format, the user can easily distinguish between the area of the score image 27 that was displayed before scrolling, which is the area being played, and the area of the score image 27 that will be played next. Also, instead of using shaded displays, the display format may be changed in other ways, such as by changing the color.
[0056] When a predetermined time has elapsed since scrolling, the display control unit 179 erases the shaded display 60 so that the shaded area of the score image 27 can be easily viewed.
[0057] [3. Operation of the display device] 11 and 12 are flowcharts showing the operation of the display device 100. The operation of the display device 100 will be described with reference to the flowcharts shown in FIGS. First, the control unit 150 starts up the APP 163 selected by the user's touch operation (step S1).
[0058] Next, the control unit 150 determines whether or not the file 165 is selected by the user's touch operation (step S2). If the file 165 is not selected (step S2 / NO), the control unit 150 waits until the file 165 is selected.
[0059] When the file 165 is selected (step S2 / YES), the control unit 150 executes an OCR process on the selected file 165 (step S3), and determines whether or not the selected file 165 includes a musical score image 27 (step S4).
[0060] If the selected file 165 does not include the musical score image 27 (step S4 / NO), the control unit 150 causes the selected file 165 to be displayed on the touch panel 131 (step S5). After that, the control unit 150 determines whether or not a touch operation by the user has been accepted (step S6). If the control unit 150 has not accepted a touch operation by the user (step S6 / NO), the control unit 150 waits until a touch operation is accepted.
[0061] When the control unit 150 receives a touch operation by the user (step S6 / YES), it determines whether or not the received operation is an operation to end the APP 163 (step S7). When the received operation is not an operation to end the APP 163 (step S7 / NO), the control unit 150 executes a process corresponding to the received operation (step S8). For example, when the control unit 150 detects a swipe operation to the right in the first display area 221, the control unit 150 moves the multiple thumbnail images 211 from the left to the right according to the amount of movement of the touch operation to the right. Also, when the control unit 150 receives an operation to end the APP 163 (step S7 / YES), it ends the APP 163 and ends this processing flow.
[0062] If the selected file 165 includes the musical score image 27 (step S4 / YES), the control unit 150 determines whether or not the selected file 165 includes a repeat symbol (step S9). If the selected file 165 does not include a repeat symbol (step S9 / NO), the control unit 150 causes the thumbnail image 211 to be displayed in the first display area 221, and the musical score image 27 to be displayed in the second display area 223 (step S14).
[0063] If the selected file 165 contains a repeat symbol (step S9 / YES), the control unit 150 determines whether the source position of the performance indicated by the detected repeat symbol and the destination position of the performance are included in the same page (step S10).
[0064] When the origin position of the performance and the destination position are included in the same page (step S10 / YES), the control unit 150 adds a first destination mark 41 indicating the destination to the beginning of the staff including the destination position of the musical score indicated by the repeat sign (step S11).
[0065] Furthermore, when the origin position and destination position of the performance are included in different pages (step S10 / NO), the control unit 150 adds a second destination mark 43 to the beginning of the staff including the destination position of the musical score indicated by the repeat sign (step S12). Furthermore, the control unit 150 adds a specific image 50 to the thumbnail image 211 of the destination page (step S13).
[0066] Next, the control unit 150 causes the sheet music image 27 of the selected file 165 to be displayed in the second display area 223, and causes the thumbnail image 211 of the sheet music image 27 to be displayed in the first display area 221 (step S14).
[0067] The operation of the display device 100 will be further described with reference to the flowchart shown in FIG. Next, the control unit 150 judges whether or not an operation has been accepted (step S15). If the control unit 150 judges that an operation has not been accepted (step S15 / NO), the control unit 150 proceeds to the judgment of step S20.
[0068] When the control unit 150 receives an operation (step S15 / YES), it determines whether or not the received operation is an operation to change the display position of the first destination mark 41 or the second destination mark 43 (step S16). For example, when the display position of the first destination mark 41 or the second destination mark 43 is pressed and held, the control unit 150 determines that an instruction to change the display position of the first destination mark 41 or the second destination mark 43 has been received.
[0069] If the accepted operation is an operation to change the display position of the first destination mark 41 or the second destination mark 43 (step S16 / YES), the control unit 150 changes the display position of the first destination mark 41 or the second destination mark 43 (step S17). The control unit 150 changes the display position of the first destination mark 41 or the second destination mark 43 based on a touch operation detected after the operation to change the display position of the first destination mark 41 or the second destination mark 43 (step S17). The control unit 150 moves the display position of the first destination mark 41 or the second destination mark 43 displayed at the position of the touch panel 131 touched by the user's finger to a position away from the touch panel 131 by the user's finger.
[0070] In addition, if the received operation is not an operation to change the display position of the first destination mark 41 or the second destination mark 43 (step S16 / NO), the control unit 150 determines whether the received operation is an operation to terminate the APP 163 (step S18).
[0071] If the accepted operation is not an operation for terminating the APP 163 (step S18 / NO), the control unit 150 executes a process corresponding to the accepted operation, similar to step S8 (step S19). Furthermore, if the accepted operation is an operation to terminate the APP 163 (step S18 / YES), the control unit 150 terminates the APP 163 and ends this processing flow.
[0072] Next, the control unit 150 determines whether or not an operation signal has been input via the input I / F 120 (step S20). If an operation signal has not been input (step S20 / NO), the control unit 150 returns to the determination of step S15.
[0073] When an operation signal is input via the input I / F 120 (step S20 / YES), the control unit 150 determines whether or not the score image 27 displayed in the second display area 223 includes a repeat symbol (step S21). If the score image 27 does not include a repeat symbol (step S21 / NO), the control unit 150 scrolls the score image 27 by a predetermined amount (step S24). At this time, the control unit 150 changes the display mode of the area displayed before the scrolling and the area newly displayed after the scrolling, and scrolls the score image 27 (step S24).
[0074] In addition, when the musical score image 27 displayed in the second display area 223 contains a repeat symbol (step S21 / YES), the control unit 150 determines whether the destination position of the musical score indicated by the repeat symbol and the source position of the musical score are included in different pages of the musical score image 27 (step S22).
[0075] If the destination position of the score indicated by the repeat sign and the source position are not included in different pages of the score image 27 (step S22 / NO), the control unit 150 scrolls the score image 27 by a predetermined amount (step S24). At this time, the control unit 150 changes the display mode of the area displayed before the scrolling and the area newly displayed after the scrolling, and scrolls the score image 27 (step S24).
[0076] Furthermore, if the destination position of the score indicated by the repeat sign and the source position are included in different pages of the score image 27 (step S22 / YES), the control unit 150 displays the page of the score image 27 to which the second destination mark 43 has been added (step S23). After that, the control unit 150 returns to the judgment of step S15.
[0077] 4. Summary of this Disclosure The following is a summary of this disclosure.
[0078] (Appendix 1) A score processing device comprising: an acquisition unit that acquires score data; and a display control unit that adds and displays a destination mark at a destination indicated by a repeat symbol included in the score.
[0079] According to this configuration, when the score is displayed, the destination mark is displayed at the destination indicated by the repeat symbol included in the score, which improves the convenience for the user who plays while viewing the score.
[0080] (Appendix 2) The score processing device according to claim 1, wherein the display control unit displays the destination mark in a different manner depending on whether the source position and destination position indicated by the repeat symbol are included on the same page or whether the source position and destination position indicated by the repeat symbol are included on different pages.
[0081] According to this configuration, the state of the destination mark indicates whether the origin position and destination position indicated by the repeat symbol are on the same page, or on different pages. Therefore, by visually checking the destination mark, the user can recognize whether the destination is on the same page or a different page.
[0082] (Appendix 3) 3. The score processing device according to claim 1, wherein the display control unit displays images of a plurality of pages included in the score, and when the source position and destination position indicated by the repeat symbol are on different pages, a specific image indicating that the destination position is included is added to the image of the page including the destination position and displayed.
[0083] According to this configuration, when the origin position and destination position indicated by the repeat symbol are on different pages, a specific image indicating that the destination position is included is displayed on the image of the page including the destination position, so that the user can recognize the page including the destination position.
[0084] (Appendix 4) The score processing device according to claim 3, wherein the display control unit displays a first destination mark at the destination position when the source position and destination position indicated by the repeat symbol are included in the same page, and displays a second destination mark different from the first destination mark at the destination position when the source position and destination position indicated by the repeat symbol are included in different pages, and adds and displays the specific image to an image of a page including the destination position.
[0085] According to this configuration, when the origin position and destination position indicated by the repeat symbol are included in the same page, a first destination mark is displayed at the destination position. Also, when the origin position and destination position indicated by the repeat symbol are included in different pages, a second destination mark different from the first destination mark is displayed. Therefore, it is possible to indicate by the first destination mark and the second destination mark whether the origin position and destination position indicated by the repeat symbol are included in the same page or different pages. Furthermore, if the origin and destination positions indicated by the repeat symbol are included in different pages, a specific image is displayed on the image of the page including the destination position, allowing the user to recognize the page including the destination position.
[0086] (Appendix 5) The score processing device according to claim 1, further comprising a recognition unit which performs OCR (Optical Character Recognition) processing on an image which is data of the score, and the display control unit which adds a destination mark to the destination indicated by the repeat symbol recognized by the recognition unit and displays it, and the display control unit which corrects the position of the destination mark based on an operation from a user and displays it.
[0087] According to this configuration, if there is an error in the destination position indicated by the repeat symbol recognized by the OCR process, the position of the destination mark can be corrected by a user operation.
[0088] (Appendix 6) The score processing device according to any one of claims 1 to 5, wherein, when scrolling the score based on a user's operation, the display control unit changes the display mode of an area displayed before scrolling from that of an area newly displayed after scrolling.
[0089] According to this configuration, when the score is scrolled based on a user's operation, the area displayed before scrolling and the area newly displayed after scrolling are displayed in different display modes, which makes it easier for the user to recognize the position of the score being played, and improves the convenience for the user who plays while viewing the score.
[0090] (Appendix 7) A program executed by a processor of a score processing device, causing the processor to function as an acquisition unit that acquires score data, and a display control unit that adds and displays destination marks at the destinations indicated by repeat symbols included in the score.
[0091] According to this configuration, when the score is displayed, the destination mark is displayed at the destination indicated by the repeat symbol included in the score, which improves the convenience for the user who plays while viewing the score.
[0092] (Appendix 8) The score processing method includes an acquisition step in which a score processing device acquires score data, and a display control step in which the score processing device adds and displays a destination mark at the destination indicated by a repeat symbol included in the score.
[0093] As a result, when the score is displayed, a destination mark is displayed at the destination indicated by the repeat symbol included in the score, improving the convenience for users who play while viewing the score.
[0094] The above-described embodiment is a preferred embodiment, however, the present invention is not limited to the above-described embodiment and various modifications are possible without departing from the spirit and scope of the present invention. For example, the present invention is not limited to acquiring and displaying music score data, and may acquire music scores in a data format other than an image file or document file.Furthermore, the present invention is not limited to music scores written on a staff, and may be in other formats, such as text notation.
[0095] 1 indicates a functional configuration, and the specific implementation form is not particularly limited. In other words, it is not necessarily required to implement hardware corresponding to each functional unit individually, and it is of course possible to implement a configuration in which one or more processors execute a program to realize the functions of multiple functional units. Also, some of the functions realized by software in the above embodiment may be realized by hardware, and some of the functions realized by hardware may be realized by software.
[0096] 11 and 12 are divided according to the main processing contents in order to facilitate understanding of the processing of the display device 100. The present invention is not limited by the manner of division or names of the processing units shown in the flowcharts shown in FIGS. 11 and 12. Furthermore, the processing of the display device 100 can be divided into more processing units according to the processing contents, or one processing unit can be divided so as to include more processes. Furthermore, the processing order of the above flowcharts is not limited to the example shown in the figures. [Explanation of symbols]
[0097] 20...Application screen, 20A...List screen, 20B...Viewing screen, 21, 21A, 21B, 21C...Bundle of thumbnail images, 23, 23A, 23B, 23C...Main thumbnail image, 25...Page image, 27...Music score image, 31...ToCoda, 33...Coda, 35...Dal Segno, 37...Segno, 41...First destination mark, 43...Second destination mark, 43...Destination mark, 50...Specific image, 60...Shaded display, 110...wireless communication I / F, 120...input I / F, 131...touch panel, 150...control unit, 160...memory unit, 161...OS, 163...APP, 165, 165A, 165B, 165C...files, 167...setting data, 170...processor, 171...acquisition unit, 173...detection unit, 175...thumbnail image bundle generation unit, 177...recognition unit, 211...thumbnail image, 221...first display area, 223...second display area.
Claims
1. An acquisition unit for acquiring data of musical scores; a display control unit that displays a destination mark by adding it to a destination indicated by a repeat sign included in the musical score; A score processing device comprising:
2. the display control unit displays the destination mark in a different manner depending on whether the origin position and the destination position indicated by the repeat symbol are included on the same page or whether the origin position and the destination position indicated by the repeat symbol are included on different pages. A score processing device according to claim 1.
3. the display control unit displays images of a plurality of pages included in the musical score, and when the origin position and the destination position indicated by the repeat sign are on different pages, displays an image of the page including the destination position by adding a specific image indicating that the destination position is included. A score processing device according to claim 1.
4. The display control unit is When the origin position and the destination position indicated by the repeat symbol are included in the same page, a first destination mark is displayed at the destination position; When the origin position and the destination position indicated by the repeat symbol are included in different pages, a second destination mark different from the first destination mark is displayed at the destination position, and the specific image is added to and displayed on an image of a page including the destination position. A score processing device according to claim 3.
5. The apparatus further includes a recognition unit that performs OCR (Optical Character Recognition) processing on the image of the score data, the display control unit adds a destination mark to a destination indicated by the repeat symbol recognized by the recognition unit and displays the destination mark; the display control unit corrects and displays the position of the destination mark based on an operation by a user. A score processing device according to claim 1.
6. the display control unit, when scrolling the score based on a user's operation, makes a display mode of an area displayed before scrolling different from a display mode of an area newly displayed after scrolling. A score processing device according to claim 1.
7. A program executed by a processor of a score processing device, The processor, A program that functions as an acquisition unit that acquires musical score data, and a display control unit that adds and displays a destination mark at the destination indicated by a repeat symbol included in the musical score.
8. An acquisition step in which the score processing device acquires score data; a display control step in which the score processing device displays a movement destination mark indicated by a repeat sign included in the score by adding the movement destination mark; A method for processing musical scores, comprising:
Citation Information
Patent Citations
Sheet music creation method and image processing system
JP2009151712A