Music keyboard interaction method and its device, equipment and medium

By setting up the music keyboard and composition area in the creation interface of the music-assisted creation software, and establishing a mapping relationship between the notes in the tune and the standard keys, the problem of users being difficult to create songs in dense notes is solved, achieving a more efficient and convenient music creation experience.

CN114495872BActive Publication Date: 2025-04-18GUANGZHOU GESHEN INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210129456.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-02-11
Publication Date
2025-04-18
Estimated Expiration
2042-02-11

AI Technical Summary

Technical Problem

Due to the screen size limitations of the composition area in the existing music-assisted creation software, the notes occupy a small distance and are densely displayed, making it difficult for users to browse globally and accurately select notes when creating songs, affecting the creation efficiency and experience.

Method used

Provides a music keyboard interaction method. By setting the music keyboard and composition area in the creation interface, dividing the note grid according to the rhythm and scale, and establishing a sequential mapping relationship between the notes in the tune and the standard keys, playing the notes in the tune in response to the note grid selection event and adding rhythm time information.

Benefits of technology

It lowers the technical threshold for non-professional users, allowing users to arrange music on a fixed music keyboard without adapting to changes in majors, improves user experience and creative efficiency, and displays melodic content with a larger range of time in a limited interface space through sparse note grid density.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114495872B_ABST
    Figure CN114495872B_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of music-assisted creation, and discloses a music keyboard interaction method and its device, equipment, and medium, including: displaying a creation interface, the creation interface includes a composition area and a music keyboard, the composition area includes a plurality of note grids divided according to the dimensions of rhythm and scale; determining the notes in the key corresponding to the key signature according to the pre-selected key signature, establishing a sequential mapping relationship between each note in the key and each standard key in the music keyboard, so that each standard key corresponds to each note in the key one by one, and the note in the key with the lowest scale is mapped to the standard key corresponding to the starting note; responding to the note grid selection event in the composition area, playing the note in the key corresponding to the note grid, playing the animation effect of the standard key corresponding to the note in the key, and adding the time information of the rhythm dimension corresponding to the note grid associated with the note in the key to the melody construction information. The present application constructs a standardized music keyboard, which can enrich the information display of the visual interface.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of music-assisted creation, and in particular to a music keyboard interaction method and its corresponding device, computer equipment and computer-readable storage medium. Background Art

[0002] Most of the software related to music-assisted creation in the prior art builds a corresponding composition area based on a piano keyboard. Each note on the keys has a corresponding position in the composition area. Users only need to select the note position in the composition area in chronological order, and can create the melody of the song without using paper, pen and musical instruments. In order to meet the needs of user creation, a piano keyboard with keys corresponding to a complete 88 notes is generally used to build the composition area. Since the interface of the composition area is limited by the screen size of the terminal device, the position of each note in the composition area occupies a small distance, and the display effect of each note is highly dense, which is not convenient for users to browse the whole picture, and it is even more inconvenient to select the note position. It is easy to touch other note positions by mistake, which affects the user's creation efficiency and experience.

[0003] In order to enable users to create efficiently in a simple composition area and improve the user experience, this application attempts to explore more technical solutions that are suitable for meeting actual needs. Summary of the invention

[0004] The primary purpose of the present application is to solve at least one of the above problems and provide a music keyboard interaction method and its corresponding device, computer equipment, and computer-readable storage medium.

[0005] In order to meet the various objectives of this application, this application adopts the following technical solutions:

[0006] A music keyboard interaction method provided for one of the purposes of the present application comprises the following steps:

[0007] Displaying a creation interface, the creation interface comprising a composition area and a music keyboard, the composition area comprising a plurality of note grids divided according to rhythm and scale dimensions, the music keyboard being arranged at a position corresponding to the scale dimension and comprising a plurality of standard keys of a fixed pattern, each standard key being used to represent a corresponding note, wherein one standard key is used to represent a starting note in the scale;

[0008] Determine the notes in the key corresponding to the key signature according to the preselected key signature, establish a sequential mapping relationship between each note in the key and each standard key in the music keyboard, so that each standard key corresponds to each note in the key one by one, and the lowest note in the key is mapped to the standard key corresponding to the starting note;

[0009] In response to a note grid selection event in the composition area, the note in the key corresponding to the note grid is played, the animation effect of the standard key corresponding to the note in the key is played, and the time information of the rhythm dimension corresponding to the note grid associated with the note in the key is added to the melody construction information.

[0010] In a further embodiment, the step of displaying the creation interface includes the following steps:

[0011] Determine the place width of each note grid in the horizontal dimension of the composition area according to the melody rhythm corresponding to each note grid in the preset rhythm dimension information;

[0012] Determine the place width of each note grid in the vertical dimension of the composition area according to the standard keys in the music keyboard corresponding to each note grid in the preset scale dimension information;

[0013] According to the corresponding occupied widths of the note grids in the horizontal and vertical dimensions of the composition area, edge auxiliary lines of the note grids are rendered to format and divide the composition area.

[0014] In a further embodiment, the step of displaying the creation interface includes the following steps:

[0015] Constructing rectangular buttons of equal length and width according to a preset aspect ratio as standard keys in a music keyboard;

[0016] The lowest standard key in the music keyboard is identified as the starting note in the scale according to the scale dimension, and the notes corresponding to other standard keys in the music keyboard are identified based on the scale sequence.

[0017] In a further embodiment, determining the notes in a key corresponding to the key signature according to the preselected key signature comprises the following steps:

[0018] Display the accompaniment template list, which contains multiple accompaniment templates, each of which includes melody rhythm and key signature;

[0019] Get the target accompaniment template selected by the user;

[0020] Determine the corresponding notes in the key according to the key signature in the target accompaniment template.

[0021] In a further embodiment, establishing a sequential mapping relationship between each note in a key and each standard key in a music keyboard includes the following steps:

[0022] Establishing a sequential mapping relationship between the notes in the key and each standard key in the music keyboard, and thereby identifying the notes in the key corresponding to each standard key;

[0023] According to the width of the standard keys corresponding to the scale dimension and the melody rhythm carried by the target accompaniment template, the horizontal and vertical edge auxiliary lines of the corresponding note grids in the composition area are drawn, and rendered to display the various note grids in the composition area under the key signature.

[0024] In an extended embodiment, after the step of responding to the note grid selection event in the composition area, the following steps are included:

[0025] In response to the keyboard switching instruction, a full keyboard pattern implemented according to the piano style is called to replace the music keyboard, and the note grids in the composition area are adjusted with the keys in the full keyboard pattern so that each scale in the full keyboard has a corresponding note grid.

[0026] In an extended embodiment, after the step of responding to the note grid selection event in the composition area, the following steps are included:

[0027] In response to a user's instruction to fill in a word, a word filling interface is triggered to be displayed;

[0028] In response to a lyrics submission event, the lyrics text inputted in the lyrics filling interface is obtained, and the lyrics text is segmented to construct a segmented text sequence;

[0029] Traversing and obtaining lyrics texts corresponding to each segmentation in the segmentation text sequence, and establishing a mapping relationship between the lyrics texts and melody construction information corresponding to each note grid in the note grid sequence, wherein the note grid sequence includes each note grid and its corresponding melody construction information;

[0030] According to the mapping relationship, the lyrics text corresponding to each word segment is updated correspondingly with the lyrics text in the note grid.

[0031] A musical keyboard interaction device adapted to one of the purposes of the present application comprises: an interface loading module, a keyboard construction module, and a melody playing module, wherein the interface loading module is used to display a creation interface, wherein the creation interface comprises a composition area and a musical keyboard, wherein the composition area comprises a plurality of note grids divided according to the dimensions of rhythm and scale, wherein the musical keyboard is arranged at a position corresponding to the dimension of scale, and comprises a plurality of standard keys of fixed style, wherein each standard key is used to represent a corresponding note, wherein one standard key is used to represent the starting note in the scale; the keyboard construction module is used to determine the notes in the key corresponding to the key signature according to a preselected key signature, establish a sequential mapping relationship between each note in the key and each standard key in the musical keyboard, so that each standard key corresponds to each note in the key one-to-one, and the note in the key of the lowest scale is mapped to the standard key corresponding to the starting note; the melody playing module is used to respond to the note grid selection event in the composition area, play the note in the key corresponding to the note grid, play the animation effect of the standard key corresponding to the note in the key, and add the time information of the note in the key associated with the rhythm dimension corresponding to the note grid to the melody construction information.

[0032] In a further embodiment, the interface loading module includes: a horizontal placeholder determination submodule, used to determine the placeholder width of each note grid in the horizontal dimension of the composition area according to the melody rhythm corresponding to each note grid in the preset rhythm dimension information; a vertical placeholder determination submodule, used to determine the placeholder width of each note grid in the vertical dimension of the composition area according to the standard keys in the music keyboard corresponding to each note grid in the preset scale dimension information; a formatting and division submodule, used to render the edge auxiliary lines of the note grid according to the corresponding placeholder width of each note grid in the horizontal and vertical dimensions of the composition area, and format and divide the composition area.

[0033] In a further embodiment, the interface loading module includes: a key construction submodule, which is used to construct rectangular buttons of equal length and width according to a preset aspect ratio as standard keys in a music keyboard; a note identification submodule, which is used to identify the bottom-level standard key in the music keyboard as the starting note in the scale according to the scale dimension, and use it as a reference to identify the notes corresponding to other standard keys in the music keyboard according to the scale sequence.

[0034] In a further embodiment, the keyboard construction module includes: an accompaniment template submodule, which is used to display an accompaniment template list, the list contains multiple accompaniment templates, each accompaniment template includes a melody rhythm and a key signature; an accompaniment acquisition submodule, which is used to obtain a target accompaniment template selected by a user; and a note determination submodule, which is used to determine the corresponding note in the key according to the key signature in the target accompaniment template.

[0035] In a further embodiment, the keyboard construction module includes: a note identification submodule, which is used to establish a sequential mapping relationship between the notes within the key and the various standard keys in the music keyboard, and thereby identify the notes within the key corresponding to each standard key; an auxiliary line rendering submodule, which is used to draw the horizontal and vertical edge auxiliary lines of the corresponding note grids in the composition area according to the corresponding width of the standard keys in the scale dimension and the melody rhythm carried by the target accompaniment template, and render them to display the various note grids in the composition area under the key signature.

[0036] In an extended embodiment, after the melody playing module, it includes: a keyboard switching loading submodule, which is used to respond to a keyboard switching instruction, call a full keyboard pattern implemented according to a piano style, replace the music keyboard, and adjust the note grids in the composition area with the keys in the full keyboard pattern, so that each scale in the full keyboard has a corresponding note grid.

[0037] In an extended embodiment, after the melody playing module, it includes: an interface display submodule, which is used to trigger the display of the lyrics filling interface in response to the user's lyrics filling instruction; a word segmentation construction submodule, which is used to respond to the lyrics submission event, obtain the lyrics text input in the lyrics filling interface, and segment the lyrics text to construct a segmentation text sequence; a text mapping submodule, which is used to traverse and obtain the lyrics text corresponding to each segmentation in the segmentation text sequence, and establish a mapping relationship between these lyrics texts and the melody construction information corresponding to each note grid in the note grid sequence, wherein the note grid sequence contains each note grid and its corresponding melody construction information; a text update submodule, which is used to update the lyrics text in the note grid with the lyrics text corresponding to each segmentation according to the mapping relationship.

[0038] A computer device provided to meet one of the purposes of the present application includes a central processing unit and a memory, wherein the central processing unit is used to call and run a computer program stored in the memory to execute the steps of the music keyboard interaction method described in the present application.

[0039] A computer-readable storage medium is provided for the purpose of the present application, which stores a computer program implemented according to the music keyboard interaction method in the form of computer-readable instructions. When the computer program is called and executed by a computer, the steps included in the method are executed.

[0040] Compared with the prior art, the advantages of this application are as follows:

[0041] First of all, the present application keeps the style of the music keyboard fixed, and when the major key changes, the corresponding notes in the major key are mapped to the standard keys of the fixed-style music keyboard, so that users do not need to adapt to the changes in the major key, and can operate the various standard keys on the fixed music keyboard to compose music, thereby lowering the technical threshold for non-professional users to implement song creation and improving the user experience.

[0042] Secondly, since the standard keys provided by the music keyboard only include a few notes within the range of intervals corresponding to the major key, the density of selectable notes within the limited interval is reduced, which has the associated impact that the display effect of the note grids in the composition area of ​​the graphical user interface is more sparse, making it convenient for users to accurately select the note grids corresponding to the notes within the key when composing songs. In addition, due to the reduction in the density of the note grids, the terminal device can display melody content with a larger duration range within the limited interface space, enriching the display of melody information within the limited display space, and improving the efficiency of human-computer interaction.

[0043] In addition, when the user selects a note grid, the present application prompts the user of the selected note by playing the animation effect of the corresponding standard key, providing more impactful visual feedback, playing a better prompting role, and helping to improve the efficiency of song creation. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0045] Figure 1 A schematic diagram of a typical network deployment architecture related to implementing the technical solution of this application;

[0046] Figure 2 A flowchart of a typical embodiment of the music keyboard interaction method of the present application;

[0047] Figure 3 , Figure 4 Schematic diagram of the graphical user interface of the terminal device in the embodiment of the present application, respectively illustrating the creation interface corresponding to the music keyboard with standard keys and the creation interface corresponding to the music keyboard with full piano keys;

[0048] Figure 5 A schematic diagram of the process of formatting and dividing the composition area in an embodiment of the present application;

[0049] Figure 6 A schematic diagram of a process for constructing a music keyboard in an embodiment of the present application;

[0050] Figure 7 A schematic diagram of a process of loading a user-selected accompaniment in an embodiment of the present application;

[0051] Figure 8 A schematic diagram of a process of drawing a composition area according to musical keyboard mark notes in an embodiment of the present application;

[0052] Fig. 9 A schematic diagram of the process of switching the music keyboard in an embodiment of the present application;

[0053] Fig.10 A schematic diagram of a process of loading lyrics text edited by a user in an embodiment of the present application;

[0054] Fig.11 This is a principle block diagram of the music keyboard interaction device of the present application;

[0055] Fig.12 A schematic diagram of the structure of a computer device used in this application. DETAILED DESCRIPTION

[0056] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, and cannot be interpreted as limiting the present application.

[0057] It will be understood by those skilled in the art that, unless expressly stated, the singular forms "one", "said", and "the" used herein may also include plural forms. It should be further understood that the term "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof. It should be understood that when we refer to an element as being "connected" or "coupled" to another element, it may be directly connected or coupled to the other element, or there may be an intermediate element. In addition, the "connection" or "coupling" used herein may include wireless connection or wireless coupling. The term "and / or" used herein includes all or any unit and all combinations of one or more associated listed items.

[0058] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by those skilled in the art to which this application belongs. It should also be understood that terms such as those defined in general dictionaries should be understood to have meanings consistent with those in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless specifically defined as here.

[0059] It will be understood by those skilled in the art that the "client", "terminal" and "terminal device" used herein include both devices with wireless signal receivers, which are devices with only wireless signal receivers without transmission capabilities, and devices with receiving and transmitting hardware, which are devices with receiving and transmitting hardware capable of two-way communication on a two-way communication link. Such devices may include: cellular or other communication devices such as personal computers, tablet computers, which have single-line displays or multi-line displays or cellular or other communication devices without multi-line displays; PCS (Personal Communications Service, personal communication system), which can combine voice, data processing, fax and / or data communication capabilities; PDA (Personal Digital Assistant, personal digital assistant), which may include a radio frequency receiver, pager, Internet / intranet access, web browser, notepad, calendar and / or GPS (Global Positioning System, global positioning system) receiver; conventional laptop and / or palmtop computers or other devices, which have and / or include a conventional laptop and / or palmtop computer or other device with and / or including a radio frequency receiver. The "client", "terminal" and "terminal device" used herein may be portable, transportable, installed in a vehicle (air, sea and / or land), or suitable for and / or configured to run locally, and / or in a distributed form, at any other location on the earth and / or in space. The "client", "terminal" and "terminal device" used herein may also be a communication terminal, an Internet terminal, a music / video playing terminal, for example, a PDA, a MID (Mobile Internet Device) and / or a mobile phone with a music / video playing function, or a smart TV, a set-top box and other devices.

[0060] The hardware referred to by the names such as "server", "client", and "service node" in this application is essentially an electronic device with the equivalent capabilities of a personal computer. It is a hardware device with the necessary components revealed by the von Neumann principle, such as a central processing unit (including an arithmetic unit and a controller), a memory, an input device, and an output device. The computer program is stored in its memory, and the central processing unit calls the program stored in the external memory into the internal memory for execution, executes the instructions in the program, and interacts with the input and output devices to complete specific functions.

[0061] It should be pointed out that the concept of "server" referred to in this application can also be extended to the case of server clusters. According to the network deployment principle understood by those skilled in the art, the servers should be logically divided. In physical space, these servers can be independent of each other but can be called through interfaces, or integrated into a physical computer or a set of computer clusters. Those skilled in the art should understand this flexibility, and should not use it to restrict the implementation of the network deployment method of this application.

[0062] See also Figure 1 , the hardware foundation required for the implementation of the relevant technical solutions of this application can be deployed according to the architecture shown in the figure. The server 80 referred to in this application is deployed in the cloud. As a business server, it can be responsible for further connecting relevant data servers and other servers that provide relevant support, etc., so as to form a logically related service cluster to provide services for related terminal devices such as the smartphone 81 and personal computer 82 shown in the figure or a third-party server (not shown). The smartphone and personal computer can access the Internet through a well-known network access method and establish a data communication link with the server 80 in the cloud to run terminal applications related to the services provided by the server.

[0063] For the server, the application is usually constructed as a service process, opening the corresponding program interface for remote calls by applications running on various terminal devices. The relevant technical solutions suitable for running on the server in this application can be implemented in the server in this way.

[0064] The application described herein refers to an application running on a server or terminal device. This application implements the relevant technical solutions of the present application in a programming manner. Its program code can be stored in a non-volatile storage medium recognizable by a computer in the form of computer executable instructions, and can be loaded into the memory by the central processing unit for execution. The relevant device of the present application is constructed by the operation of the application on the computer.

[0065] Unless expressly specified, one or more technical features of the present application can be deployed on a server for implementation and accessed by a client through a remote call to obtain an online service interface provided by the server, or can be directly deployed and run on a client for access.

[0066] Unless explicitly specified, the various data involved in this application can be stored remotely on a server or on a local terminal device, as long as it is suitable for being called by the technical solution of this application.

[0067] Those skilled in the art should be aware that, although the various methods of the present application are described based on the same concept and thus present commonality to each other, unless otherwise specified, these methods can be independently executed. Similarly, for each embodiment disclosed in the present application, they are all proposed based on the same inventive concept, therefore, concepts with the same expression, and concepts that are appropriately changed for convenience despite different expressions, should be understood as equivalent.

[0068] Unless the mutually exclusive relationship between the embodiments to be disclosed in this application is explicitly stated, the relevant technical features involved in each embodiment can be cross-combined to flexibly construct a new embodiment, as long as such combination does not deviate from the creative spirit of this application and can meet the needs of the prior art or solve certain deficiencies in the prior art. Those skilled in the art should be aware of this flexibility.

[0069] See also Figure 2 The music keyboard interaction method of the present application, in its typical embodiment, comprises the following steps:

[0070] Step S1100, displaying a creation interface, wherein the creation interface includes a composition area and a music keyboard, wherein the composition area includes a plurality of note grids divided according to rhythm and scale dimensions, wherein the music keyboard is arranged at a position corresponding to the scale dimension and includes a plurality of standard keys of a fixed style, wherein each standard key is used to represent a corresponding note, wherein one standard key is used to represent a starting note in the scale;

[0071] The creation interface is presented in a graphical user interface of the client, wherein the composition area in the creation interface is displayed in a two-dimensional plane, and the vertical dimension of the composition area is expanded as a scale dimension, displaying each pitch in the scale, starting from the tonic and ending with the tonic, ascending from low to high, or descending from high to low, arranged in a stepped manner, and the scale can be a natural seven-tone scale, and its interval organization is that there are 5 whole tones in each octave, divided into two strings and three strings, and the two strings are separated by a semitone, which is equivalent to the natural major scale (whole-whole-half-whole-whole-half), and each pitch in the scale can act as the tonic to establish a mode, and 7 different seven-tone natural modes can be formed. The horizontal dimension of the composition area is unfolded as a rhythm dimension, and the time value area corresponding to each note in the music melody is displayed in chronological order. Specifically, the time value area corresponding to each note in each beat of each measure is displayed according to the beat. The beat includes 4 / 4, 8 / 8, 16 / 16, 32 / 32, 64 / 64, 128 / 128, etc., where the former represents the number of measures and the latter represents the note corresponding to each beat in each measure. The exemplary example 4 / 4 is a quarter note as one beat, and four beats per measure. Therefore, according to the horizontal dimension and vertical dimension structure of the composition area, the auxiliary lines can be used to format the entire composition area into a grid style, and each grid in the composition area of ​​the grid style corresponds to a note, and the grid in the composition area is used as a note grid.

[0072] In one embodiment, the beat of the rhythm dimension of the composition area can be adjusted to meet the needs of the created music melody. The exemplary examples of the beat setting are: such as modifying the beat of the global editing environment corresponding to the music melody from 4 / 4 to 8 / 8, setting the 4 beats corresponding to a certain measure to 8 beats based on the 4 / 4 beat of the global editing environment corresponding to the music melody, deleting a certain measure in the music melody, and inserting one or more measures in the music melody based on the 4 / 4 beat of the global editing environment corresponding to the music melody, and the measure corresponds to 4 beats. Further, the composition area is reloaded accordingly by obtaining the beat setting, so that the user can intuitively understand the duration of each note of the music melody from the visualized composition area, which helps to understand the melody rhythm and is more convenient for users to create music.

[0073] The music keyboard is arranged on the scale dimension side of the composition area, and the music keyboard includes a plurality of standard keys with fixed styles, each standard key correspondingly representing a note (pitch class) in the scale corresponding to the music keyboard, and the pitch order of the notes corresponding to the scale dimension is taken from low to high as the pitch order of the notes corresponding to the standard keys of the music keyboard. Thus, the standard key with the lowest pitch of the corresponding note in the music keyboard is determined, and the corresponding note is set as the starting note in the scale corresponding to the music keyboard. The standard keys are a plurality of keys with the same piano key style, and the style of the standard keys can also be pre-stored as a candidate style, and a user can select and update the fixed style of the standard keys by providing an optional sample list, and the starting note is the lowest note in the corresponding scale, such as the scale is C major, and the starting note is DO, the lowest note in C major.

[0074] Step S1200, determining the notes in the key corresponding to the preselected key signature, establishing a sequential mapping relationship between each note in the key and each standard key in the music keyboard, so that each standard key corresponds to each note in the key one by one, and mapping the lowest scale note in the key to the standard key corresponding to the starting note;

[0075] The key signature includes C major, G major, E major, B major (C flat major), D major, A major, F sharp major (G flat major), F major, B flat major, E flat major, A flat major, D flat major (C sharp major), and the major key is based on the system of twelve equal temperaments, starting from any semitone (DO, #DO, RE, #RE, MI, FA, #FA, SOL, #SOL, LA, #LA, SI), and making a new major key according to the rhythmic interval arrangement order of the major key, and the rhythmic interval arrangement order is whole whole half, and whole whole whole half. The notes in the key are the notes corresponding to the key signature, such as the key signature is C major, and the corresponding notes in the key are DO, RE, MI, FA, SOL, LA, SI.

[0076] According to the pitch sequence of the notes corresponding to each standard key of the music keyboard, the standard key with the lowest pitch corresponding to the note in the music keyboard is determined, and further, according to the pitch sequence of the notes within the key corresponding to the key signature, it is determined that the lowest pitch note within the key is mapped to the standard key, and based on the standard key and the notes within the key, the corresponding standard keys and notes within the key are obtained in turn according to the pitch sequence of the notes corresponding to the standard keys and the sequence of the notes within the key, and a one-to-one mapping relationship is established between them. Thus, according to the mapping relationship between the standard keys and the notes within the key, the note within the key is set as the identifier of the note corresponding to the standard key, and it is presented on each standard key of the music keyboard in the creation interface, such as Figure 3 As shown in Figure 105.

[0077] Therefore, in the creation interface, the music keyboard is fixed and provides a limited number of standard keys. The number of standard keys usually depends on the notes within the key corresponding to the pre-selected key signature, which is usually not more than eight. Therefore, the music keyboard is more concise in the interface, and because each standard key is only used to represent the notes within the key, other notes not related to the notes within the key are not displayed, making the standard keys displayed by the music keyboard more streamlined. Within the same interval range, fewer standard keys are included. In the composition area of ​​the creation interface, the density of the note grid becomes sparser. When the interface is displayed on a small-screen terminal device such as a mobile phone, the clarity is higher and it is easier to operate the note grid.

[0078] Since the notes within the key depend on the pre-selected major, and the pitch representation of the music keyboard does not change, it is only necessary to remap the notes within the key corresponding to the major key to the standard keys of the music keyboard as the major key changes, so that the standard key where the starting note in the music keyboard is located is mapped corresponding to the lowest scale of the notes within the key, and the remaining standard keys are also mapped one by one to the remaining notes within the key in sequence. Therefore, no matter how the major key changes, the display content of the music keyboard remains unchanged, achieving the effect of a fixed style. For users, there is no need to reapply the layout of the music keyboard or consider the changes caused by the major key to compose music, which makes it more convenient for non-professional users to compose melodies, reduces the technical threshold for music creation, and greatly improves the user experience of such users.

[0079] Step S1300, in response to the note grid selection event in the composition area, play the note in the key corresponding to the note grid, play the animation effect of the standard key corresponding to the note in the key, and add the time information of the rhythm dimension corresponding to the note grid associated with the note in the key to the melody construction information.

[0080] The note grid selection event refers to an event in which a user selects a corresponding note grid when creating a music melody in the composition area. The corresponding note grid selection includes selecting multiple note grids of consecutive beats of a note in the same key from the composition area each time or selecting any note grid from the composition area each time. Figure 3 As shown in 102, the selection can be performed multiple times. The client responds to the note grid selection event, determines that the selected note grid in the event corresponds to the standard key in the music keyboard, and determines the note in the key corresponding to the standard key through the mapping relationship between the note in the key and the standard key, so as to play the animation effect corresponding to the note in the key and the standard key. In one embodiment, the animation effect is to display a red layer with a transparency of 80% on the standard key corresponding to the selected note grid in the graphical user interface. Figure 3As shown in 104, in order to achieve a highlighting effect, it is convenient for users to know how to quickly locate the standard key corresponding to the selected note grid to determine the in-key note marked thereon. The animation effect can be flexibly set by technical personnel in this field according to actual business scenarios. Further, according to the tempo and beat set in the composition area, the time value occupied by the note grid in the rhythm dimension, that is, the time information, is calculated, and the in-key note corresponding to the selected note grid and the time information are added to the melody construction information. The tempo is the number of beats per minute, and the single beat time can be calculated.

[0081] Through the disclosure of this typical embodiment, it can be seen that the present application has many positive advantages, including but not limited to the following aspects:

[0082] First of all, the present application keeps the style of the music keyboard fixed, and when the major key changes, the corresponding notes in the major key are mapped to the standard keys of the fixed-style music keyboard, so that users do not need to adapt to the changes in the major key, and can operate the various standard keys on the fixed music keyboard to compose music, thereby lowering the technical threshold for non-professional users to implement song creation and improving the user experience.

[0083] Secondly, since the standard keys provided by the music keyboard only include a few notes within the range of intervals corresponding to the major key, the density of selectable notes within the limited interval is reduced, which has the associated impact that the display effect of the note grids in the composition area of ​​the graphical user interface is more sparse, making it convenient for users to accurately select the note grids corresponding to the notes within the key when composing songs. In addition, due to the reduction in the density of the note grids, the terminal device can display melody content with a larger duration range within the limited interface space, enriching the display of melody information within the limited display space, and improving the efficiency of human-computer interaction.

[0084] In addition, when the user selects a note grid, the present application prompts the user of the selected note by playing the animation effect of the corresponding standard key, providing more impactful visual feedback, playing a better prompting role, and helping to improve the efficiency of song creation.

[0085] See also Figure 5 In a further embodiment, the step S1100, the step of displaying the creation interface, includes the following steps:

[0086] Step S1110, determining the place width of each note grid in the horizontal dimension of the composition area according to the melody rhythm corresponding to each note grid in the preset rhythm dimension information;

[0087] The preset rhythm dimension information includes the beat and tempo corresponding to each note grid. The time value corresponding to each note grid, i.e., the melody rhythm, can be calculated based on the beat and tempo. Thus, the time value corresponding to each note is used as its placeholder width in the horizontal dimension of the composition area.

[0088] The preset rhythm dimension information can be set by the user in advance in the rhythm area of ​​the creation interface before the user creates the melody. Figure 3 As shown in 100, it mainly includes beat and speed settings. Secondly, the user can also use the melody rhythm related settings of the client default configuration, which mainly includes 4 / 4 beat and 90 speed.

[0089] Step S1120, determining the place width of each note grid in the vertical dimension of the composition area according to the standard keys in the music keyboard corresponding to each note grid in the preset scale dimension information;

[0090] The preset scale dimension information includes the standard keys in the music keyboard corresponding to each note grid and the notes in the key associated with the standard key mapping, and the width of the standard keys corresponding to each note grid, i.e., the rectangular strip style of the piano keys, is used as the placeholder width of the note grid in the vertical dimension of the composition area, and each note grid is mapped and associated with its corresponding standard key, so as to subsequently determine the standard key corresponding to the note grid and the notes in the key associated with the standard key mapping.

[0091] The preset scale dimension information can be set by the user in advance at the key signature setting entry of the music keyboard area of ​​the creation interface before creating the melody. The key signature setting entry is as follows: Figure 3 As shown in 101, the client receives the user's key signature selection instruction and determines the note in the key corresponding to the key signature selected by the user, and associates the corresponding mapping of the called note with the standard keys in the music keyboard area. Secondly, the user can also use the music keyboard composed of the corresponding standard keys of the key signature configured by the client and the key notes corresponding to the key signature. The default configured key signature is C major, and its corresponding notes in the key are DO, RE, MI, FA, SOL, LA, SI.

[0092] Step S1130, rendering edge auxiliary lines of the note grids according to the corresponding placeholder widths of each note grid in the horizontal and vertical dimensions of the composition area, and formatting and dividing the composition area.

[0093] According to the corresponding occupied widths of each note grid in the horizontal and vertical dimensions of the composition area, edge auxiliary lines are rendered to format and divide each note grid in the composition area, so that each note grid corresponds to a standard key in a music keyboard in the music rhythm dimension of the composition area, and is unfolded in chronological order in the music rhythm dimension of the composition area, such as Figure 3 As shown in Figure 103.

[0094] In this embodiment, the note grids are divided by auxiliary lines in the formatted composition area, and the rhythm and pitch corresponding to each note grid are clearly displayed, which is convenient for users to create. In addition, since the style of the music keyboard is fixed, the number of standard keys is fixed and adaptive major changes, the number of standard keys within a limited range of pitch is simplified and reduced, and correspondingly the note grids divided according to the standard keyboard are also larger. Compared with the existing technology, the density is lower when displayed on a limited screen, which is convenient for users to identify and reduces accidental touches.

[0095] See also Figure 6 In a further embodiment, the step S1100, the step of displaying the creation interface, includes the following steps:

[0096] Step S1111: constructing rectangular buttons of equal length and width according to a preset aspect ratio as standard keys in a music keyboard;

[0097] In one embodiment, analogous to the aspect ratio of the white keys of a piano, rectangular buttons of equal length and width of uniform size and style are constructed with a preset aspect ratio of 15:2.2 as the standard keys in the music keyboard. The aspect ratio can be flexibly set by technical personnel in this field as needed.

[0098] Step S1112: Identify the lowest standard key in the music keyboard as the starting note in the scale based on the scale dimension, and use it as a reference to identify the notes corresponding to other standard keys in the music keyboard according to the scale sequence.

[0099] The pitch sequence of the notes corresponding to the scale dimension is used as the pitch sequence of the notes corresponding to the standard keys of the music keyboard, so that the corresponding standard keys are sorted in order from low to high with the pitch of the note to construct a key array, the standard key with the lowest pitch corresponding to the note in the key array, that is, the standard key at the bottom level, is determined, and the note sequence is traversed to obtain the note with the lowest pitch, that is, the starting note. Thus, the starting note can be used as the identifier of the standard key at the bottom level. Further, the array subscript of the key array corresponding to the standard key at the bottom level and the sequence subscript of the scale sequence corresponding to the starting note are determined as a reference. The reference subscript is moved in step of one, and the corresponding standard keys and notes are sequentially obtained from the key array and the scale sequence, and the note is used as the identifier of the standard key. The scale sequence is a sequence constructed by the notes in the key corresponding to the pitch sequence from low to high, and the notes in the key are the notes in the major key selected by the user to create the music melody.

[0100] The number of standard keys in the music keyboard is 7. Figure 3 As shown in 105, the number of the standard keys can be flexibly set by those skilled in the art as needed. The corresponding mapping of each standard key is associated with seven basic pitches corresponding to an octave of a major key, i.e., the notes within the key. The key signature setting entry in the touch-sensitive music keyboard area can be used to select the key signature and the octaves corresponding to the key signature. The key signature setting entry is as shown in FIG. Figure 3 101 in the figure includes twelve major key settings and octave settings of the same major key. For example, if the key signature is C major, the seven standard keys are mapped to the notes DO, RE, MI, FA, SOL, LA, and SI in the key of C major. Similarly, when the key signature is D, E, F, etc., the mapping of standard keys and the notes in the key of major can also be achieved. Those skilled in the art can understand that the standard key style of the composition interface is identified as DO, RE, MI, FA, SOL, LA, and SI, but the notes in the key of the corresponding major can be obtained through the mapping relationship. For example, if the key signature is D, the standard key mapping representing DO is associated with the note in the key of D major, which is equivalent to Re in C major. In this way, a music keyboard with a unified style that is adaptive to each major key is achieved, which is convenient for non-professional users to create melodies.

[0101] In this embodiment, by constructing a music keyboard with a unified style, the visualized standard keys still maintain the same fixed style when the major key changes, thereby lowering the technical threshold for non-professional users to create songs and improving the user experience.

[0102] See also Figure 7 In a further embodiment, the step S1200, determining the notes in the key corresponding to the key signature according to the pre-selected key signature, comprises the following steps:

[0103] Step S1210, displaying an accompaniment template list, the list comprising a plurality of accompaniment templates, each accompaniment template comprising a melody rhythm and a key signature;

[0104] The user touches the accompaniment control in the creation interface, the client generates an accompaniment selection request, pushes the request to the server, downloads multiple accompaniment templates issued by the server in response to the accompaniment template acquisition event, and constructs these accompaniment templates into a list, i.e., the accompaniment template list is displayed on the creation interface.

[0105] The accompaniment template is compiled by chord progression and is marked with corresponding key signatures and melody rhythm information. The melody rhythm information is used to indicate rhythm dimension information such as beat, tempo, and time value of each note grid in the composition area, and the key signature is used to indicate scale dimension information such as major, pitch, and pitch of each note grid in the composition area.

[0106] Step S1220, obtaining the target accompaniment template selected by the user;

[0107] The client receives a user selection instruction and determines a target accompaniment template from the accompaniment template list. The user selection instruction means that after the user determines an accompaniment template, he can touch the "Use" control to select the candidate accompaniment template, determine it as the target accompaniment template, generate a request to obtain the target accompaniment template, and send the request to the server to download and obtain the target accompaniment template.

[0108] The accompaniment template list is a list formed by the client periodically sending a request for obtaining the latest accompaniment template to the server, obtaining the text identifiers of the latest accompaniment templates, and arranging them in a certain order.

[0109] Step S1230: Determine the corresponding notes in the key according to the key signature in the target accompaniment template.

[0110] The target accompaniment template includes a key signature, and the corresponding notes in the key can be obtained according to the key signature. For example, if the key signature is C major, the corresponding notes in the key are DO, RE, MI, FA, SOL, LA, and SI.

[0111] In this embodiment, multiple accompaniment templates are provided for users to choose from, and the accompaniment templates are prepared in advance for users to select as needed, which further improves the convenience of users in creating musical works and helps to improve the efficiency of auxiliary creation.

[0112] See also Figure 8 In a further embodiment, the step S1230, establishing a sequential mapping relationship between each note in the key and each standard key in the music keyboard, comprises the following steps:

[0113] Step S1240: establishing a sequential mapping relationship between the notes in the key and each standard key in the music keyboard, and thereby identifying the notes in the key corresponding to each standard key;

[0114] For specific implementation, please refer to step S1200.

[0115] Step S1250, based on the width of the standard keys corresponding to the scale dimension and the melody rhythm carried by the target accompaniment template, draw the horizontal and vertical edge auxiliary lines of the corresponding note grids in the composition area, and render them to display the various note grids in the composition area under the key signature.

[0116] The vertical width corresponding to the standard key in the scale dimension is used as the width of the note grid in the vertical dimension of the composition area, and the duration is calculated using the melody rhythm including beats and tempo carried by the target accompaniment template as the width of the note grid in the horizontal dimension of the composition area. Thus, horizontal and vertical edge auxiliary lines of the composition area are drawn and rendered to format and divide the various note grids in the composition area under the key signature.

[0117] In this embodiment, the division of the note grids of the composition area is reloaded according to the melody rhythm corresponding to the target accompaniment template selected by the user, so as to facilitate the user to further create on this target accompaniment template.

[0118] See also Fig. 9 In an extended embodiment, after the step S1300, the step of responding to the note grid selection event in the composition area, the following steps are included:

[0119] Step S1400, responding to the keyboard switching instruction, calling the full keyboard pattern implemented according to the piano style, replacing the music keyboard, and adjusting the note grids in the composition area with the keys in the full keyboard pattern, so that each scale in the full keyboard has a corresponding note grid.

[0120] In response to the keyboard switching instruction, the music keyboard switching style is determined to be a full keyboard style, the full keyboard pattern implemented according to the piano style is called, and the full keyboard music keyboard is responsively constructed according to the aspect ratio of the white keys and the black keys in the full keyboard pattern. Figure 4 As shown in 200, the music keyboard constructed by replacing the marked keys is replaced, and the width of each key in the full keyboard music keyboard is used as the vertical proportion width of the note grid in the composition area, and the division of each note grid in the vertical dimension of the composition area is reloaded with the vertical proportion width, so that each scale corresponding to each key in the full keyboard music keyboard has a corresponding note grid. Figure 4 As shown in 201.

[0121] This embodiment allows the user to set the music keyboard as a full keyboard as needed, so as to facilitate the selection of notes within the key corresponding to the standard keys and note grids corresponding to notes outside the key, so that the user can obtain more comprehensive music auxiliary creation functions, so that the music auxiliary creation software is compatible with both efficient and simple auxiliary creation methods and rich and comprehensive auxiliary creation means.

[0122] See also Fig.10 In an extended embodiment, after the step S1300, the step of responding to the note grid selection event in the composition area, the following steps are included:

[0123] Step S1401, triggering the display of a lyrics filling interface in response to a user's lyrics filling instruction;

[0124] Touching a lyrics filling control in the function selection area of ​​the composition area triggers the lyrics filling instruction, thereby displaying the lyrics filling interface for receiving the input of lyrics text. Of course, other more convenient ways of setting the entry for triggering the user's lyrics filling instruction can also be adopted, as long as the lyrics filling interface can be entered through a certain entry. Those skilled in the art can flexibly change the settings without affecting the implementation of this application.

[0125] Step S1402, in response to the lyrics submission event, obtaining the lyrics text input in the lyrics filling interface, and performing word segmentation on the lyrics text to construct a word segmentation text sequence;

[0126] Lyrics text such as Chinese characters, ligatures, and regular punctuation marks can be input in the lyrics filling interface. The ligatures represent continuous transitions between the lyrics corresponding to the upper and lower note grids. After completing the input, touch the confirmation control provided in the lyrics filling interface to trigger a corresponding lyrics submission event, obtain the lyrics text input by the user in the lyrics filling interface, call the character slicing method to segment the lyrics text one by one to obtain multiple single characters, and construct them into the segmented text sequence.

[0127] Step S1403, traversing and acquiring lyrics texts corresponding to each segmentation in the segmentation text sequence, and establishing a mapping relationship between the lyrics texts and melody construction information corresponding to each note grid in the note grid sequence, wherein the note grid sequence includes each note grid and its corresponding melody construction information;

[0128] The lyrics text corresponding to each word in the word segmentation text sequence, i.e., the single character, is traversed and the beat and duration in the composition area corresponding to each note grid in the note grid sequence, i.e., the melody construction information, is traversed, and a mapping relationship is correspondingly established between each single character and the duration corresponding to each note grid.

[0129] The melody structure information is the placeholder information and duration information of the note cells selected by the user. The placeholder information is the measure to which the note cell belongs in the composition area and the beats corresponding to that measure, such as the second beat of the third measure to the second beat of the fourth measure, the second beat of the first measure, etc. The duration information is the duration information corresponding to the note cell calculated according to the tempo and rhythm.

[0130] Step S1404: Update the lyric text in the note cells corresponding to the lyric texts of the respective word segments according to the mapping relationship.

[0131] Generally speaking, the lyrics input by the user in the lyric filling interface usually comply with the constraints of the lyric prompt information. Therefore, after obtaining the lyric text input by the user from the editing area, generally, the existing lyric text in the note cells is replaced correspondingly. Thus, if the user only modifies the single-sentence text of individual lyric sentences, only the corresponding single-sentence text in the stored lyric cache area needs to be replaced. The lyric text input by the user can also be generated by means of artificial intelligence, including the recommended text obtained by the user through searching or associating using the artificial intelligence interface based on deep semantic learning, and all can be used as the lyric text required by this application.

[0132] Specifically, according to the melody structure information of the note cells mapped and associated with the single characters corresponding to the word segments in the word segment text sequence, determine the note cells pointed to in the composition area, and update the lyric text in the note cells to the lyric text corresponding to the single character.

[0133] Specifically, according to the melody rhythm information of the note cells, point to the note cells selected by the user in the composition area, and thus replace and update the lyric text of the corresponding word segment, that is, the single character, according to the mapping relationship to the original lyric text set in the note cells. The original lyric text is the lyric text default-configured for each note cell after it is selected by the user. The lyric text is the single character "la", and this configuration can be flexibly set by those skilled in the art as needed.

[0134] In this embodiment, user-defined lyric editing is provided to implement the integrated operation of lyric writing and composition. Moreover, the note cells within the effective screen space range are relatively large, facilitating the user to identify and edit the lyrics of each note cell and improving the human-computer interaction efficiency.

[0135] Please refer to Fig.11The present application provides a music keyboard interaction device, which is adapted to the functional deployment of the music keyboard interaction method of the present application, including: an interface loading module 1100, a keyboard construction module 1200, and a melody playing module 1300, wherein the interface loading module 1100 is used to display a creation interface, the creation interface includes a composition area and a music keyboard, the composition area includes a plurality of note grids divided according to rhythm and scale dimensions, the music keyboard is arranged at a position corresponding to the scale dimension, and includes a plurality of standard keys with fixed styles, each standard key is used to represent a corresponding note, and one standard key is used to represent the starting note in the scale; key The disk construction module 1200 is used to determine the notes within the key corresponding to the pre-selected key signature, establish a sequential mapping relationship between each note within the key and each standard key in the music keyboard, so that each standard key corresponds to each note within the key one by one, and the lowest scale note within the key is mapped to the standard key corresponding to the starting note; the melody playing module 1300 is used to respond to the note grid selection event in the composition area, play the note within the key corresponding to the note grid, play the animation effect of the standard key corresponding to the note within the key, and add the time information of the rhythm dimension of the note within the key associated with the note grid to the melody construction information.

[0136] In a further embodiment, the interface loading module 1100 includes: a horizontal placeholder determination submodule, used to determine the placeholder width of each note grid in the horizontal dimension of the composition area according to the melody rhythm corresponding to each note grid in the preset rhythm dimension information; a vertical placeholder determination submodule, used to determine the placeholder width of each note grid in the vertical dimension of the composition area according to the standard keys in the music keyboard corresponding to each note grid in the preset scale dimension information; a formatting and division submodule, used to render the edge auxiliary lines of the note grid according to the corresponding placeholder width of each note grid in the horizontal and vertical dimensions of the composition area, and format and divide the composition area.

[0137] In a further embodiment, the interface loading module 1100 includes: a key construction submodule, which is used to construct rectangular buttons of equal length and width according to a preset aspect ratio as standard keys in a music keyboard; a note identification submodule, which is used to identify the bottom-level standard keys in the music keyboard as the starting notes in the scale according to the scale dimension, and use it as a reference to identify the notes corresponding to other standard keys in the music keyboard according to the scale sequence.

[0138] In a further embodiment, the keyboard construction module 1200 includes: an accompaniment template submodule, used to display an accompaniment template list, the list contains multiple accompaniment templates, each accompaniment template includes a melody rhythm and a key signature; an accompaniment acquisition submodule, used to obtain a target accompaniment template selected by a user; and a note determination submodule, used to determine the corresponding notes in the key according to the key signature in the target accompaniment template.

[0139] In a further embodiment, the keyboard construction module 1200 includes: a note identification submodule, which is used to establish a sequential mapping relationship between the notes within the key and each standard key in the music keyboard, and thereby identify the notes within the key corresponding to each standard key; an auxiliary line rendering submodule, which is used to draw the horizontal and vertical edge auxiliary lines of the corresponding note grids in the composition area according to the corresponding width of the standard keys in the scale dimension and the melody rhythm carried by the target accompaniment template, and render it to display the various note grids in the composition area under the key signature.

[0140] In an extended embodiment, after the melody playing module 1300, it includes: a keyboard switching loading submodule, which is used to respond to a keyboard switching instruction, call a full keyboard pattern implemented according to a piano style, replace the music keyboard, and adjust the note grids in the composition area with the keys in the full keyboard pattern, so that each scale in the full keyboard has a corresponding note grid.

[0141] In an extended embodiment, after the melody playing module 1300, it includes: an interface display submodule, which is used to trigger the display of a lyrics filling interface in response to a user's lyrics filling instruction; a word segmentation construction submodule, which is used to respond to a lyrics submission event, obtain the lyrics text input in the lyrics filling interface, and perform word segmentation on the lyrics text to construct a word segmentation text sequence; a text mapping submodule, which is used to traverse and obtain the lyrics text corresponding to each word in the word segmentation text sequence, and establish a mapping relationship between these lyrics texts and the melody construction information corresponding to each note grid in the note grid sequence, wherein the note grid sequence contains each note grid and its corresponding melody construction information; a text update submodule, which is used to update the lyrics text in the note grid with the lyrics text corresponding to each word according to the mapping relationship.

[0142] A computer device provided to meet one of the purposes of the present application includes a central processing unit and a memory, wherein the central processing unit is used to call and run a computer program stored in the memory to execute the steps of the music keyboard interaction method described in the present application.

[0143] A computer-readable storage medium is provided for the purpose of the present application, which stores a computer program implemented according to the music keyboard interaction method in the form of computer-readable instructions. When the computer program is called and executed by a computer, the steps included in the method are executed.

[0144] In order to solve the above technical problems, the present application also provides a computer device. Fig.12As shown, a schematic diagram of the internal structure of a computer device. The computer device includes a processor, a computer-readable storage medium, a memory, and a network interface connected via a system bus. Among them, the computer-readable storage medium of the computer device stores an operating system, a database, and computer-readable instructions. The database may store a control information sequence. When the computer-readable instructions are executed by the processor, the processor can implement a music keyboard interaction method. The processor of the computer device is used to provide computing and control capabilities to support the operation of the entire computer device. The memory of the computer device may store computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor can execute the music keyboard interaction method of the present application. The network interface of the computer device is used to connect and communicate with a terminal. Those skilled in the art can understand that Fig.12 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0145] In this embodiment, the processor is used to execute Fig.11 The memory stores the program code and various data required to execute the above modules or submodules. The network interface is used to transmit data between user terminals or servers. The memory in this embodiment stores the program code and data required to execute all modules / submodules in the live gift resource update of this application, and the server can call the program code and data of the server to execute the functions of all submodules.

[0146] The present application also provides a storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the music keyboard interaction method of any embodiment of the present application.

[0147] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments of the present application can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the aforementioned storage medium can be a computer-readable storage medium such as a disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0148] To sum up, the present application visualizes the song melody creation interface and adopts a music keyboard composed of standard keys of a fixed style, which lowers the technical threshold for non-professional users to implement song creation and simplifies the number of standard keys, making the display effect of the note grids in the composition area of ​​the creation interface more sparse, thereby improving the recognition of each note grid, facilitating user editing, and improving user experience.

[0149] Those skilled in the art will appreciate that the various operations, methods, steps, measures, and schemes in the processes discussed in this application may be alternated, altered, combined, or deleted. Further, other steps, measures, and schemes in the various operations, methods, and processes discussed in this application may also be alternated, altered, rearranged, decomposed, combined, or deleted. Further, the steps, measures, and schemes in the prior art that are similar to those disclosed in this application may also be alternated, altered, rearranged, decomposed, combined, or deleted.

[0150] The above description is only a partial implementation method of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A music keyboard interaction method, characterized in that: The steps include: Displaying a creation interface, the creation interface comprising a composition area and a music keyboard, the composition area comprising a plurality of note grids divided according to rhythm and scale dimensions, the music keyboard being arranged at a position corresponding to the scale dimension and comprising a plurality of standard keys of a fixed pattern, each standard key being used to represent a corresponding note, wherein one standard key is used to represent a starting note in the scale; Determine the notes in the key corresponding to the preselected key signature, establish a sequential mapping relationship between each note in the key and each standard key in the music keyboard, so that each standard key corresponds to each note in the key one by one, and map the notes in the key with the lowest scale to the standard keys corresponding to the starting note, wherein the number of standard keys depends on the notes in the key corresponding to the preselected key signature; In response to a note grid selection event in the composition area, the note in the key corresponding to the note grid is played, the animation effect of the standard key corresponding to the note in the key is played, and the time information of the rhythm dimension corresponding to the note grid associated with the note in the key is added to the melody construction information.

2. The music keyboard interaction method according to claim 1, characterized in that: The steps of displaying the creation interface include the following steps: Determine the place width of each note grid in the horizontal dimension of the composition area according to the melody rhythm corresponding to each note grid in the preset rhythm dimension information; Determine the place width of each note grid in the vertical dimension of the composition area according to the standard keys in the music keyboard corresponding to each note grid in the preset scale dimension information; According to the corresponding occupied widths of the note grids in the horizontal and vertical dimensions of the composition area, edge auxiliary lines of the note grids are rendered to format and divide the composition area.

3. The music keyboard interaction method according to claim 1, characterized in that: The steps of displaying the creation interface include the following steps: Constructing rectangular buttons of equal length and width according to a preset aspect ratio as standard keys in a music keyboard; The lowest standard key in the music keyboard is identified as the starting note in the scale according to the scale dimension, and the notes corresponding to other standard keys in the music keyboard are identified based on the scale sequence.

4. The music keyboard interaction method according to claim 1, characterized in that: Determining the notes in a key corresponding to the key signature according to the pre-selected key signature comprises the following steps: Display the accompaniment template list, which contains multiple accompaniment templates, each of which includes melody rhythm and key signature; Get the target accompaniment template selected by the user; Determine the corresponding notes in the key according to the key signature in the target accompaniment template.

5. The music keyboard interaction method according to claim 4, characterized in that: Establishing a sequential mapping relationship between each note in a key and each standard key in a music keyboard includes the following steps: Establishing a sequential mapping relationship between the notes in the key and each standard key in the music keyboard, and thereby identifying the notes in the key corresponding to each standard key; According to the width of the standard keys corresponding to the scale dimension and the melody rhythm carried by the target accompaniment template, the horizontal and vertical edge auxiliary lines of the corresponding note grids in the composition area are drawn, and rendered to display the various note grids in the composition area under the key signature.

6. The music keyboard interaction method according to claim 1, characterized in that: After the step of responding to the note grid selection event in the composition area, the following steps are included: In response to the keyboard switching instruction, a full keyboard pattern implemented according to the piano style is called to replace the music keyboard, and the note grids in the composition area are adjusted with the keys in the full keyboard pattern so that each scale in the full keyboard has a corresponding note grid.

7. The music keyboard interaction method according to claim 1, characterized in that: After the step of responding to the note grid selection event in the composition area, the following steps are included: In response to a user's instruction to fill in a word, a word filling interface is triggered to be displayed; In response to a lyrics submission event, the lyrics text inputted in the lyrics filling interface is obtained, and the lyrics text is segmented to construct a segmented text sequence; Traversing and obtaining lyrics texts corresponding to each segmentation in the segmentation text sequence, and establishing a mapping relationship between the lyrics texts and melody construction information corresponding to each note grid in the note grid sequence, wherein the note grid sequence includes each note grid and its corresponding melody construction information; According to the mapping relationship, the lyrics text corresponding to each word segment is updated correspondingly with the lyrics text in the note grid.

8. A music keyboard interactive device, characterized in that: include: An interface loading module, used for displaying a creation interface, wherein the creation interface includes a composition area and a music keyboard, wherein the composition area includes a plurality of note grids divided according to the dimensions of rhythm and scale, wherein the music keyboard is arranged at a position corresponding to the dimensions of the scale and includes a plurality of standard keys of a fixed style, wherein each standard key is used to represent a corresponding note, wherein one standard key is used to represent a starting note in the scale; A keyboard construction module, for determining the notes in a key corresponding to the preselected key signature according to the preselected key signature, establishing a sequential mapping relationship between each note in a key and each standard key in a music keyboard, so that each standard key corresponds to each note in a key one by one, and mapping the notes in a key of the lowest scale to the standard keys corresponding to the starting note, wherein the number of standard keys depends on the notes in a key corresponding to the preselected key signature; A melody playing module is used to respond to a note grid selection event in the composition area, play the note in the key corresponding to the note grid, play the animation effect of the standard key corresponding to the note in the key, and add the time information of the rhythm dimension corresponding to the note grid associated with the note in the key to the melody construction information.

9. A computer device comprising a central processing unit and a memory, characterized in that: The central processing unit is used to call and run the computer program stored in the memory to execute the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: It stores a computer program implemented according to the method described in any one of claims 1 to 7 in the form of computer-readable instructions, and when the computer program is called and executed by a computer, the steps included in the corresponding method are executed.

Citation Information

Patent Citations

  • Song writing method and apparatus using touch screen in mobile terminal

    CN101668058A

  • Melody creation navigation method and device thereof, equipment, medium and product

    CN113539216A