MIDI music creation method and device based on graphical programming

Abstract

The invention discloses an MIDI (musical instrument digital interface) music creation method and device based on graphical programming. The method comprises the steps that graphic notes in an online music drawing board are obtained, and the graphic notes are generated through user interaction operation and comprise vector diagram information; the vector diagram of the graphic notes is converted into a note data matrix, and the note data matrix comprises position information and audio duration information of the graphic notes; and generating an audio file supporting reverse analysis to restore a creation state according to the note data matrix code. The technical problems that the creation process is disposable and cannot be traced back due to the lack of reversible edition of the output file in the existing MIDI music creation method, and the creation flexibility and the modification space of a user are seriously restricted are solved.

Description

Technical Field

[0001] The present invention relates to the field of computer music, and in particular, to a MIDI music creation method and apparatus based on graphical programming. Background Art

[0002] MIDI is the most widely used music standard format in the music arrangement field and can be called "sheet music that a computer can understand". It records music using digital control signals of musical notes. A complete MIDI music file is only dozens of KB in size and can contain dozens of music tracks. Almost all modern music is produced and synthesized using MIDI plus a sound library. MIDI transmits not sound signals, but instructions such as musical notes and control parameters, which indicate what a MIDI device should do and how to do it, such as which note to play and at what volume. They are uniformly represented as MIDI messages. However, in graphical programming, the MIDI music creation method lacks reversible editing of the output file, resulting in a one-time and non-retraceable creation process, which severely restricts the user's creation flexibility and modification space.

[0003] In view of the above problems, no effective solution has been proposed yet. Summary of the Invention

[0004] Embodiments of the present invention provide a MIDI music creation method and apparatus based on graphical programming to at least solve the technical problem that the existing MIDI music creation method lacks reversible editing of the output file, resulting in a one-time and non-retraceable creation process, which severely restricts the user's creation flexibility and modification space.

[0005] According to one aspect of the embodiments of the present invention, a MIDI music creation method based on graphical programming is provided, including: obtaining graphical musical notes in an online music scoreboard, where the graphical musical notes are generated through user interaction operations and include vector graph information; converting the vector graph of the graphical musical notes into a musical note data matrix, where the musical note data matrix includes position information and audio duration information of the graphical musical notes; and encoding an audio file that supports reverse parsing to restore the creation state according to the musical note data matrix.

[0006] According to another aspect of the embodiments of the present invention, there is also provided a MIDI music composition device based on graphical programming, including: an acquisition module configured to acquire graphical notes in an online music scoreboard, where the graphical notes are generated through user interaction operations and include vector graphic information; a conversion module configured to convert the vector graphics of the graphical notes into a note data matrix, where the note data matrix includes the position information and audio duration information of the graphical notes; and a generation module configured to encode and generate an audio file that supports reverse parsing to restore the creation state according to the note data matrix.

[0007] In the embodiments of the present invention, graphical notes in an online music scoreboard are acquired, where the graphical notes are generated through user interaction operations and include vector graphic information; the vector graphics of the graphical notes are converted into a note data matrix, where the note data matrix includes the position information and audio duration information of the graphical notes; and an audio file that supports reverse parsing to restore the creation state is encoded and generated according to the note data matrix. Through the above solution, the technical problem that the existing MIDI music composition method lacks reversible editing of the output file, resulting in a one-time and non-retraceable creation process, severely restricting the creation flexibility and modification space of users, is solved. Description of the Drawings

[0008] The drawings described herein are used to provide a further understanding of the present invention, form a part of this application, and the schematic embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation to the present invention. In the drawings:

[0009] Figure 1 is a flowchart of a MIDI music composition method based on graphical programming according to an embodiment of the present invention;

[0010] Figure 2 is a flowchart of an online MIDI music editing method according to an embodiment of the present invention;

[0011] Figure 3 is an online music scoreboard in an improvisation mode according to an embodiment of the present invention;

[0012] Figure 4 is an online music scoreboard in a score pattern according to an embodiment of the present invention;

[0013] Figure 5 is a diagram of musical instrument, accompaniment, beat, and mode selection according to an embodiment of the present invention;

[0014] Figure 6 is a diagram of block selection according to an embodiment of the present invention;

[0015] Figure 7It is a module diagram of a system for MIDI music composition based on graphical programming according to an embodiment of the present invention;

[0016] Figure 8 It is a flowchart of an operation method of a system for MIDI music composition based on graphical programming according to an embodiment of the present invention;

[0017] Figure 9 It is a schematic structural diagram of a device for MIDI music composition based on graphical programming according to an embodiment of the present invention;

[0018] Figure 10 It shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. Detailed implementation manners

[0019] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0020] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of the present invention described herein can be implemented in an order different from those illustrated or described herein. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units does not necessarily need to be limited to those steps or units clearly listed, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0021] According to an embodiment of the present invention, a method embodiment of a method for MIDI music composition based on graphical programming is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that here.

[0022] Figure 1 It is a method for MIDI music composition based on graphical programming according to an embodiment of the present invention. As Figure 1 shown, the method includes the following steps:

[0023] Step S102: Obtain the graphic notes in the online music scoreboard. The graphic notes are generated through user interaction operations and contain vector graphic information.

[0024] Provide a creation interface for the improvisation mode and / or the score chart mode in the online music scoreboard; in the improvisation mode, generate music segments by freely dragging the graphic notes; in the score chart mode, edit the graphic notes based on a preset music score template to generate structured music segments; wherein, the music segments include the graphic notes.

[0025] Step S104: Convert the vector graphics of the graphic notes into a note data matrix, where the note data matrix includes the position information and audio duration information of the graphic notes.

[0026] For example, extract the coordinate data in the vector graphics to generate an initial note position sequence; based on a preset time domain mapping rule, convert the coordinate data in the initial note position sequence into note duration information; integrate the coordinate data and the note duration information into the note data matrix.

[0027] Step S106: Generate an audio file that supports reverse parsing to restore the creation state according to the encoding of the note data matrix.

[0028] First, for the note data matrix. Update by dynamically binding the note positions in the music score template with the coordinate information of the note data matrix; when detecting a modification event in which the user modifies the configuration parameters through the music score template, update the note data matrix in real time based on the modified configuration parameters.

[0029] Next, generate the audio file.

[0030] Finally, reverse parse the audio file. Parse the note events in the audio file, extract the position and duration information of the notes; reverse map the extracted position and duration information into the vector graphics of the graphic notes, and restore the creation interface in the online music scoreboard, where the audio file includes MIDI files and MP3 files.

[0031] Another MIDI music composition method based on graphical programming is provided in the embodiments of the present application. The MIDI file records the instructions of music (such as pitch, note duration, dynamics, etc.), rather than the actual audio waveform. Therefore, its file size is very small, suitable for storage and transmission on mobile devices. In mobile programming, MIDI files can be efficiently loaded and parsed, reducing the occupation of system resources. MIDI is event-driven, and its instruction set enables developers to flexibly control all aspects of music (such as changing speed, pitch, rhythm, etc.). In a graphical programming environment, the parameters of MIDI music can be adjusted in real time by dragging and dropping components, enhancing the creation experience. The instructions of MIDI can be seamlessly integrated with other parts of the application, such as dynamically generating or modifying music according to user input or sensor data. For example, a mobile application can change the performance of MIDI music in real time through the input of devices such as touch screen gestures, gyroscopes, and microphones. MIDI supports multiple tracks, suitable for developing complex music applications. For example, different tracks can be assigned to different graphical objects to create dynamic and layered music effects.

[0032] In a graphical programming platform, currently, the teaching related to software operations mainly records the teacher's operations as a video and adds explanatory content to the video, which is integrated with the teaching content of programming logic and presented to students in the form of an entire video. However, the above method lacks the reversible editability of output files, resulting in a one-time and non-retraceable creation process, seriously restricting the creation flexibility and modification space of users. To solve the above problems, the present invention provides an online MIDI music editing method, as Figure 2 shown, including the following steps:

[0033] Step S202, obtaining graphical notes in an online music scoreboard.

[0034] The online music scoreboard in improvisation mode is as Figure 3 shown, and the online music scoreboard in score diagram mode is as Figure 4 shown. Instrument, accompaniment, beat, and mode selection are as Figure 5 shown, and block selection is as Figure 6 shown.

[0035] Step S204, converting the vector diagram of the graphical note into a corresponding note data matrix, where the note data matrix includes the position information and duration information of the graphical note;

[0036] Step S206, encoding and generating a corresponding MIDI file and / or MP3 file according to the note data matrix.

[0037] In the embodiment of the present application, by converting the graphic notes in the online music scoreboard into corresponding note data matrices and saving them as corresponding MIDI files or MP3 files when saving and outputting, the saved MIDI files can restore the music created by the current user, solving the following problems in the prior art: In traditional visual music editors, only MIDI music editing, playing, and output functions are provided to users. Users are allowed to improvise a piece of music based on the provided UI interactions, such as a scoreboard mapping musical notes or a piano keyboard, and output it. Users can obtain an audio file after output, usually MP3 or OGG. The output of such editing products does not have the function of re - editing and cannot be reversely parsed and restored to the state during creation and editing. Therefore, it is a one - time creation solution, greatly limiting the editing flexibility and creative space of creators.

[0038] The embodiment of the present application also provides a system for MIDI music creation based on graphical programming, as Figure 7 shown. The system includes a music creation module 72, a music editing module 74, a music usage module 76, and a music management module 78.

[0039] The music creation module 72 is used for initialization and parameter configuration. Users can choose to create a blank MIDI project or quickly generate a framework based on preset templates (such as pop, classical styles), and support customizing beats (such as 4 / 4 time, 6 / 8 time), default instruments (such as piano, strings), and the number of tracks configuration. This module provides two creation interfaces: "improv mode" and "score mode". The former allows free dragging of note blocks for improvisation, and the latter uses a staff - style grid to assist in precise composition, meeting the creation habits of different users.

[0040] The music editing module 74 is the core functional unit of the system, used for note editing, instrument configuration, and real - time interaction. Users drag graphical building blocks (such as notes, rests, pitch bend blocks) to the scoreboard area, and the system automatically converts them into note data matrices containing position, duration, and velocity, and maps them to MIDI events. During the editing process, the instrument type can be dynamically assigned to each track, and it supports importing tones from the built - in library or third - party tone libraries. This module also integrates an automatic accompaniment function, which intelligently generates drum rhythms or chord accompaniments based on the main melody. Users can adjust the complexity through a slider. To improve the rhythm accuracy, the system provides a visual beat line, and when users drag notes near the beat line, they will automatically snap into alignment. The editing results can be auditioned in real - time through the MIDI synthesis engine, supporting single - track or full - track playback, and allowing dynamic adjustment of note attributes (such as velocity, glide effect) and global parameters (speed, volume).

[0041] The music usage module 76 realizes the output and application integration of the creative achievements. Users can export the current drawing board project as a standard MIDI file, retaining all tracks and editing information for subsequent modification, or call the built-in synthesizer to render it into audio formats such as MP3 and WAV. For advanced application scenarios, this module provides an API interface to support binding MIDI instructions to external systems (such as game engines and interactive devices). For example, the generation of notes can be controlled by touch coordinates, or the music rhythm can be dynamically adjusted using gyroscope data to achieve cross-media interaction.

[0042] The music management module 78 is used for project storage, collaboration, and resource management. Users can save or load the drawing board project files. The system automatically records the version history and supports reverting to any editing node. Preset templates, sound libraries, and user-defined building blocks are stored in categories in the resource library, supporting keyword search and batch import. For team collaboration, the module provides cloud synchronization functionality. Multiple users can edit the same project simultaneously, and the system automatically merges the modification records through a conflict detection algorithm to ensure version consistency.

[0043] Compared with traditional music, the present invention enables more users to participate in music creation, gain a sense of achievement, and can enrich the types of works, supporting the creation of more music theme works.

[0044] The following will describe in detail the operation process of the system for MIDI music creation based on graphical programming, as Figure 8 shown, the operation process of this system includes the following steps:

[0045] Step S802, generating a vector graph based on the input graphical notes.

[0046] In the graphical programming interface, users complete music creation by dragging graphical building blocks (such as note blocks and rest blocks) to the drawing board area. The system captures the user's operations in real time and generates a vector graph containing the following information: 1) Position information. Through mapping in the drawing board coordinate system, the horizontal and vertical coordinates (X, Y) of each building block are recorded. The horizontal coordinate corresponds to the start time of the note (unit: millisecond), and the vertical coordinate corresponds to the pitch (encoded by semitones. For example, C4 is 60, and C#4 is 61); 2) Shape and color information. The shape of the building block identifies the note type (such as a circle for a whole note and a rectangle for a quarter note), and the color identifies the instrument type (such as blue for a piano and red for a drum set); 3) Additional attributes. The note velocity (range 0 - 127), pitch bend, and vibrato parameters are set through long pressing or the right-click menu.

[0047] The embodiments of this application introduce a time-axis dynamic adsorption function. When the user drags a musical note near the beat line (error range ±10 ms), it is automatically aligned to the nearest beat point to ensure timing accuracy. The calibration algorithm calculates the adsorption threshold in real time based on the beat period (BPM). For example, when the BPM is 120, the duration of a quarter note is 500 ms, and the adsorption threshold is ±5 ms. In addition, for the grid interface in the score pattern, a two-way mapping table of pitch-pixels is used on the vertical axis. For example, each semitone corresponds to 10 pixels. When the user drags a block to the 50th pixel, the system automatically maps it to the pitch C4 (60) and generates the corresponding MIDI event (Note On, Key = 60).

[0048] Step S804: Convert the vector graph into a musical note data matrix.

[0049] The system parses the graphic musical notes in the vector graph into structured data to generate a musical note data matrix. This matrix contains the following fields:

[0050] Field Name Data Type Description StartTime Floating Point Number Note Start Time (seconds) Duration Floating Point Number Note Duration (seconds) Pitch Integer MIDI Pitch Number (0 - 127) Velocity Integer Keystroke Force (0 - 127) InstrumentID String Instrument Identifier (e.g., "Piano_Steinway") Effects JSON Object Effect Parameters (Pitch Bend Range, Vibrato Frequency)

[0051] First, perform coordinate parsing. According to the drawing board resolution (e.g., 1920×1080 pixels) and the time-axis range (e.g., 30 seconds), convert the X coordinate to StartTime: StartTime = (X / 1920) × 30 or StartTime = (1920 / X) × 30. Then, perform pitch mapping. Query the corresponding Pitch value according to the vertical coordinate Y and the pitch-pixel mapping table. Next, perform duration calculation. The width of the block determines the duration Duration. For example, if a quarter note corresponds to a width of 120 pixels (duration of 0.5 seconds), then: Duration = (Width / 120) × 0.5 or Duration = (120 / Width) × 0.5.

[0052] The embodiments of this application support the reverse parsing of MIDI files into graphical blocks. Metadata is embedded in the musical note data matrix: the block identifier GridID, which is used to record the unique identifier of the block on the drawing board and restore the layout during reconstruction; the version hash value VersionHash, which is used to ensure consistency with the original project state during parsing. In addition, for the coordinate jitter caused by the user's rapid dragging, the system uses the Kalman filter algorithm to smooth the trajectory to avoid generating redundant or conflicting MIDI events.

[0053] Step S806: Generate a MIDI file.

[0054] The system generates a standard MIDI file (SMF format) according to the musical note data matrix. The specific process is as follows:

[0055] 1) Track layering.

[0056] Group the notes into different tracks according to the InstrumentID, and each track contains the corresponding instrument configuration instruction (Program Change).

[0057] 2) Event sorting.

[0058] Sort all note events (Note On / Off) according to the StartTime, and insert control events (ControlChange), such as pitch bend wheel (CC#1), volume (CC#7).

[0059] 3) Timestamp quantization.

[0060] Convert the floating-point time (seconds) to MIDI Delta Time (Tick) based on the PPQN (Pulses Per Quarter Note) parameter. For example, when PPQN = 480, 1 second (120BPM) corresponds to 960 Tick.

[0061] Traditional MIDI encoding uses a fixed PPQN (usually 480), resulting in insufficient time accuracy for high BPM music.

[0062] The present invention introduces a dynamic PPQN algorithm:

[0063]

[0064] For example, when BPM = 200, PPQN = 960, the time resolution is doubled, avoiding timing errors caused by note crowding. For continuously repeated events (such as the sustained intensity of long notes), use Running Status compression to reduce the file size by more than 30%.

[0065] Step S808, reverse parse the MIDI file into graphical building blocks.

[0066] The core innovation of the present invention lies in supporting the reverse parsing of MIDI files and restoring them to the editing state. Specifically, first extract the metadata. Read the GridID and VersionHash from the MIDI file and verify the compatibility with the current project. Then perform event parsing, decompose the MIDI events by track, and convert them into a note data matrix. For example: Note On event (timestamp, pitch, velocity) → StartTime, Pitch, Velocity; Program Change event → InstrumentID. Finally, perform graphical reconstruction. According to the GridID and coordinate mapping rules in the note data matrix, restore the position, shape, and color of the building blocks on the drawing board.

[0067] When the MIDI file in the embodiment of the present application contains external editing (such as modification by third-party software), the system ensures compatibility through the following steps: compare the original VersionHash with the hash value in the MIDI file to detect inconsistent areas; for conflict events (such as overlapping notes), adopt the "user priority" strategy to retain the version of the last user operation; automatically insert annotation events (Meta Event) to record the conflict handling log for the user to view. For control events such as pitch bend and vibrato, perform special effect inverse mapping, parse the CC#1 and CC#2 data, and convert them into a JSON object in the Effects field. For example, the pitch bend wheel value (0 - 16383) is mapped to the pitch bend range (-12 semitones to +12 semitones).

[0068] Step S810, real-time interaction and dynamic adjustment.

[0069] The system can also be integrated with external devices (such as touch screens and gyroscopes) through the API to achieve dynamic adjustment of music parameters. When the user slides the screen, the system converts the X / Y coordinates of the finger trajectory into pitch and volume parameters and updates the MIDI events in real time. After the gyroscope acceleration data is processed by low-pass filtering, it controls the global rhythm (BPM). For example, when the device tilt angle > 30°, the BPM increases by 10%. An LSTM model can also be integrated to analyze the user's current melody and recommend chord progressions or drum patterns, which the user can insert into the scoreboard by clicking the "adopt" button.

[0070] In this embodiment, to reduce the latency of real-time interaction, a double-buffer mechanism is adopted. The foreground buffer processes user input and graphics rendering; the background buffer is used for asynchronous execution of MIDI encoding and synthesizer rendering to ensure that the audio output latency < 20ms. For the memory limitation of mobile devices, the sound library is loaded on demand. For example, when the user selects the "piano" track, only the sampling data of SteinwayPiano (about 50MB) is loaded, rather than the complete sound library (> 1GB).

[0071] The present application also provides a MIDI music creation device based on graphical programming, as Figure 9 shown, including: an acquisition module 92 configured to acquire graphical notes in an online music scoreboard, where the graphical notes are generated through user interaction operations and include vector graph information; a conversion module 94 configured to convert the vector graph of the graphical notes into a note data matrix, where the note data matrix includes the position information and audio duration information of the graphical notes; a generation module 96 configured to encode and generate an audio file that supports reverse parsing to restore the creation state according to the note data matrix.

[0072] It should be noted that: The MIDI music creation device with graphical programming provided in the above embodiments is only illustrated by dividing the above functional modules. In practical applications, the above functions can be allocated to different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the MIDI music creation device with virtual graphical programming provided in the above embodiments and the embodiments of the MIDI music creation method based on graphical programming belong to the same concept. For the specific implementation process, please refer to the method embodiments and will not be elaborated here.

[0073] Figure 10 The schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure is shown. It should be noted that Figure 10 The electronic device shown is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0074] As Figure 10 shown, the electronic device includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1002 or the program loaded from the storage section 1008 into the random access memory (RAM) 1003. In the RAM 1003, various programs and data required for system operations are also stored. The CPU 1001, ROM 1002, and RAM 1003 are connected to each other via a bus 1004. The input / output (I / O) interface 1005 is also connected to the bus 1004.

[0075] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including such as a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as required. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as required so that a computer program read from it can be installed into the storage section 1008 as required.

[0076] The above are only the preferred embodiments of the present application. It should be pointed out that for those of ordinary skill in the art, without departing from the principle of the present application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of the present application.

Claims

1. A MIDI music composition method based on graphical programming, characterized in that, Including: Obtain graphic notes in an online music scoreboard, where the graphic notes are generated through user interaction operations and contain vector graphic information; Convert the vector graphics of the graphic notes into a note data matrix, where the note data matrix includes the position information and audio duration information of the graphic notes; Generate an audio file that supports reverse parsing to restore the creation state according to the encoding of the note data matrix.

2. The method according to claim 1, characterized in that, Converting the vector graphics of the graphic notes into a note data matrix includes: Extract the coordinate data in the vector graphics to generate an initial note position sequence; Based on a preset time-domain mapping rule, convert the coordinate data in the initial note position sequence into note duration information; Integrate the coordinate data and the note duration information into the note data matrix.

3. The method according to claim 1, wherein Before obtaining the graphic notes in the online music scoreboard, the method further includes: Provide a creation interface for an improvisation mode and / or a score chart mode in the online music scoreboard; In the improvisation mode, generate a music segment by freely dragging graphic notes; in the score chart mode, edit graphic notes based on a preset music score template to generate a structured music segment; where the music segment includes the graphic notes.

4. The method according to claim 3, wherein Before generating an audio file that supports reverse parsing to restore the creation state according to the encoding of the note data matrix, the method further includes: Dynamically bind the note positions in the music score template to the coordinate information of the note data matrix; When detecting a modification event in which the user modifies configuration parameters through the music score template, update the note data matrix in real time based on the modified configuration parameters.

5. The method according to claim 1, wherein After generating an audio file that supports reverse parsing to restore the creation state according to the encoding of the note data matrix, the method further includes: Parse the note events in the audio file, and extract the position and duration information of the notes; Reverse map the extracted position and duration information to the vector graphics of the graphic notes, and restore the creation interface in the online music scoreboard.

6. The method according to any one of claims 1 to 5, characterized in that The audio file includes MIDI files and MP3 files.

7. A MIDI music creation device based on graphical programming, characterized in that, Including: An acquisition module configured to obtain graphic notes in an online music scoreboard, where the graphic notes are generated through user interaction operations and contain vector graphic information; A conversion module configured to convert the vector graphics of the graphic notes into a note data matrix, where the note data matrix includes the position information and audio duration information of the graphic notes; A generation module configured to generate an audio file that supports reverse parsing to restore the creation state according to the encoding of the note data matrix.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, where when the program runs, it controls the device where the computer-readable storage medium is located to execute the method according to any one of claims 1 to 6.

9. A computer device, characterized in that, Including: A memory and a processor, The memory stores a computer program; The processor is used to execute the computer program stored in the memory, and when the computer program runs, it causes the processor to execute the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the method according to any one of claims 1 to 6.

Images