Information processing method, information processing device, program, and information processing system

The information processing system addresses paper and ink depletion issues by generating and sharing performance images through URL-based access, ensuring easy sharing and post-event accessibility.

JP7586156B2Active Publication Date: 2024-11-19CASIO COMPUTER CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2022142235
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-09-07
Publication Date
2024-11-19
Estimated Expiration
2042-09-07

AI Technical Summary

Technical Problem

Conventional methods for generating and sharing images from electronic musical instrument performances at events face issues such as paper and ink depletion, manual labor requirements, and lack of post-event accessibility or sharing capabilities.

Method used

An information processing system that generates images based on performance data, stores them, and provides URL information through a two-dimensional code or digital watermark, allowing easy access and sharing without manual intervention.

Benefits of technology

Enables easy sharing and post-event access to performance images and information, reducing resource consumption and manual labor, and enhancing user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007586156000001
    Figure 0007586156000001
  • Figure 0007586156000002
    Figure 0007586156000002
  • Figure 0007586156000003
    Figure 0007586156000003
Patent Text Reader

Abstract

To make it possible to provide a performer with images and performance information generated according to a performance so that they can be easily shared with others.SOLUTION: A control unit of an information processing device acquires performance information corresponding to a performance operation from an electronic musical instrument, generates a second image according to the performance based on the acquired performance information, and causes a server to store the second image and the performance information. Further, the control unit acquires URL information for accessing the stored second image and performance information from the server, and instructs a label printer to output the acquired URL information.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing method, an information processing device, a program, and an information processing system. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a technique for analyzing performance information input when a user plays an electronic musical instrument, generating an image corresponding to the performance, and displaying the generated image (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-101168 A Summary of the Invention [Problem to be solved by the invention]

[0004] Incidentally, events and the like may be held using the technology described in Patent Document 1. At such events, for example, electronic musical instruments are made available to visitors so that they can play freely, and images corresponding to the performance of the performer are generated and displayed. In such events, as a method for providing the generated images to the performers, for example, a method in which the system automatically prints the images is available. However, this method has problems in that paper or ink frequently runs out, and manpower is required. In addition, it is not possible for the performers to listen to their performances later or share them with others.

[0005] An object of the present invention is to make it possible to easily provide a performer with images and performance information generated in response to a performance in a manner that allows them to be shared with others. [Means for solving the problem]

[0006] In order to solve the above problems, the information processing method of the present invention comprises: The computer Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; storing the image and / or the performance information in a storage device; Acquiring address information for accessing the stored image and / or performance information death, Instructing an output device to output the acquired address information In addition, the output device is instructed to output a thumbnail of the image or performance date and time information. . Effect of the Invention

[0007] According to the present invention, images and performance information generated in response to a performance can be easily provided to the performer so as to be shareable with others. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an example of the overall configuration of an information processing system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram showing a functional configuration of an information processing device. [Diagram 3] FIG. 13 is a diagram showing a sequence in an information processing system, from generating an image in accordance with the performance when a performer starts a performance, to outputting URL information for accessing the generated image and the performance information. [Figure 4] FIG. 11 is a diagram showing parameters used in generating a first image. [Diagram 5] 13A and 13B are diagrams showing an example of a second image displayed by the display device and a label output by the label printer based on instructions from the information processing device. [Figure 6] A diagram showing the flow of a sequence executed between a two-dimensional code reader application on a user terminal and a server when the user terminal is held over a two-dimensional code on a label. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are subject to various limitations that are technically preferable for implementing the present invention. Therefore, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0010] [Configuration of information processing system 100] FIG. 1 is a diagram showing an example of the overall configuration of an information processing system 100 according to the present invention. 1, the information processing system 100 includes an information processing device 1, an electronic musical instrument 2, a server 3, a display device 4, a label printer 5, and a user terminal 6. The information processing device 1 is connected to the electronic musical instrument 2, the server 3, the display device 4, and the label printer 5 via wired or wireless connections so as to be able to transmit and receive data. The user terminal 6 can be connected to the server 3 via a wireless LAN (Local Area Network) such as WiFi, a mobile phone communication network, the Internet, or the like.

[0011] At least the information processing device 1, the electronic musical instrument 2, the display device 4, and the label printer 5 of the information processing system 100 are installed at an event venue, and visitors can freely play the electronic musical instrument 2. Each device constituting the information processing system 100 will be described below.

[0012] [Information processing device 1] The information processing device 1 is a device that generates images according to musical performance, based on musical performance information (for example, Musical Instrument Digital Interface (MIDI) data) input based on a performance operation on an electronic musical instrument 2. Specifically, the information processing device 1 analyzes the performance information input by the electronic musical instrument 2 in real time, generates an image (called a first image) corresponding to the real-time performance, and displays it on the display device 4. When the performance ends, the information processing device 1 generates an image corresponding to the entire performance (a performance summary image summarizing the performance; called a second image) and displays it on the display device 4. The information processing device 1 also transmits the second image and the performance information to the server 3, and upon receiving URL (Uniform Resource Locator) information from the server 3 as address information for accessing the second image and the performance information, generates a two-dimensional code representing the received URL information and outputs it to the label printer 5. The information processing device 1 may be, for example, a tablet PC (Personal Computer), a notebook PC, a smartphone, or the like.

[0013] FIG. 2 is a block diagram showing the functional configuration of the information processing device 1. As shown in FIG. As shown in FIG. 2, the information processing device 1 includes a control unit 11, a storage unit 12, an input unit 13, a display unit 14, a communication unit 15, etc., and each unit is connected via a bus 16.

[0014] The control unit 11 is a computer including at least one CPU (Central Processing Unit), RAM (Random Access Memory), etc., and controls each unit of the information processing device 1. Specifically, the CPU of the control unit 11 reads out a specified program from among the system programs and various application programs stored in the storage unit 12, expands it in the RAM, and executes various processes including the process on the information processing device 1 side shown in FIG.

[0015] The storage unit 12 is composed of a non-volatile semiconductor memory, a HDD (Hard Disk Drive), etc. The storage unit 12 stores the system program of the information processing device 1, various application programs, and data required for executing the programs. The storage unit 12 is not limited to being built into the information processing device 1, and may include an external recording medium that is detachable from the information processing device 1. In this embodiment, the storage unit 12 stores a performance image generating application 121 for executing the processing on the information processing device 1 side shown in FIG. 3.

[0016] The input unit 13 is composed of push button switches, a touch panel attached to the display unit 14, and the like. The input unit 13 outputs to the control unit 11 an operation signal of the push button switch by the user or an operation signal on the screen.

[0017] Display unit 14 is an output device that is configured with an LCD (Liquid Crystal Display), an EL (Electro Luminescence) display, or the like, and performs various displays according to display information instructed by control unit 11. In other words, information processing device 1 may also function as an output device that outputs the above-mentioned URL information.

[0018] The communication unit 15 includes a wireless unit and a wired unit for communicating with external devices, and transmits and receives data to and from the external devices.

[0019] [Electronic Instruments 2] The electronic musical instrument 2 is, for example, a keyboard instrument, and is equipped with a keyboard having a number of keys on which a performer performs musical operations. The electronic musical instrument 2 generates musical tone waveforms and outputs sounds in accordance with the performance operations on the keyboard. The electronic musical instrument 2 also generates performance information in accordance with the performance operations and transmits the performance information to the information processing device 1 via a communication unit (not shown). The performance information includes a note on message for a pressed key, a note number (the number (pitch) of the pressed key), and a velocity, or a note off message for a released key, a note number (the number (pitch) of the released key), and a velocity, etc.

[0020] [Server 3] The server 3 includes a control unit, a storage unit, and a communication unit. As a storage device, the server 3 stores (stores) the second image, performance information, and image parameters transmitted from the information processing device 1 in the storage unit in association with each other. The server 3 also generates address information for accessing the second image and performance information stored in the storage unit and transmits it to the information processing device 1. In this embodiment, the server 3 generates a Web page for viewing a performance based on the second image and performance information, and transmits URL information for accessing the Web page to the information processing device 1.

[0021] [Display device 4] The display device 4 is an output device that performs display in response to an instruction from the information processing device 1. The display device 4 may be a projector that projects an image onto a projection surface such as a screen, or may be a monitor (large monitor) such as a liquid crystal display or an organic EL display.

[0022] [Label Printer 5] The label printer 5 is an output device that has a long recording medium wound in a roll and performs printing on the recording medium in response to an instruction from the information processing device 1.

[0023] [User terminal 6] The user terminal 6 is a terminal device such as a smartphone or tablet terminal carried by a performer, etc. The user terminal 6 includes a control unit, a storage unit, an input unit, a display unit, a camera, a communication unit, etc. The user terminal 6 is equipped with a two-dimensional code reader application and a web browser, and is capable of reading two-dimensional codes and viewing web pages.

[0024] [Operation of information processing system 100] Next, the operation of the information processing system 100 will be described. In the information processing system 100, when a performance is performed on the electronic musical instrument 2, images (first image, second image) corresponding to the performance are generated in the information processing device 1, and the generated images are displayed on the display device 4. The generated second image and performance information are transmitted to the server 3. The server 3 stores the second image and performance information, generates a Web page and its URL information for viewing a performance based on the second image and performance information, and transmits the generated URL information to the information processing device 1. When the information processing device 1 receives the URL information from the server 3, a two-dimensional code representing the URL information and a thumbnail of the second image are generated, and are printed out by the label printer 5. As a result, the URL information for accessing the Web page for viewing a performance based on the second image and performance information is provided to the performer. When the user terminal 6 is held over the two-dimensional code output by the label printer 5, the two-dimensional code is read by the user terminal 6 and URL information is obtained. The obtained URL information enables the user to view the Web page, i.e., the performance based on the second image and the performance information.

[0025] 3 is a diagram showing a sequence in information processing system 100 from generating an image according to the performance when a performer starts playing electronic musical instrument 2 to outputting URL information for accessing the generated image and performance information. The sequence shown in FIG. 3 will be described below.

[0026] First, the electronic musical instrument 2 determines whether or not a performance operation (key press or key release) has been performed (step S1). If it determines that a performance operation has been performed (step S1; YES), it generates performance information based on the performance operation and transmits (inputs) it to the information processing device 1 (step S2), and then proceeds to step S3. When it is determined that no performance operation has been performed (step S1; NO), the electronic musical instrument 2 proceeds to step S3.

[0027] In step S3, the electronic musical instrument 2 determines whether or not a predetermined time has elapsed without any performance operation (step S3). If it is determined that the predetermined time has not elapsed without any performance operation (step S3; NO), the electronic musical instrument 2 returns to step S1. If it is determined that the predetermined time has elapsed without any performance operation (step S3; YES), the electronic musical instrument 2 determines that the performance has ended, and ends the process.

[0028] In the information processing device 1, the control unit 11 determines whether or not performance information has been input from the electronic musical instrument 2 via the communication unit 15 (step S4).

[0029] When it is determined that performance information has been input from the electronic musical instrument 2 via the communication unit 15 (step S4; YES), the control unit 11 acquires the input performance information, analyzes it in real time, and generates a first image corresponding to the most recent performance based on the analysis result. Then, the control unit 11 transmits the generated first image to the display device 4 via the communication unit 15, instructs the display device 4 to display the first image (step S5), and proceeds to step S6. Note that the control unit 11 may also cause the display unit 14 to display the first image.

[0030] In step S5, the control unit 11, for example, analyzes the input performance information to determine the key, pitch (note), velocity, tempo, etc. of the music being played, and determines the type of element (for example, an image of a flower or leaf) to be drawn and the size of the element based on the determined information, and generates a first image according to the most recent performance. As a method for generating the first image and the second image from the performance information, for example, the method described in Patent Document 1 can be used, but is not limited to this. The control unit 11 transmits the generated first image to the display device 4 to display it. In addition, as shown in FIG. 4, the control unit 11 records the image parameters used to generate the first image in the RAM. Examples of the image parameters used to generate the first image include the note (pitch) and velocity included in the performance information, the key and tempo that are the analysis results of the performance, the element ID indicating the type of the drawn element, the size of the element, etc. Note that the element corresponding to the element ID is stored in the storage unit 12.

[0031] When it is determined that no performance information has been input from the electronic musical instrument 2 via the communication section 15 (step S4; NO), the control section 11 proceeds to step S6.

[0032] In step S6, the control unit 11 judges whether or not a predetermined time has elapsed without any input of performance information (step S6). When it is determined that the predetermined time has not elapsed without any input of performance information (step S6; NO), the control section 11 returns to step S4 and repeats steps S4 to S6.

[0033] If it is determined that a predetermined time has elapsed without input of performance information (step S6; YES), the control unit 11 determines that the performance has ended and generates a second image summarizing the entire performance. Then, the control unit 11 transmits the generated second image to the display device 4 via the communication unit 15, and instructs the display device 4 to display the second image (step S7). In step S7, the control unit 11 generates a second image based on image parameters (image parameter group) used to generate a plurality of first images generated during performance, which are stored in the RAM. The control unit 11 transmits the generated second image to the display device 4 via the communication unit 15 to display the image (see FIG. 1). The control unit 11 may also cause the display unit 14 to display the second image.

[0034] Next, the control unit 11 obtains the current date and time as the performance date and time when the performance was performed, and stores the performance date and time information in the RAM (step S8).

[0035] Next, the control unit 11 transmits the data of the second image, the performance information, and the image parameters to the server 3 via the communication unit 15 (step S9).

[0036] When the server 3 receives the data of the second image, the performance information, and the image parameters from the information processing device 1 (step S10; YES), the server 3 stores the received data in the storage unit of the server 3 in association with each other (step S11).

[0037] Next, the server 3 generates a Web page for viewing and listening to the performance based on the second image and the performance information, and stores it in the storage unit (step S12). Then, the server 3 generates URL information for accessing the generated Web page and transmits it to the information processing device 1 (step S13).

[0038] In the information processing device 1, when URL information is received from the server 3 via the communication unit 15 (step S14; YES), the control unit 11 acquires the received URL information and generates a two-dimensional code representing the URL information and a thumbnail of the second image (step S15). For example, the control unit 11 encodes the received URL information to generate a two-dimensional code (such as a QR code (registered trademark)) that represents the URL information. In addition, the control unit 11 performs dithering on the second image, binarizes it, and reduces it to generate a black and white binary thumbnail.

[0039] Then, the control unit 11 transmits the generated two-dimensional code, thumbnail of the second image, and performance date and time information data to the label printer 5 via the communication unit 15, and instructs the label printer 5 to output the two-dimensional code, thumbnail of the second image, and performance date and time information, causing this information to be printed out (step S16). The label printer 5, following instructions from the information processing device 1, prints out the two-dimensional code, a thumbnail of the second image, and performance date and time information (step S17).

[0040] FIG. 5 is a diagram showing an example of a second image 141 displayed by the display device 4 and a label 51 output by the label printer 5 based on an instruction from the information processing device 1. As shown in FIG. As shown in FIG. 5, the label 51 displays a two-dimensional code 51a representing URL information, a thumbnail 51b of the second image, and a performance date and time 51c.

[0041] The label printer 5 uses a long recording medium (e.g., a tape member) in a roll, and the size of the two-dimensional code is much smaller than the second image. Therefore, even if the label printer 5 prints the two-dimensional code, it is very unlikely that the paper or ink will run out. Therefore, by using the label printer 5 to print out the two-dimensional code representing the URL information for accessing the second image and the performance information, it is possible to automatically provide the performer with the URL information for accessing the second image and the performance information without requiring human labor. In other words, it is possible to easily provide the performer with the image and performance information generated according to the performance so that they can be shared with others.

[0042] Furthermore, by printing not only the two-dimensional code 51a but also a thumbnail 51b of the second image and performance date and time 51c, the performer can distinguish his or her own two-dimensional code from that of other performers, thereby reducing the possibility of accidentally taking away another performer's two-dimensional code.

[0043] The performer obtains the label 51 output from the label printer 5, starts up a two-dimensional code reader application on his / her own user terminal 6, and holds it over the two-dimensional code 51 a on the label 51.

[0044] 6 is a diagram showing the flow of a sequence executed between the server 3 and the user terminal 6 when a two-dimensional code reader application is started in the user terminal 6 and the user terminal 6 is held over the two-dimensional code 51a of the label 51. The sequence shown in FIG. 6 will be described below.

[0045] In the user terminal 6, the camera is placed on standby to photograph the two-dimensional code 51a, and when the two-dimensional code 51a is photographed (step S21; YES), the user terminal 6 decodes the photographed two-dimensional code 51a and acquires URL information (step S22).

[0046] Next, the user terminal 6 determines whether or not a user operation has been performed to instruct access to a Web page based on the acquired URL information (step S23). If it is determined that access to a web page based on the acquired URL information has been instructed (step S23; YES), the user terminal 6 accesses the server 3 based on the acquired URL information and requests transmission of the web page specified by the URL information (step S24).

[0047] When there is a request from the user terminal 6 to access a Web page based on the URL information, the server 3 reads out the Web page specified by the URL information and transmits it to the user terminal 6 (step S25).

[0048] The user terminal 6 displays, by a browser, the Web page transmitted from the server 3, that is, the Web page for viewing and listening to the second image and the performance based on the performance information (step S26).

[0049] Here, the Web page displayed in step S26 displays the second image generated according to the performance, and a user interface (play button, stop button, pause button, etc.) for viewing the performance based on the performance information. The performer can enjoy viewing the second image and listening to the performance by playing back the performance information through this Web page. In addition, the Web page displays a DL button for instructing the download of the second image reconstructed according to the display screen of the user terminal 6.

[0050] When the DL button is pressed on the web page to request the download of the second image (step S27; YES), the user terminal 6 requests the server 3 to download the second image and transmits screen information of its own device (user terminal 6) (e.g., resolution (number of horizontal pixels x number of vertical pixels)) to the server 3 (step S28).

[0051] When the server 3 receives a download request and screen information for the second image from the user terminal 6 (step S29; YES), it reconstructs the second image for use as wallpaper in accordance with the display screen of the user terminal 6 (step S30), and transmits the reconstructed second image (reconstructed image) to the user terminal 6 (step S31). The server 3 reads out the image parameters received together with the second image displayed on the Web page from the storage unit, and reconstructs the second image that matches the size and resolution of the display screen of the user terminal 6 based on the read image parameters. If the specs of the control unit of the server 3 are high and the performance information can be read and analyzed at high speed, the second image that matches the display screen of the user terminal 6 may be reconstructed from the performance information without using the image parameters. In this case, there is no need to transmit the image parameters from the information processing device 1 to the server 3 in step S9 of FIG. 3.

[0052] The user terminal 6 receives the second image transmitted from the server 3 (step S32). The performer can enjoy the second image by downloading it and displaying it as wallpaper, for example.

[0053] When an instruction to end the display of the Web page is given (step S33; YES), the user terminal 6 closes the Web page and ends the sequence executed between the user terminal 6 and the server 3.

[0054] In this way, the information processing system 100 generates URL information for accessing the second image and performance information according to the performer's performance and outputs a two-dimensional code representing the URL information, so that the URL information for accessing the second image and performance information can be provided to the performer without the need for human intervention. Therefore, the second image and performance information generated according to the performance can be easily provided to the performer. Furthermore, by sharing the acquired two-dimensional code (URL information) with others, the performer can share and enjoy the second image and performance information with others.

[0055] Below, a modification of the above embodiment will be described. (Variation 1) In the above embodiment, the second image corresponding to the performance and the two-dimensional code representing URL information for accessing the performance information are printed out by the label printer 5, but the method of outputting the two-dimensional code is not limited to this. For example, the control unit 11 may superimpose the two-dimensional code representing the URL information on the second image, and instruct the display device 4 or the display unit 14 of the information processing device 1 to display the second image with the two-dimensional code superimposed. In this case, it is preferable to display only the second image without displaying the two-dimensional code for a certain period of time, and to place the two-dimensional code in an inconspicuous position, so as not to impair the artistic quality of the second image.

[0056] (Variation 2) In the above embodiment, in steps S15 to S16 in FIG. 3, when the control unit 11 of the information processing device 1 receives the URL information from the server 3, the control unit 11 generates a two-dimensional code of the URL information and causes the label printer 5 to print out the code, but the method of outputting the URL information is not limited to this. For example, in steps S15 to S16 in FIG. 3, the control unit 11 may generate a digital watermark image in which the URL information is embedded in the second image, transmit the digital watermark image to the display device 4, and instruct the display device 4 to display the digital watermark image. Alternatively, the control unit 11 may instruct the display unit 14 to display the digital watermark image. In this case, in step S7 in FIG. 3, the second image is not displayed on the display device 4 or the display unit 14 of the information processing device 1. This is to prevent the performer from taking a picture of the second image without the digital watermark.

[0057] User terminal 6 is equipped with an application that reads information embedded in a digital watermark image, and when the digital watermark image displayed on display device 4 is photographed by a camera, user terminal 6 acquires URL information from the digital watermark image. The process after acquiring the URL information is the same as the process from step S23 onward in Fig. 6, and therefore the explanation thereof will be cited.

[0058] (Variation 3) In the above embodiment, a Web page is generated for each performance, but a common Web page may be prepared in advance. The URL information of the common Web page is displayed in the form of a two-dimensional code on the electronic musical instrument 2, a poster, a card that the performer can take home, or other places where the performer can see it. When the server 3 receives the second image, performance information, and image parameters from the information processing device 1, it adds the received second image, performance information, etc. to the common Web page. The performer can view the common Web page by photographing the two-dimensional code representing the URL information of the common Web page with the camera of the user terminal 6. The second image and performance information added to the Web page are deleted by the server 3 after a certain period of time.

[0059] According to the third modification, in addition to the performances of the performers themselves, data corresponding to performances within a certain period of time is uploaded to the common Web page, so that the performers can search based on the time and place of the performance to view the second images and performances of others. In addition, the second images and performance information data can be shared and enjoyed with others. In addition, in the third modification, since individual URL information is not generated for each performance, it is possible to omit the process of generating a different two-dimensional code for each performance and presenting it to the performer. It is also possible to avoid the problem of confusion when some people do not come to pick up the printed two-dimensional code. In addition, when a performer plays multiple pieces of music, it becomes possible to access the second images and performance information of multiple performances all at once with a single access.

[0060] As described above, the control unit 11 of the information processing device 1 acquires performance information corresponding to a performance operation from the electronic musical instrument 2, generates a second image corresponding to the performance based on the acquired performance information, and stores the second image and the performance information in the server 3. The control unit 11 then acquires URL information for accessing the stored second image and performance information from the server 3, and instructs the label printer 5, the display device 4, or the display unit 14 to output the acquired URL information. Therefore, the URL information for accessing the second image and the performance information can be automatically provided to the performer without requiring any human intervention, and the second image and the performance information generated according to the performance can be easily provided to the performer so as to be shareable with others.

[0061] For example, the control unit 11 generates a two-dimensional code representing the above-mentioned URL information, and instructs the label printer 5, the display device 4, or the display unit 14 to output the generated two-dimensional code. Therefore, the performer can easily access the second image and the performance information by simply holding the user terminal 6 over the two-dimensional code. In addition, the performer can take the two-dimensional code home with him / her, so that he / she can access the second image and the performance information later.

[0062] Also, for example, the control unit 11 generates a thumbnail of the second image and instructs the label printer 5 to output the two-dimensional code and the thumbnail. Therefore, it becomes possible for a performer to identify his / her own two-dimensional code, and it is possible to prevent the performer from mistakenly taking home another performer's two-dimensional code.

[0063] Also, for example, the control unit 11 obtains performance date and time information when the performance corresponding to the performance information was performed, and instructs the label printer 5 to output the two-dimensional code and the performance date and time information. Therefore, it becomes possible for a performer to identify his / her own two-dimensional code, and it is possible to prevent the performer from mistakenly taking home another performer's two-dimensional code.

[0064] Also, for example, the control unit 11 superimposes a two-dimensional code on the second image and instructs the display device 4 or the display unit 14 to output the second image on which the two-dimensional code is superimposed. Therefore, the performer can easily access the second image and performance information by simply holding the user terminal 6 over the two-dimensional code.

[0065] Also, for example, the control unit 11 generates a digital watermark image in which URL information is embedded in the second image, and instructs the display device 4 or the display unit 14 to output this digital watermark image. Therefore, the performer can easily access the second image and the performance information by simply photographing the digital watermark image with the user terminal 6 equipped with an application for reading the information embedded in the digital watermark image.

[0066] Also, for example, the server 3 generates a Web page and URL information of the Web page for viewing the performance based on the second image and the performance information, and transmits them to the information processing device 1. Therefore, the performer can easily view the performance based on the second image and the performance information.

[0067] Furthermore, for example, when a download request for the second image is received from a user terminal 6 that has accessed the server 3 based on the URL information, the server 3 acquires screen information of the display screen of the user terminal 6 from the user terminal 6, generates a reconstructed image by reconstructing the second image according to the display screen of the user terminal 6 based on the acquired screen information, and transmits the generated reconstructed image to the user terminal 6. Therefore, it is possible to provide the performer with a second image that corresponds to the screen of the user terminal 6.

[0068] The contents of the description in the above embodiment and modified examples are preferred examples of the information processing method, information processing device, program, and information processing system according to the present invention, and are not limited to these.

[0069] For example, in the above embodiment, the information processing device 1 is separate from the electronic musical instrument 2, but the information processing device 1 and the electronic musical instrument 2 may be integrated. For example, the functions of the information processing device 1 may be provided in the electronic musical instrument 2.

[0070] In the above embodiment, the storage device is the server 3, the second image, performance information, and image parameters are stored in the server 3, and URL information for accessing the second image and the performance information is generated by the server 3, but the memory unit 12 of the information processing device 1 may function as the storage device. That is, the control unit 11 of the information processing device 1 may store the second image, performance information, and image parameters in the memory unit 12 of the information processing device 1, and generate URL information for accessing the second image and the performance information. For example, the control unit 11 may store the second image, performance information, and image parameters in the memory unit 12 of the information processing device 1, generate a Web page for viewing a performance based on the second image and performance information, and generate URL information for accessing the Web page.

[0071] In the above embodiment, the second image and the performance information are stored and address information for accessing both is generated and output in order to provide both to the performer, but only one of them may be stored and URL information for accessing only one of them may be generated and output. The above-mentioned Web page may also be a Web page for viewing either the second image or the performance information.

[0072] In the above embodiment, a Web page for viewing the performance based on the second image and the performance information is generated, and URL information for accessing the Web page is generated and output, but URL information for accessing the storage location of the second image and the performance information may be generated and output. Also, the address information is not limited to URL information.

[0073] Furthermore, in the above embodiment and modified example, the URL information is provided to the performer by outputting it as a two-dimensional code or a digital watermark image, but characters representing the URL information may also be output.

[0074] In the above embodiment, the electronic musical instrument 2 is a keyboard instrument, but it may be another electronic musical instrument such as an electric guitar or a MIDI violin.

[0075] In the above embodiment, the ROM is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, a hard disk, an SSD, or a portable recording medium such as a CD-ROM can be applied. In addition, a carrier wave can be applied as a medium for providing data of the program according to the present invention via a communication line.

[0076] In addition, the detailed configurations and operations of each device constituting the information processing system may be modified as appropriate without departing from the spirit of the invention.

[0077] Although the embodiment and modified examples of the present invention have been described above, the technical scope of the present invention is not limited to the above-mentioned embodiment, but is defined based on the claims. Furthermore, the technical scope of the present invention also includes equivalent ranges that are made by adding modifications that are not related to the essence of the present invention from the claims. [Explanation of symbols]

[0078] 100 Information Processing Systems 1. Information processing device 11 Control section 12 Storage section 121 Performance image generation app 13 Input section 14 Display section 15 Communications Department 2. Electronic Instruments 3 Server 4 Display device 5. Label Printer 6 User terminals

Claims

1. The computer Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; storing the image and / or the performance information in a storage device; obtaining address information for accessing the stored image and / or performance information; instructing an output device to output the acquired address information, and instructing the output device to output a thumbnail of the image or performance date and time information; Information processing methods.

2. The computer includes: generating a two-dimensional code representing the address information; instructing the output device to output a two-dimensional code representing the address information; The information processing method according to claim 1 .

3. The computer includes: generating a thumbnail of said image; instructing the output device to output the two-dimensional code and the thumbnail; The information processing method according to claim 2 .

4. The computer includes: Acquire performance date and time information on when the performance corresponding to the performance information was performed; instructing the output device to output the two-dimensional code and the performance date and time information; The information processing method according to claim 2 .

5. 5. The information processing method according to claim 2, wherein the output device is a label printer.

6. The computer Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; storing the image and / or the performance information in a storage device; obtaining address information for accessing the stored image and / or performance information; generating a two-dimensional code representing the address information; superimposing the two-dimensional code on the image; instructing an output device to output the image on which the two-dimensional code is superimposed; Information processing methods.

7. The computer Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; storing the image and / or the performance information in a storage device; obtaining address information for accessing the stored image and / or performance information; generating a digital watermark image in which the address information is embedded in the image; instructing an output device to output the digital watermark image in which the address information is embedded; Information processing methods.

8. The information processing method according to claim 6 or 7, wherein the output device is a display device.

9. 2. The information processing method according to claim 1, wherein the address information is address information of a Web page for viewing and listening to a performance based on the image and / or the performance information.

10. Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; storing the image and / or the performance information in a storage device; obtaining address information for accessing the stored image and / or performance information; instructing an output device to output the acquired address information, and instructing the output device to output a thumbnail of the image or performance date and time information; An information processing device having a control unit.

11. On the computer, Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; storing the image and / or the performance information in a storage device; obtaining address information for accessing the stored image and / or performance information; instructing an output device to output the acquired address information, and instructing the output device to output a thumbnail of the image or performance date and time information; A program for executing a process.

12. An information processing system including an information processing device, a server, and an output device, The information processing device includes: Acquire performance information according to the performance operation, generating an image according to the performance based on the acquired performance information; Transmitting the image and / or the performance information to the server; The server, storing the image and / or the performance information; generating address information for accessing the stored image and / or performance information and transmitting the address information to the information processing device; The information processing device includes: Acquire the address information transmitted from the server; instructing the output device to output the acquired address information and to output a thumbnail of the image or performance date and time information; The output device includes: outputting the address information and outputting a thumbnail of the image or performance date and time information; Information processing system.

13. The server, 13. The information processing system according to claim 12, further comprising: generating a Web page for viewing a performance based on said image and said performance information, and address information of said Web page, and transmitting the generated Web page to said information processing device.

14. The server, When a download request for the image is received from a terminal device that has accessed based on the address information, screen information of a display screen of the terminal device is acquired from the terminal device; generating a reconstructed image by reconstructing the image in accordance with the display screen of the terminal device based on the acquired screen information; Transmitting the generated reconstructed image to the terminal device; The information processing system according to claim 12.

Citation Information

Patent Citations

  • Karaoke system

    JP2012078526A

  • Musical performance recording device

    JP2014228628A

  • Information processing unit, information processing method, information processing program and electronic musical instrument

    JP2019101168A

  • Program, method, electronic apparatus, and musical performance data display system

    JP2021099456A