Performer matching system and program

Abstract

We provide a performer matching system and program that enables real-time remote performance after objectively evaluating the skills of fellow performers. [Solution] The performer matching server 1 registers conditions such as the genre of performance and the part of the instrument to be played, has the performer play practice pieces extracted from the genre and part, or selected pieces chosen by the performer, and collects the results from the user terminal 2. It also determines the performance level from the performance record during online performances and registers the performer's evaluation in the storage unit 12. The system searches for performer registration data to find collaborators, registration data of other performers (collaborators) that match the performance level, searches for collaborators by performance level, starts online performance if the performer and collaborators are able to perform in real time, and adjusts the schedule for online performance if they are not able to perform in real time.

Description

Technical Field

[0001] The present invention relates to a performer matching system, and particularly to a performer matching system and a program capable of finding remote co-performers who meet the conditions.

Background Art

[0002] [Conventional Technology] Conventionally, it has been a difficult task to find band members at a level that matches the preferences of performers. Therefore, in some conventional performer matching systems, performers are asked to input their musical preferences and playing levels by self-reporting, and then find performers who are suitable as band members.

[0003] [Related Technology] In addition, as related prior arts, there are Japanese Patent No. 6828106 "Video Distribution System, Video Distribution Method, and Video Distribution Program" (Patent Document 1), and Japanese Patent Publication No. 2019-506035 "Method for Matching Partners in Co-starring Videos, Terminal, and Computer-readable Storage Medium" (Patent Document 2).

[0004] Patent Document 1 describes distributing a co-starring video including a first character generated based on the movement of a first user and a second character generated based on the movement of a second user.

[0005] Patent Document 2 describes synthesizing a video of the role one played and a video of the role of the partner into a co-starring video. <图

Prior Art Documents

Patent Documents

[0006]

Patent Document 1

Patent Document 2

Summary of the Invention

[0007] However, the conventional matching system described above had a problem: it only found potential co-performers who met the criteria, and it did not allow for the actual skill level of the candidates to be verified or for real-time remote co-performance to occur.

[0008] Furthermore, Patent Documents 1 and 2 do not describe a configuration that enables real-time remote performance after objectively evaluating the skill level of the performers.

[0009] This invention was made in view of the above circumstances, and aims to provide a performer matching system and program that can achieve real-time remote performance after objectively evaluating the skill level of the performers. [Means for solving the problem]

[0010] To solve the problems of the above-mentioned conventional examples, the present invention is a performer matching system having a performer matching server connected via a network, wherein the performer matching server registers the genre of performance and the instrument part of the performer as registration data from a user terminal connected to the network, has the performer perform a practice piece extracted from the genre and part or a selected piece chosen by the performer, inputs the performer's performance data from the user terminal, determines the performance level based on the performance data and registers the performer's evaluation, when a performer searches for a collaborator, searches for the registration data and performance levels of other performers who can be collaborators that match the performer's registration data and performance level to extract collaborators, and if the performer and collaborator are able to perform in real time, starts an online performance via the performer and collaborator's user terminals, and obtains the performance data of the online performance from the performer and collaborator's user terminals.

[0011] The present invention is characterized in that, in the above-mentioned performer matching system, the performer matching server adjusts the online performance schedule if the performer and co-performers are unable to perform in real time.

[0012] The present invention is characterized in that, in the above-mentioned performer matching system, the performer matching server adds the performance record of a performer during an online performance to the evaluation of that performer.

[0013] The present invention is characterized in that, in the above-mentioned performer matching system, the performer matching server provides the performer's registration data and performance data to the scouting user terminal.

[0014] The present invention is characterized in that, in the above-mentioned performer matching system, the performer matching server causes the performer to perform an avatar performance based on the performer's performance data and displays it on the user's terminal.

[0015] The present invention is characterized in that, in the above-mentioned performer matching system, the performer matching server generates a promotional video based on the performer's performance data and displays it on the user's terminal.

[0016] The present invention relates to a processing program that operates on a performer matching server connected via a network, characterized in that the performer matching server registers the genre of performance and the instrument part to be played as registration data from a user terminal connected to the network, has the performer perform a practice piece extracted from the genre and part, or a piece selected by the performer, and obtains the performer's performance data by inputting it from the user terminal, determines the performance level based on the performance data and registers the performer's evaluation, and when a performer searches for a collaborator, searches the registration data and performance levels of other performers who can be collaborators that match the performer's registration data and performance level to extract collaborators, and if the performer and collaborator are able to perform in real time, initiates an online performance via the performer and collaborator's user terminals, and obtains the performance data of the online performance from the performer and collaborator's user terminals.

[0017] The present invention is characterized in that, in the above program, the performer matching server is configured to adjust the schedule for online performances if the performer and co-performers are unable to perform in real time.

[0018] The present invention is characterized in that, in the above program, the performer matching server is configured to add the performance record of a performer who is performing online to the evaluation of that performer.

[0019] The present invention is characterized in that, in the above program, the performer matching server is configured to provide the performer's registration data and performance data to the scout user terminal.

[0020] The present invention is characterized in that, in the above program, the performer matching server is configured to perform an avatar performance based on the performer's performance data and display it on the user terminal.

[0021] In the above program, the present invention is characterized in that the performer matching server is made to function to generate a promotion video based on the performance data of the performer and display it on the user terminal.

Effect of the Invention

[0022] According to the present invention, a performer matching server registers, as registration data, the genre of the performance of a performer and the conditions of the parts of the performance instrument from a user terminal connected to the network, and causes the performer to perform an étude extracted from the genre and the part or a selected piece chosen by the performer itself and input it from the user terminal to obtain the performance data of the performer. The performance level is determined based on the performance data, and the evaluation of the performer is registered. When the performer searches for a co-performer, the registration data and performance level of other performers who are co-performers matching the registration data and performance level of the performer are searched to extract the co-performer. If the performer and the co-performer can perform in real time, an online performance is started via the user terminals of the performer and the co-performer, and the performance data of the online performance is obtained from the user terminals of the performer and the co-performer. As a performer matching system, the performer can perform with an optimal co-performer when the performer wants to perform, which has the effect.

Brief Explanation of the Drawings

[0023] [Figure 1] It is a schematic configuration diagram of this system. [Figure 2] It is a schematic processing flow diagram of the performer matching server. [Figure 3] It is a processing flow diagram of the avatar performance.

Modes for Carrying Out the Invention

[0024] Embodiments of the present invention will be described while referring to the drawings. [Outline of the Embodiment] The performer matching system according to an embodiment of the present invention (this system) involves a performer matching server registering conditions such as the genre of performance and the part of the instrument to be played, having performers perform practice pieces extracted from the said genre and part, or selected pieces chosen by the performer, and also determining the performance level from the performance record during online performances and registering the performer's evaluation. The system searches for performer data to find collaborators, registers data of other performers (collaborators) that match the performance level, extracts collaborators by searching the performance level, starts an online performance if the performer and the collaborator can perform in real time, and adjusts the schedule for the online performance if they cannot perform in real time. Performers can register with the performer matching server whenever they want to perform and immediately perform with the most suitable collaborator, and even if real time is not possible, they can perform with the most suitable collaborator at the adjusted time. Furthermore, once you register with the performer matching server, you will be recommended as a collaborator with other performers, creating connections with performers you wouldn't have known before and providing opportunities to enjoy new musical activities.

[0025] [This system: Figure 1] This system will be explained with reference to Figure 1. Figure 1 is a schematic diagram of the system's configuration. As shown in Figure 1, this system comprises a performer matching server 1 and multiple user terminals 2, which are connected via a network 3.

[0026] [Performer Matching Server 1] The performer matching server 1 comprises a control unit 11, a storage unit 12, and an interface unit 13. The control unit 11 implements the functions described below by executing the processing program stored in the storage unit 12. Furthermore, the interface unit 13 is an interface unit for connecting the performer matching server 1 to the network 3.

[0027] [User Terminal 2] User terminal 2 is an information processing device equipped with a microphone and camera, such as a smartphone, tablet, or laptop PC, owned by the performer. The performer registers their information from user terminal 2, records or videos their performance of practice pieces or selected pieces, and performs in real time.

[0028] [Network 3] Network 3 is intended to represent the internet. For collaborative performances, a high-speed internet connection with minimal latency is desirable. Furthermore, in order to synchronize user terminal 2, performer matching server 1 may be configured to distribute synchronization sounds to the user terminal 2 of the other performers.

[0029] [Processing by performer matching server 1: Figure 2] The processing of the performer matching server 1 will be explained with reference to Figure 2. Figure 2 is a schematic flow diagram of the performer matching server. The processes handled by the performer matching server 1 include performer registration, performer level determination, performer evaluation, co-performer search, real-time performance processing, and performance scheduling.

[0030] As shown in Figure 2, the performer matching server 1 first performs performer registration processing (S1), then performer level determination processing (S2), then performer evaluation processing (S3), then performer search processing (S4), determines whether real-time performance is possible or not (S5), performs real-time performance processing (S6) if real-time performance is possible (Yes), and performs performance scheduling processing (S7) if real-time performance is not possible (No). The details of each process are explained below.

[0031] [Performer registration process] The performer registration process involves performers (users) entering their profiles, including their approach to music, frequency of activity, musical preferences, musicality of their performances, instruments played, years of experience, personality, and performance techniques (skill level and style). This information is then stored in the memory unit 12 with a user ID assigned to it. Musicians can register the moment they want to perform and immediately find collaborators. Here, to make the actual operation easier to understand, we will refer to "musicians who have registered because they want to perform now" as "users."

[0032] The self-declaration entry mentioned above basically involves registering your performance level, genre, and instrument. Furthermore, the performer's performance information (audio and video), preferred song titles, and preferred arrangement techniques are stored in the memory unit 12 of the performer matching server 1. The performance information consists of audio of a song chosen by the performer as their specialty (selected song) and video data of that selected song (selected song data). Note that the selected song data can be updated at any time, not just initially.

[0033] Furthermore, the performer matching server 1 also stores information about the performer's network communications (conversations, chats, and evaluation messages from others), and uses this information to evaluate the performer. This allows for not only evaluations of the quality of the performance based on the audio recording, but also evaluations of the performance style from others.

[0034] [Performer level determination process] The performer level determination process involves the performer matching server 1 selecting a practice piece according to the registered performer's profile, providing it to the user terminal 2, collecting audio or video data (practice piece data) performed by the performer, and storing it in the storage unit 12. The performer matching server 1 then determines the performer's level from the practice piece data, the selected piece data, or both, and stores the level data attached to the user ID. For example, performer matching server 1 uses an AI that has learned from performances of practice pieces and other data to score the performer's performance and determine their level.

[0035] [Performer evaluation process] The performer evaluation process evaluates the performer associated with the user ID based on the performer information registered through the performer registration process and the level data determined through the performer level determination process. The evaluation is performed based on the performer matching server 1's collected performance data, quantifying or categorizing performance genre, performance part, performance style, performance level, and communication skills, and calculating them quantitatively or qualitatively. AI, including machine learning and statistical methods, can be used in the evaluation calculation process. Furthermore, the performer evaluation process also incorporates evaluation information from fellow performers, and this information is updated each time a performance takes place.

[0036] [Search for co-stars] The co-performer search process searches for the most suitable co-performers for registered and rated performers. The performer matching server 1 searches for and suggests to the user collaborators who share a similar genre, similar tastes, and similar or appropriate skill level, based on the performer profiles and level data stored in the memory unit 12. Based on a similar level of technical skill, if the parties agree, individuals with slightly different levels of technical skill can also be considered as potential co-performers, thus broadening the scope of co-performer searches. Furthermore, the performer matching server 1 collects feedback and evaluations from both performers and co-performers after the performance and stores them in the memory unit 12, verifying the accuracy of the co-performer search process and updating the co-performer search performance.

[0037] [Real-time performance processing] The real-time performance processing function works as follows: when a user selects a collaborator suggested by the performer matching server 1, the performer matching server 1 immediately contacts the collaborator, requests an online performance, and if the collaborator agrees, a real-time performance is realized.

[0038] The audio or video of the real-time performance is stored in the memory unit 12 of the performer matching server 1 as performance information for the performers (users and co-performers) during the performer registration process. Furthermore, after a real-time performance, the system provides feedback to the user regarding the evaluation information from the other performers, and the performer matching server 1 updates the evaluation information of the other performers during the performer evaluation process. In this example, the performer matching server 1 immediately searches for fellow performers when a user registers with the performer matching server 1; however, it may also be configured to initiate a search based on a search instruction from the user. In other words, performers can simply register in advance, and when they want to perform, they can enter a search instruction for a collaborator, and the performer matching server 1 will recommend collaborators at that moment.

[0039] [Performance Schedule Processing] The performance schedule processing function involves the performance matching server 1 requesting performance schedules from the user's selected co-performers and coordinating the performance schedules with those co-performers. Once the performance schedule is adjusted, the online performance will take place at the adjusted date and time. It may also be possible to adjust the schedule for in-person performances, not just online ones. In these performances, feedback on the co-performers' evaluations will be provided to the user, and the performer evaluation process will add and update the evaluation information of the co-performers.

[0040] [Other processing] Other processes performed on performer matching server 1 include a scouting function, an avatar performance function, and a promotional video (PV) generation function.

[0041] [Scout function] The scouting function works by having the performer matching server 1 evaluate online bands and individual musicians who are members of those bands, search for information on bands and individual musicians of a specific level in the music genre desired by the scout, and notify the scout's user terminal 2. Alternatively, the performer matching server 1 could host auditions conducted by scouts to discover new talent. This makes it easier for scouts to find promising new bands and musicians.

[0042] [Avatar Performance Function] Another feature is the avatar performance function. The avatar performance function analyzes the performance habits and style of the recorded performer, generates an avatar that mimics that performer's style using AI, has the avatar perform, and displays it on user terminal 2. There are three types of avatar performance functions: the first is an avatar function where the player's identity is not specified; the second is a substitute avatar function; and the third is an avatar function where the player's identity is not specified (NPC: non-player character).

[0043] The first feature, the anonymous avatar function, allows the performer to play music through an avatar without revealing their face or personal information. This function is configured by the performer themselves. The second substitute avatar function uses an AI to generate avatars that remember the performer's mannerisms and perform in their place when they are absent (AI substitute function). This function can be set by the performer themselves, their co-performers, scouts, or users looking for performers. The third feature is the non-performing avatar function (NPC), where the generated AI makes the avatar perform the music requested by the user, rather than imitating the actual performer (AI performance function). This function is set by the collaborator, scout, or user searching for performers.

[0044] In particular, the second AI substitute function uses the performance information of a specific performer as training data to train an AI, which then generates performances that mimic that individual. Furthermore, the third AI performance function will perform in a style that many people consider good or in a style that the user desires. These functions would be more effective if they could use machine learning to determine performance techniques and styles, and then provide information on the performer's skills to the scout's user terminal 2.

[0045] [Avatar performance processing: Figure 3] The avatar performance processing in the performer matching server 1 will be explained with reference to Figure 3. Figure 3 is a flowchart of the avatar performance processing. As shown in Figure 3, when the avatar performance process in the performer matching server 1 starts, an avatar performance selection process is performed (SS11). In this selection process, it is determined whether or not the first unspecified avatar function (first function) has been selected (S12), and if the first function has been selected (if Yes), the avatar performance of the first function is executed (S13).

[0046] If the first function is not selected in the determination process S12 (if No), then it is determined whether the second AI substitute function (second function) is selected (S14). If the second function is selected (if Yes), the avatar performance of the second function is executed (S15). If the second function is not selected in the judgment process S14 (i.e., No), the avatar performance of the third AI performance function (third function) is executed (S16). The process ends once the avatar performance for each function has been completed.

[0047] [PV generation function] Additionally, it has a promotional video (PV) generation function. The PV generation function synthesizes video footage of performers filmed online to create a promotional video, which is then displayed on user terminal 2. In addition to videos of the actual person, avatar videos may also be used to generate the promotional video.

[0048] [Effects of the embodiment] According to this system, the performer matching server 1 registers conditions such as the genre of performance and the instrument part to be played, and has the performer play practice pieces extracted from the said genre and part, or selected pieces chosen by the performer, which are then collected from the user terminal 2. In addition, the system determines the performance level from the performance record during online performances and registers the performer's evaluation in the memory unit 12. The system searches for performer registration data, other performers (performers) registration data that match the performance level, extracts performers by searching the performance level, and if the performer and performer are able to play in real time, it starts the online performance. If they are not able to play in real time, it adjusts the schedule for the online performance, which has the effect of allowing performers to play with the most suitable performers when they want to. [Industrial applicability]

[0049] This invention is suitable for a performer matching system and program that can objectively evaluate the skill level of fellow performers and then realize real-time remote performance. [Explanation of Symbols]

[0050] 1…Performer matching server, 2…User terminal, 3…Network, 11…Control unit, 12…Storage unit, 13…Interface unit

Claims

1. A performer matching system having a performer matching server connected via a network, The aforementioned performer matching server is The user terminal connected to the network registers the performer's performance genre and instrument part as registration data, has the performer perform a practice piece extracted from the genre and part, or a piece selected by the performer, and inputs the data from the user terminal to obtain the performer's performance data, determines the performance level based on the performance data and registers the performer's evaluation, A performer matching system characterized in that, when a performer searches for a co-performer, the system searches for the registration data and performance level of other performers who can be co-performers that match the performer's registration data and performance level, extracts co-performers, initiates an online performance via the performer's and co-performer's user terminals if the performer and co-performer are able to perform in real time, and obtains the performance data of the online performance from the performer's and co-performer's user terminals.

2. The performer matching system according to claim 1, characterized in that the performer matching server adjusts the schedule for online performances if the performer and the co-performers are unable to perform in real time.

3. The performer matching system according to claim 1 or 2, characterized in that the performer matching server adds the performance record of a performer during an online performance to the evaluation of that performer.

4. The performer matching system according to claim 1 or 2, characterized in that the performer matching server provides the performer's registration data and performance data to the scout user terminal.

5. The performer matching system according to claim 1 or 2, characterized in that the performer matching server causes the performer to perform an avatar performance based on the performer's performance data and displays it on the user terminal.

6. The performer matching system according to claim 1 or 2, characterized in that the performer matching server generates a promotional video based on the performer's performance data and displays it on the user terminal.

7. A processing program that operates on a performer matching server connected via a network, The aforementioned performer matching server, The user terminal connected to the network registers the performer's performance genre and instrument part as registration data, has the performer perform a practice piece extracted from the genre and part, or a piece selected by the performer, and inputs the data from the user terminal to obtain the performer's performance data, determines the performance level based on the performance data and registers the performer's evaluation, A program characterized in that, when a performer searches for a collaborator, it searches for the registration data and performance level of other performers who can be collaborators that match the performer's registration data and performance level, extracts collaborators, and if the performer and collaborator are able to perform in real time, it initiates an online performance via the performer's and collaborator's user terminals, and acquires the performance data of the online performance from the performer's and collaborator's user terminals.

8. The program according to claim 7, characterized in that the performer matching server is configured to adjust the schedule for online performances if the performer and the co-performers are unable to perform in real time.

9. The program according to claim 7 or 8, characterized in that the performer matching server is configured to add the performance record of a performer who is performing online to the evaluation of that performer.

10. The program according to claim 7 or 8, characterized in that the performer matching server is configured to provide the performer's registration data and performance data to the scout user terminal.

11. The program according to claim 7 or 8, characterized in that the performer matching server is configured to perform an avatar performance based on the performer's performance data and display it on the user terminal.

12. The program according to claim 7 or 8, characterized in that the performer matching server is configured to generate a promotional video based on the performer's performance data and display it on the user terminal.

Images