Computer systems, content delivery systems, and content delivery methods

Abstract

To provide new technologies useful for the evaluation of user-generated content (UGC). [Solution] The server system 1100 is a computer system that provides UGC 7x (User Generated Content) received from provider user 2x to multiple users 2. When the server system 1100 receives UGC 7x from provider user 2x, it selects a review user 3 from among the users 2. Then, it communicates with the review user 3's user terminal 1500 to have the review user 3 review the received UGC 7x. If the review is successful, the received UGC 7x is registered and provided to users 2 in the content market.

Description

Technical Field

[0001] The present invention relates to a computer system that provides UGC (User Generated Content) to a plurality of users.

Background Art

[0002] Recently, systems for publishing computer-readable content (hereinafter referred to as "UGC" (User Generated Content)) created by ordinary users have become popular. For example, when the UGC is a video, a video posting site corresponds to such a system. A user can post his / her UGC on a video posting site and have other users view it. Also, when the UGC is an illustration, an illustration posting site corresponds to this. There are posting sites according to the attributes of UGC (for example, music, 3DCG, novels, voice, etc.). Patent Document 1 discloses a technique for evaluating UGC.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Content created by a user may include inappropriate expressions. For example, expressions that infringe on the copyright of others or expressions that conflict with public order and good morals. Also, when the content is a derivative work of original content (for example, an online game, a comic, an anime, etc.) or content that becomes an item available in the original content, expressions that damage the worldview of the original content or the image of the characters appearing in it also fall under inappropriate expressions. In the case of video content, cases where the screen flickering that can affect photosensitive users is included also fall under inappropriate expressions.

[0005] One possible measure to stop the publication of user-generated content (UGC) containing such inappropriate expressions is for system operators to review each piece of UGC individually. This is not a problem if the number of UGC pieces is small, but if the number exceeds a certain level and becomes large, this measure may become impractical.

[0006] The problem that this invention aims to solve is to provide a new technology that is useful for reviewing user-generated content (UGC). [Means for solving the problem]

[0007] The first invention for solving the above-mentioned problems is a computer system that provides UGC (User Generated Content) received from a provider user to multiple users by performing predetermined communication with each user terminal, The receiving means for receiving the UGC from the provider user (for example, the server processing unit 200s, receiving unit 214 in Figure 10, the registration application acceptance data 700 in Figure 12, and steps S14 to S22 in Figure 16), A means for selecting review users from among the aforementioned users (for example, the server processing unit 200s in Figure 10, the review user selection unit 216, the review user account list 715 in Figure 13, and step S24 in Figure 16), The computer system comprises a review control means (for example, the server processing unit 200s in Figure 10, the review control unit 218, the review control data 710 in Figure 13, and step S72 in Figure 16) that communicates with the user terminal of the review user and controls the execution of a review process in which the review user reviews the received UGC received by the reception means.

[0008] According to the first invention, a computer system can select review users from among its users and have them review UGC received from provider users. By having review users perform the review, the human and time costs that system operators previously incurred in reviewing UGC can be reduced. Moreover, by selecting review users from among its users, the review can be conducted using review criteria that are more in line with those of general users, compared to when system operators review UGC. According to the first invention, a useful technology for reviewing UGC can be provided.

[0009] The second invention is a computer system of the first invention, further comprising user information management means (for example, the server processing unit 200s in Figure 10, the user information management unit 202, the content experience information 618 in Figure 4, step S116 in Figure 16, and step S90 in Figure 19) that manage user information including content experience information regarding the use and / or creation of UGC for each user, and the review user selection means that selects the review user using the content experience information (for example, steps S52 to S70 in Figure 18).

[0010] According to the second invention, the computer system can identify and select users with extensive experience in using and creating UGC (User-Generated Content) as review users. Therefore, the quality of the review process can be improved.

[0011] The third invention is a computer system of the second invention, wherein the examination user selection means further selects the examination user using the attributes of the received UGC (for example, steps S62 and S64 in Figure 18).

[0012] UGC attributes include the content category (e.g., video, still image, music, novel, in-game item, etc.), the content style (e.g., CG rendering image, hand-drawn illustration, etc. for still images), and the age restriction rate for content use.

[0013] According to the third invention, the computer system can select review users who have extensive experience in using and creating UGC with the same attributes as the submitted UGC to be reviewed. Therefore, the quality of the review can be further improved.

[0014] The fourth invention is a computer system of the second or third invention, wherein the examination user selection means further uses the creation information of the received UGC to select the examination user.

[0015] The creation information for submitted UGC refers to information about the circumstances and environment in which the UGC was created. For example, this includes the date and time of completion, the length of time it took to create, the time of day it was created, the location of creation (e.g., region, country, home / office, etc.), and information about the tools used for creation (software, tools, creation environment, etc.). According to the fourth invention, the computer system will be able to select an examination user based on the creation information of the submitted UGC to be examined.

[0016] The fifth invention is a computer system of any of the second to fourth inventions, wherein the review user selection means further selects the review user using the content experience information of the provider user (for example, steps S62 and S64 in Figure 18).

[0017] According to the fifth invention, the computer system can further select review users using the content experience information of the provider users. For example, based on the content experience of the provider users, users with more extensive content experience can be selected as review users. Therefore, the quality of the review can be further improved.

[0018] The sixth invention is a computer system of any of the first to fifth inventions, further comprising relationship management means for managing relationships between users (for example, the server processing unit 200s, relationship management unit 203, and friend list 607 in Figure 3 in Figure 10), wherein the review user selection means selects the review user based on the relationships between the users relating to the provider user (for example, step S48 in Figure 18).

[0019] According to the sixth invention, the computer system can select a review user based on the relationship between users with respect to the provider user.

[0020] The seventh invention is a computer system of any one of the first to sixth inventions, further comprising review user evaluation control means (for example, the server processing unit 200s in FIG. 10, the review user evaluation unit 224, the review user evaluation 642 in FIG. 3, steps S156 to S166 in FIG. 20) that controls the execution of review user evaluation processing for evaluating the review user based on the review result.

[0021] According to the seventh invention, the computer system can evaluate a review user based on the review result given by the review user. Therefore, by using this evaluation when selecting a review user, it becomes possible to select as a review user a user who has a track record of conducting higher and more appropriate reviews.

[0022] The eighth invention is a computer system of the seventh invention, in which the review user evaluation control means executes the review user evaluation processing after a predetermined time has elapsed since the start of the provision of the received UGC reviewed in the review processing (for example, steps S132 and S172 in FIG. 17).

[0023] According to the eighth invention, for example, it becomes possible to perform review user evaluation processing related to the received UGC after providing a time allowance from when the received UGC is provided to the user until it becomes known after a predetermined time has elapsed.

[0024] The ninth invention is a computer system of the seventh or eighth invention, in which the review user evaluation processing is a process of evaluating the review user who reviewed the UGC based on the usage evaluation of the UGC by the usage user and the review result of the review processing related to the UGC (for example, steps S130 to S136 in FIG. 17).

[0025] According to the ninth invention, the computer system can evaluate the review user in consideration of the evaluation (usage evaluation) of the UGC used by the usage user and the review result given by the review user for the UGC. For example, a review user whose review result and the usage evaluation of the usage user match can be highly evaluated. As a result, it becomes possible to select, as a review user, a user who has a record of conducting reviews close to the evaluation criteria of all users.

[0026] Further, the tenth invention is the computer system according to the ninth invention, wherein the review user evaluation process is a process of evaluating the review user who reviewed the UGC based on the unique usage evaluation when a predetermined usage evaluation determination condition that can uniquely determine the usage evaluation is satisfied, and the review result of the review process regarding the UGC.

[0027] According to the tenth invention, for example, if the usage evaluation determination condition is set as a condition where the number of usage evaluations is a predetermined number and the usage evaluation that becomes the top evaluation is determined as the unique usage evaluation, it becomes possible to uniquely determine what kind of evaluation the UGC is overall.

[0028] The eleventh invention is the computer system according to the sixth or seventh invention, wherein the review user evaluation process is a process of evaluating the review user who reviewed the UGC based on the evaluation of the UGC by the operator of the computer system and the review result of the review process regarding the UGC (for example, steps S170 to S176 in FIG. 17).

[0029] According to the eleventh invention, the computer system can evaluate the review user in consideration of the evaluation of the UGC by the operator and the review result given by the review user for the UGC. For example, a review user whose review result and the operator's evaluation match can be highly evaluated. As a result, it becomes possible to select, as a review user, a user who has a record of conducting reviews close to the evaluation criteria of the operator.

[0030] The twelfth invention further comprises an examination personal information management means (e.g., server processing unit 200s in Figure 10, examination personal information 644 in Figure 5, step S84 in Figure 19) that manages examination personal information for each examination user, including at least examination experience and / or examination level, and modifies the examination personal information based on the evaluation results of the examination user evaluation process, and the examination user selection means that selects the examination user using the examination personal information (e.g., step S46 in Figure 18), It is a computer system of any of the seventh through eleventh inventions.

[0031] According to the twelfth invention, the computer system manages personal examination information, which is modified based on the evaluation results of the examination user evaluation process, for each examination user, and uses this personal examination information to select examination users. The personal examination information represents the user's track record as an examination user. Therefore, it becomes possible to select examination users with a high level of examination experience.

[0032] The thirteenth invention is a computer system of any seventh to twelfth invention, further comprising a reward granting means (for example, the server processing unit 200s in Figure 10, the reward granting unit 240, the reward definition data 512 in Figure 11, and step S200 in Figure 17) for granting a reward to the reviewing user based on the evaluation results of the reviewing user evaluation process.

[0033] Furthermore, the fourteenth invention is a computer system of the thirteenth invention, wherein the aforementioned benefit is information that can be used when creating the aforementioned UGC.

[0034] According to the 13th or 14th invention, a computer system can provide rewards to users who become examination users. The provision of rewards serves as an incentive to become examination users.

[0035] The fifteenth invention is a computer system of any one of the first to fourteenth inventions, further comprising a means for determining whether or not to provide the received UGC based on the examination results (for example, the server processing unit 200s in Figure 10, the provision determination unit 220, the UGC registration data 720 in Figure 14, and step S92 in Figure 19).

[0036] According to the 15th invention, a computer system can decide whether or not to provide the received UGC to the user based on the examination results.

[0037] The sixteenth invention is a computer system of any one of the first to fifteenth inventions, further comprising UGC selection screen control means for controlling the display of the UGC selection screen for provision on the user terminal, and further comprising UGC selection screen control means for controlling the display order of the UGC based on the examination results (for example, the server processing unit 200s in Figure 10, the UGC selection screen control unit 232, and step S112 in Figure 16).

[0038] According to the 16th invention, the computer system can determine the display order of UGCs on the UGC selection screen based on the examination results of the UGCs.

[0039] The 17th invention is a content provision system comprising a server system which is a computer system according to any of the 1st to 16th inventions, and the user terminal.

[0040] According to the 17th invention, a content provision system that achieves the effects of the computer system described above can be realized.

[0041] The 18th invention is a content provision method in which a computer system provides user-generated content (UGC), which is computer-readable content received from a provider user, to multiple users by communicating with each user terminal as prescribed, the method comprising: receiving the UGC from the provider user; selecting review users from among the users; communicating with the user terminal of the review user to control the execution of a review process in which the review user reviews the received UGC; and disclosing the review results of the review process to at least the provider user.

[0042] According to the 18th invention, a content provision method that produces the same effects as the first invention can be realized. [Brief explanation of the drawing]

[0043] [Figure 1] A diagram showing an example of a game system configuration. [Figure 2] A diagram illustrating the parent content (online games), related user-generated content (UGC), and the UGC review process. [Figure 3] A diagram showing an example of the data structure of user information. [Figure 4] A diagram showing an example of the structure of content experience information. [Figure 5] A diagram illustrating an example of the structure of personal information being reviewed. [Figure 6] A diagram illustrating the use of UGC registration application history data and UGC usage history data in the selection of review users. [Figure 7] A diagram (part 1) illustrating the use of review experience data in selecting review users. [Figure 8] A diagram (part 2) illustrating the use of review experience data in selecting review users. [Figure 9] A diagram illustrating the selection of review users based on user information. [Figure 10] A functional block diagram showing an example of the functional configuration of a server system. [Figure 11] A diagram showing examples of programs and data stored in the server's memory unit. [Figure 12] A diagram showing an example of the data structure of registration application acceptance data. [Figure 13] A diagram showing an example of the data structure of review control data. [Figure 14] A diagram showing an example of the data structure of UGC registration data. [Figure 15] A functional block diagram showing an example of the functional configuration of a user terminal. [Figure 16] A flowchart illustrating the processing flow of a server system. [Figure 17] Flowchart continuing from Figure 16. [Figure 18] A flowchart illustrating the process for selecting review users. [Figure 19] A flowchart illustrating the pre-distribution review process. [Figure 20] A flowchart illustrating the process of withdrawing distribution. [Figure 21] A functional block diagram showing an example of the functional configuration of a server system in a modified example. [Figure 22] A diagram showing examples of programs and data stored in the server memory unit in a modified example. [Modes for carrying out the invention]

[0044] Examples of embodiments of the present invention will be described below, but it goes without saying that the embodiments to which the present invention can be applied are not limited to the following embodiments.

[0045] Figure 1 shows an example configuration of game system 1000. Game System 1000 is a system that provides an online game service that allows registered users to play online games, and a posting service that accepts (posts) of user-generated content (UGC) related to the game, and provides (publishes and distributes) the UGC to users.

[0046] The game system 1000 is a computer system comprising a server system 1100 and user terminals 1500 for each user, with the user terminals 1500 serving as the Man-Machine Interface (MMIF). It is a content provision system that provides online games and user-generated content (UGC). Figure 1 depicts four user terminals 1500, but in actual system operation, the number of user terminals 1500 is not limited. The server system 1100 and the user terminals 1500 can communicate with each other via network 9, and the user terminals 1500 can also communicate with each other via network 9.

[0047] Network 9 refers to a communication path capable of data communication. In other words, Network 9 includes not only LANs (Local Area Networks) using dedicated lines (dedicated cables) or Ethernet (registered trademark) for direct connections, but also communication networks such as telephone networks, cable networks, and the Internet, and the communication method is either wired or wireless.

[0048] The server system 1100 comprises a main unit 1101, a keyboard, a touch panel, and storage 1140, with a control board 1150 mounted on the main unit 1101. The control board 1150 is equipped with various microprocessors such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor), various IC memories 1152 such as VRAM, RAM, and ROM, and a communication device 1153. Note that part or all of the control board 1150 may be implemented using an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a SoC (System on a Chip).

[0049] The server system 1100 then implements the following functions by having the control board 1150 perform calculations based on predetermined programs and data: (1) a user management function for managing information related to user registration, etc., (2) a game management function for allowing users to play online games as players, (3) a UGC creation service function for providing a UGC creation function, and (4) a posting service function for receiving, publishing, and distributing UGC submissions related to online games.

[0050] Although the server system 1100 is depicted as a single server device, it may be implemented using multiple devices. For example, the server system 1100 may consist of multiple blade servers, each handling different functions, connected to each other via an internal bus for data communication. Furthermore, the location of the hardware constituting the server system 1100 is not restricted. Multiple independent servers located in separate locations may communicate with each other via the network 9 to function as the server system 1100 as a whole.

[0051] The user terminal 1500 is a computer system used by the user to access the game system 1000. The user terminal 1500 functions as the human-machine interface within the game system 1000. Therefore, it can be said that the game system 1000 is equipped with the user terminal 1500.

[0052] In Figure 1, the user terminal 1500 is represented as a device commonly known as a smartphone, but any computer system that can be used is also acceptable, such as a smartwatch, smart glasses or other wearable computer, a portable game console, a home game console, a tablet computer, or a personal computer. When multiple electronic devices, such as a smartphone and a smartwatch connected to the smartphone, are connected in a communicative manner to perform a single function, these multiple electronic devices can be considered as a single user terminal 1500.

[0053] The user terminal 1500 includes an operation input device (e.g., touch panel 1506, keyboard, game controller, mouse, etc.), an image display device (e.g., touch panel 1506, video monitor, head-mounted display, etc.), and a control board 1550.

[0054] The control board 1550 is equipped with a CPU 1551, various microprocessors such as a GPU and DSP, various IC memories 1552 such as VRAM, RAM, and ROM, and a communication module 1553 that connects to the network 9. These elements mounted on the control board 1550 are electrically connected via bus circuits and the like, enabling data reading and writing, and signal transmission and reception. Part or all of the control board 1550 may be configured with an ASIC, FPGA, or SoC. The control board 1550 stores programs and various data necessary to realize the functions of a user terminal in the IC memory 1552.

[0055] The user terminal 1500 can, by executing a predetermined application program, realize the functions of an MMIF for using the game system 1000, specifically, the functions of a game client, the functions of a terminal for creating UGC, and the functions of viewing and using publicly available and distributed UGC in the game.

[0056] The user terminal 1500 is configured to download application programs and various data necessary for their execution from the server system 1100, but it may also be configured to read them from a separate storage medium such as a memory card.

[0057] Figure 2 is a diagram illustrating the parent content, an online game, the related user-generated content (UGC), and the UGC review process. In this embodiment, the UGC review is described as being conducted before the UGC is published or distributed. Therefore, this review will be referred to as "pre-distribution review." The term "parent" in "parent content" indicates the relative position of the content to the UGC. The term "parent content" is used to indicate the content that motivated the creation of the UGC.

[0058] The server system 1100 can register multiple users 2 (2a, 2b, ...), and each registered user 2 can play an online game as parent content on their respective user terminal 1500. In the example in Figure 2, the game screen W2 shows an MMORPG screen where a player character 4 is fighting an enemy NPC 6, but the game genre is not limited to this and can be set as appropriate.

[0059] UGC7 (7a, 7b, ...) is categorized by UGC attribute and published and distributed on the content marketplace provided by server system 1100, and then provided to user 2.

[0060] UGC attributes can adopt categories such as UGC7. Categories include, for example, videos, still images, music, skin data usable for player character 4, accessories usable for player character 4, items such as weapons and armor with different color schemes usable for player character 4, and written works such as novels based on the game world or player character 4. Videos include, for example, gameplay videos, fan movies and MAD movies based on player character 4 or the game world. Still images include, for example, illustrations based on player character 4 and stamp images that can be attached to chats. Music includes, for example, background music, sound effects, and call tones.

[0061] When using the content marketplace, the UGC selection screen W4 displayed on the user terminal 1500 shows a list of UGC7 (7a, 7b, ...) provided by user 2 and registered for publication and distribution, similar to a publicly known online shopping site. In the example in Figure 2, each UGC7 is represented as text, but they could also be displayed as icons.

[0062] User 2, who uses the content marketplace, selects the UGC7 they want to use on the UGC selection screen W4 displayed on user terminal 1500. Depending on the selected UGC7, it may be possible to use it after paying a fee.

[0063] UGC7 selected on the UGC selection screen W4 can be viewed and appreciated independently, and if it is an item usable in the game, it can be used during gameplay. For example, weapon items with different color schemes than the original ones provided in the game, or skins for player character 4 are good examples. Items usable in the game will be registered in user 2's save data.

[0064] UGC7 is created by User 2, who is both the creator and provider of UGC7. UGC7 is provided by User 2 to the game system 1000 after completing a prescribed registration application procedure, and is registered by the server system 1100 as something that can be made public and distributed on the content market. In other words, UGC7 is received by the server system 1100 from the provider user through prescribed communication between the user terminal 1500 and the server system 1100, and is provided to multiple users via the content market. Figure 2 shows the registration application for UGC7x created by provider user 2x.

[0065] User 2 can create UGC7 using the UGC creation service provided by server system 1100 as a web application. For example, web applications (e.g., video editing, CG creation, music creation, text editor, etc.) are available for each UGC attribute, and User 2 acquires the right to use these web applications by paying a predetermined fee. Of course, User 2 may also create UGC7 using video editing software, CG software, music software, text editor, or other applications that they have prepared themselves.

[0066] UGC7, which is accepted by server system 1100 through a registration application, is not immediately made available (published and distributed) on the content market. It is registered and made available on the content market only after passing a pre-distribution review.

[0067] Pre-distribution review is conducted by review users 3 (3a, 3b, ...). Review users 3 (3a, 3b, ...) are users 2 who act as reviewers and are selected by the server system 1100 from among the registered users 2. Review users 3 are also selected from users who have given permission to act as reviewers during the user registration procedure, etc. In the example in Figure 2, there are three review users 3 for UGC7x, and the review results for each review user show "2 votes for OK and 1 vote for NG". In this case, the overall review result for UGC7x is "OK" by majority vote.

[0068] The pre-distribution review method is not limited to the example in Figure 2 and can be set as appropriate. For example, the number of review users 3 can be set as appropriate. Also, instead of a simple pass / fail choice, a system is also possible in which each review user assigns points to UGC7x within their allocated points, and if the total value reaches the passing threshold, it is considered a pass.

[0069] Figure 3 shows an example of the data structure of user information 600 created and managed by the server system 1100 for each registered user 2. User information 600 is prepared for each user 2 who has been registered through a prescribed user registration procedure, and stores various data related to that user 2. These various data can also be described as the "user attribute" data of that user 2.

[0070] One user information 600 may include, for example, a unique user account 601, age 603, hobby and preference declaration data 605, a friend list 607, and game save data 609.

[0071] Age 603 and hobby / preference declaration data 605 are self-reported. For hobbies and preferences, user 2 may declare by checking items from a pre-prepared list that they believe correspond to their own hobbies and preferences.

[0072] Friend list 607 is a list of user accounts 601 of 2 users who have mutually declared themselves as friends among other users who met in or outside of the game.

[0073] Furthermore, user information 600 includes a review officer approval flag 610, UGC creation service usage rights ownership data 614, and content experience information 618 related to the use and creation of UGC7.

[0074] The examiner authorization flag 610 is set to "1" when user 2 performs a prescribed operation to indicate that they are willing to assume the role of examiner user 3. The initial setting is "0 (not authorized)".

[0075] The UGC creation service usage rights ownership data 614 is created when user 2 has the right to use the UGC creation service provided by the game system 1000. The usage rights may be possessed by everyone from the beginning, or they may be acquired and owned through a prescribed billing procedure. In the example in Figure 3, one UGC creation service usage rights ownership data 614 stores the following associated data: a) acquisition date and time, b) createable UGC attributes indicating the UGC attributes of the UGC 7 that can be created, c) work save data which is various data related to the work performed using the creation service, and d) additional function information indicating whether additional functions such as plugins, add-ins, and add-ons that can be added to the service are available. Of course, the UGC creation service usage rights ownership data 614 can also store other data as appropriate.

[0076] Figure 4 shows an example of the structure of content experience information 618. Content experience information 618 includes UGC registration application history data 620 and UGC usage history data 630. A structure in which either of these is omitted is also possible.

[0077] The UGC registration application history data 620 is created when user 2 creates UGC7 and applies for registration to make UGC7 available for publication and distribution on the content market. The UGC registration application history data 620 stores various data related to the registration application. The registration application is the procedure by which user 2 provides UGC7 to the server system 1100. Therefore, the UGC registration application history data 620 is also creation and provision history data of user 2 creating UGC7 and providing it to the server system 1100.

[0078] A single UGC registration application history data 620 may include, for example, the registration application date and time 622 (the date and time of provision from the provider user's perspective), a registration application ID 626 uniquely assigned to each registration application, the UGC attributes 626 of the registered UGC7, and the overall review result 628. Of course, other data may also be included as appropriate.

[0079] UGC usage history data 630 is created each time user 2 uses UGC 7 on the content marketplace. User 2, who uses UGC 7, can be referred to as the "user". One UGC usage history data 630 includes, for example, the date and time of use 632, the UGC registration ID 634 indicating the used UGC 7, and the UGC attribute 636. Of course, other data may also be included as appropriate.

[0080] Returning to Figure 3, the user information 600 includes the review user ID 640, which is automatically assigned when user 2 is selected as review user 3, the review user evaluation 642, the review personal information 644, and the ineligible person flag 670.

[0081] The Review User Evaluation 642 indicates the evaluation of User 2 as Review User 3. In this embodiment, the Review User Evaluation 642 has an initial value of "100P (points)," and points are added when the evaluation improves and deducted when the evaluation decreases. The Review User Evaluation 642 may also be an evaluation history that stores the date and time the evaluation was changed and the points by which the evaluation was changed in chronological order.

[0082] Figure 5 is a diagram illustrating an example of the structure of the review personal information 644. The review personal information 644 includes review experience data 650 and review level 658.

[0083] Review experience data 650 is created each time user 2 performs a pre-distribution review as review user 3. Each review experience data 650 includes the review date and time 652, the review UGC registration ID 654 indicating the subject of the review, and the review result 656 for each review user indicating the review result made by user 2. Of course, other data may also be included as appropriate.

[0084] Review level 658 is automatically determined based on a given level setting criterion, using review user evaluation 642 and review experience data 650. A higher level indicates a more extensive track record of performing correct reviews and a more reliable review process.

[0085] It is also possible to omit the review experience data 650 and review level 658 and substitute them with the review user evaluation 642.

[0086] Returning to Figure 3, the ineligible user flag 670 is created when user 2 is selected as review user 3, and is set to "1 (ineligible)" if user 2 is determined to be ineligible as review user 3. The initial value is "0 (eligible)". User 2, whose flag is "1", will not be selected as review user 3.

[0087] The server system 1100 selects a review user 3 from among the users 2 based on various information contained in the user information 600.

[0088] Figure 6 is a diagram illustrating the use of UGC registration application history data 620 and UGC usage history data 630 in relation to the selection of review users. Reviewer User 3 is expected to provide a more appropriate review the more knowledgeable they are about UGC7, and more specifically, the more knowledgeable they are about video if it's video, or music if it's music. The level of knowledge User 2 has about UGC7 can be inferred from the number of UGC registration application history data 620 and the number of UGC usage history data 630 of User 2.

[0089] The server system 1100 assigns points to each user 2 based on the number of UGC registration application history data 620 and points based on the UGC usage history data 630. The sum of these points is considered an indicator of the user 2's extensive experience with UGC 7, or in other words, one of the indicators of their suitability as a review user 3. In the example in Figure 6, users 2a and 2b are candidate users for review user 3. Users 2a and 2b are each assigned 10 points for each UGC registration application history data 620 submission and 1 point for each UGC usage history data 630. As a result, user 2a receives "100 points" and user 2b receives "20 points". Therefore, in this example, user 2a can be judged to be more suitable as a review user 3.

[0090] Furthermore, the UGC creation service usage rights ownership data 614 can also be converted into points and used as an element of the appropriate indicator, similar to the UGC registration application history data 620 and the UGC usage history data 630.

[0091] Figures 7 and 8 illustrate the use of review experience data 650 in the selection of review users. The server system 1100 has a mechanism to receive user evaluations and operator evaluations of publicly available and distributed UGC 7 in order to maintain review standards, and to reflect these in the selection of the next review user 3.

[0092] Specifically, as shown in Figure 7, a user 2c who uses UGC7 in the content marketplace can input an unsuitable rating for the UGC7 they used, indicating that they consider it unsuitable for publication and distribution. Inputting an unsuitable rating is possible by performing a predetermined unsuitable rating start operation on the user terminal 1500. In the example in Figure 7, user 2c has inputted an unsuitable rating for the UGC7c they used.

[0093] As shown in Figure 8, the operator 8 can input an evaluation of a publicly available and distributed UGC7, indicating that the UGC7 is unsuitable for public release and distribution. In the example in Figure 8, the operator 8 has input an evaluation that UGC7c is unsuitable. This evaluation input by the operator 8 may be performed from the server system 1100, or from a user terminal 1500u that can remotely operate the server system 1100.

[0094] If the server system 1100 finds a UGC7 that has been publicly released and distributed that is deemed unsuitable, it searches for the review user 3 that reviewed the UGC7 before distribution by referring to the review experience data 650. If the review user 3's review result 656 is "OK", that is, if the review user 3 made a review result different from the user evaluation or operator evaluation, points are deducted from the review user evaluation 642 of that review user 3. In the examples in Figures 7 and 8, review user 3d judged UGC7c as "NG", so its review user evaluation 642d is maintained, but the review user evaluation 642e of review user 3e, who judged UGC7c as "OK", is deducted. Then, in the selection of the next review user 3, the updated review user evaluations 642 of each review user are referred to.

[0095] Figure 9 is a diagram illustrating the selection of review user 3 based on user information 600. When selecting a review user 3, the server system 1100 considers users 2 whose review officer approval flag 610 is "1" among the registered users 2 as candidate users 2k for review user 3, and excludes users 2 whose ineligible flag 670 is "1 (indicating ineligibility)" and users 2 whose review user evaluation 642 falls below a predetermined standard value from candidate users 2k. Furthermore, the server system 1100 excludes user 2 from the candidate users if their review user evaluation 642, application experience, and review level are lower than those of the provider users (creator users) of UGC7 that are subject to pre-distribution review. In the example in Figure 9, the silhouette of excluded user 2 is shown with a dashed line.

[0096] Furthermore, the server system 1100 refers to the friend list 607 of each of the 2k candidate users and excludes user 2, who is friends with the provider user (creator user) of UGC7 that is subject to pre-distribution review, from the candidate users 2k. This is done when it is determined that there is a possibility that the review may be influenced if there is a friendship. Of course, it can also be argued that users who are friends have more opportunities to see the provider user's (creator user's) UGC7 on a regular basis, so they will be able to review it properly. In this case, user 2, who is not friends, should be excluded from the candidate users.

[0097] Furthermore, when executing these exclusions sequentially, it is preferable not to perform the exclusion if the number of candidate users (2,000) remaining after the exclusion falls below a predetermined target number.

[0098] Next, the server system 1100 calculates sorting points for each of the remaining candidate users 2k based on the data in the user information 600 that corresponds to the suitability indicator for review.

[0099] The "data that corresponds to the review suitability index" can be the UGC creation service usage rights ownership data 614, the UGC registration application history data 620, and the UGC usage history data 630. Each of these data contains information about the UGC attributes of UGC7 (creatable UGC attributes, UGC attributes 626 (see Figure 4), and used UGC attributes 636 (see Figure 4)). Therefore, these data are compared with the UGC attributes of UGC7 that are subject to pre-distribution review, and points are calculated by assigning high points to data with the same UGC attributes and low points to data with different UGC attributes. The weighting according to the data type of the UGC creation service usage rights ownership data 614, the UGC registration application history data 620, and the UGC usage history data 630 can be set as appropriate, in addition to the example in Figure 6.

[0100] Furthermore, the server system 1100 refers to the hobby and preference declaration data 605 and adds sorting points according to the number of similar hobbies and preferences as the provider user (creator user) of the UGC7 subject to pre-distribution review. This is based on the assumption that candidate users 2k with similar hobbies and preferences can better discern the value of the UGC7 subject to pre-distribution review and conduct a more accurate review.

[0101] The server system 1100 then sorts the candidate users 2k by the sum of their sorting points, selects the top predetermined number of candidate users 2k' from among them, and sorts them further by the points of their respective review user evaluations 642. Finally, a predetermined number of users are selected as review users 3 from the top of the review user evaluation 642 points.

[0102] Next, we will explain the functional configuration of Game System 1000. Figure 10 is a functional block diagram showing an example of the functional configuration of the server system 1100. The server system 1100 comprises an operation input unit 100s, a server processing unit 200s, an audio output unit 390s, an image display unit 392s, a communication unit 394s, and a server storage unit 500s.

[0103] The operation input unit 100s is a means for inputting various operations for managing the server system 1100. Examples of this include a keyboard, touch panel, mouse, etc.

[0104] The server processing unit 200s is implemented using electronic components such as IC memory and other arithmetic circuits, including a processor such as a CPU, GPU, ASIC, or FPGA, and controls data input and output with each functional unit, including the operation input unit 100s and the server storage unit 500s. It then performs various calculation processes based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from user terminals 1500, etc., and comprehensively controls the operation of the server system 1100.

[0105] The server processing unit 200s includes a user information management unit 202, a game management unit 204, a UGC provision control unit 210, a timing unit 280s, a sound generation unit 290s, an image generation unit 292s, and a communication control unit 294s. Of course, other functional units may also be included as appropriate.

[0106] The User Information Management Unit 202 handles processing related to user registration procedures, receives various types of information linked to user accounts, and controls the management of the storage of user information 600 (see Figure 3). User information 600 includes a friend list 607, which indicates friendships, one type of relationship between users. Therefore, the User Information Management Unit 202 also functions as a Relationship Management Unit 203, managing relationships between users.

[0107] Game Management Unit 204 performs various controls related to the execution of online games. Game Management Unit 204 is the parent content management unit.

[0108] The UGC provision control unit 210 performs various controls related to the creation and provision of UGC7. For example, the UGC provision control unit 210 includes a UGC creation control unit 212, a reception unit 214, a review user selection unit 216, a review control unit 218, a provision eligibility determination unit 220, a review result notification control unit 222, a review user evaluation unit 224, a review personal information management unit 226, a market management unit 230, and a reward granting unit 240.

[0109] The UGC creation control unit 212 controls the execution of various services for user 2 to create UGC7. For example, if UGC7 is video content, it may control the implementation of video editing functions on the user terminal 1500, such as providing a web application for video editing.

[0110] The reception unit 214 controls the process for receiving UGC7 from provider users. Specifically, it controls the acceptance of registration applications for UGC7 provided by provider users, and controls the storage of UGC7 data accepted in registration applications.

[0111] The review user selection unit 216 controls the selection of review user 3 from among user 2. Specifically, the review user selection unit 216 selects review user 3 using content experience information 618 (see Figures 3 to 9). More specifically, the review user selection unit 216 selects review user 3 based on (1) UGC attributes of the received UGC, (2) content experience information 618 of the provider user, (3) relationships between users related to the provider user (for example, friendships shown in the friend list 607), and (4) review user evaluation 642 or review personal information 644.

[0112] The review control unit 218 communicates with the user terminal 1500 of the review user 3 and controls the execution of the review process in which the review user 3 reviews the received UGC received by the reception unit 214. This includes the control related to pre-distribution review (see Figure 2).

[0113] The provision decision unit 220 decides, based on the review results, whether or not to provide the UGC (received UGC) received by the reception unit 214. Specifically, if the UGC "passes" the pre-distribution review, it will be provided to user 2 by publishing and distributing it on the content market; if it "fails," it will not be provided.

[0114] The review result notification control unit 222 controls the notification of the overall review result (pass / fail) to the user who provided the UGC7 that was subject to review.

[0115] The review user evaluation unit 224 controls the execution of a review user evaluation process that evaluates the review user 3 based on the review results of the pre-distribution review for UGC7 (received UGC) received by the reception unit 214.

[0116] Specifically, the review user evaluation unit 224 performs the following processes after a predetermined time has elapsed since the provision (publication and distribution) of the received UGC on the content market: (1) an evaluation of the review user 3 who reviewed the UGC 7 based on the evaluation of the UGC 7 by the user and the review results of the review process for the UGC 7; and (2) an evaluation of the review user 3 who reviewed the UGC 7 based on the evaluation of the UGC 7 by the operator 8 of the game system 1000 and the review results of the review process for the UGC 7. It is also possible to omit one of these processes.

[0117] The Review Personal Information Management Department 226 manages Review Personal Information 644 (see Figure 5), which includes at least the review experience and / or review level, for each Review User 3 (for each of the 2 users who have been selected as Review User 3), and modifies the Review Personal Information 644 based on the evaluation results of the Review User Evaluation Process.

[0118] The market management unit 230 performs various controls related to the use of UGC7 via the content market. Specifically, the market management unit 230 includes a UGC selection screen control unit 232 and a UGC usage control unit 234.

[0119] The UGC selection screen control unit 232 displays the content market's UGC selection screen W4 (see Figure 2) on the user terminal 1500. Specifically, it controls the display order of UGC7 on the UGC selection screen W4 based on the review results. For example, it may display them in descending order of the number of "passed" reviews among the review results for each reviewing user. In a configuration where pre-distribution review is based on a point system, it may display them in descending order of the points earned.

[0120] The UGC utilization control unit 234 controls the user to make available to user 2 the UGC7 selected by user 2 from among the UGC7 presented on the screen.

[0121] The reward granting unit 240 grants rewards to the reviewing user based on the evaluation results of the reviewing user evaluation process.

[0122] The timing unit 280s uses the system clock to perform various timing operations, such as determining the current date and time and the time limit.

[0123] The sound generation unit 290s is implemented by executing ICs and software that generate and decode audio data, generating or decoding audio data such as operation sounds, sound effects, background music, and voice calls related to the system management of the server system 1100, the creation of UGC7, and the provision of online games. Audio signals related to system management are then output to the sound output unit 390s. The sound output section 390s is implemented by a speaker or the like and emits sound based on the audio signal.

[0124] The image generation unit 292s generates images for various management screens for the system management of the server system 1100 and outputs the image data to the image display unit 392s. The image display unit 392s is implemented using a device that displays images, such as a flat panel display, a head-mounted display, or a projector. The image generation unit 292s also generates various images related to the UGC7 creation service, gameplay, and content market. For example, for images related to gameplay, it may also render game space images captured by a virtual camera, which are the source of the game images displayed on each user terminal 1500.

[0125] The communication control unit 294s performs data processing related to data communication and enables data exchange with external devices via the communication unit 394s. The communication unit 394s connects to the network 9 to enable communication. This can be achieved by, for example, a wireless communication device, a modem, a TA (terminal adapter), a jack or control circuit for a wired communication cable, etc. In the example in Figure 1, the communication device 1153 corresponds to this.

[0126] The server storage unit 500s stores programs and various data necessary to enable the server processing unit 200s to comprehensively control the server system 1100. It also serves as a workspace for the server processing unit 200s, temporarily storing calculation results performed by the server processing unit 200s according to various programs. This function can be implemented using, for example, IC memory such as RAM or ROM, magnetic disks such as hard disks, optical disks such as CD-ROMs or DVDs, or online storage. In the example shown in Figure 1, this corresponds to the storage media such as the IC memory 1152 and hard disk mounted on the main unit 1101. Online storage may also be included in the server storage unit 500s.

[0127] Figure 11 shows an example of programs and data stored in the server storage unit 500s. In this embodiment, the server storage unit 500s stores a server program 501, a distribution client program 503, game initial setup data 510, bonus definition data 512, user information 600 (see Figure 3), registration application acceptance data 700, review control data 710, UGC registration data 720, play data 750, content market control data 760, UGC creation service control data 770, and the current date and time 900. The server storage unit 500s also stores other programs and data (for example, timers, counters, various flags, etc.) as appropriate.

[0128] The server program 501 is a program that, when read and executed by the server processing unit 200s, causes the server system 1100 to function as a user information management unit 202, a game management unit 204, and a UGC provision control unit 210.

[0129] The distribution client program 503 is the original client program that is provided to and executed on the user terminal 1500.

[0130] The game initial settings data 510 stores various definition data and initial settings data related to the parent content, the online game.

[0131] Reward definition data 512 is prepared for each type of reward to be given as compensation to user 2 who performed pre-distribution review as review user 3. Each reward definition data 512 stores in association the application requirements, which are the conditions that must be met for the definition data to apply, and data indicating the content of the reward.

[0132] The application requirements for the benefit definition data 512 can be set as appropriate. For example, they could be "the latest value of the review user evaluation 642 is equal to or greater than the threshold value" or "every time the review user evaluation 642 reaches 100 × N (where N is a natural number) points." For example, they could be "every time the review user evaluation 642 maintains a value of 100 points or more for M days (where M is a natural number)." Alternatively, the conditions could be described by the number of pre-distribution reviews.

[0133] The bonus content can be configured as needed, including: a) content usable in the parent content (e.g., in-game currency, items and skins that can be equipped to player character 4), b) package data or software that extends some functionality to software such as plugins and add-ons usable in the UGC creation service, c) filters for image processing and speech synthesis, and d) material data such as images and audio.

[0134] Registration application acceptance data 700 is created each time user 2 submits a registration application to publish and distribute UGC7 on the content marketplace, following the prescribed registration application procedure. In other words, registration application acceptance data 700 is created each time UGC7 is provided by the provider user.

[0135] One registration application acceptance data 700 includes, for example, a unique acceptance ID 701, an acceptance date and time 702, a provider user account 703 indicating the user 2 who submitted the registration application (the provider user who provided the UGC7, the creator user of the provided UGC7), acceptance UGC data 705 which is the data of the UGC7 itself and is computer-readable data, UGC attributes 707 of the UGC7, and UGC creation information 709. Of course, other data, such as the title and description of the UGC7, can also be included as appropriate.

[0136] UGC creation information 709 is information about the circumstances and environment in which the UGC7 was created. For example, this includes the date and time of completion, the length of time required for creation, the time of day when it was created, the location of creation (e.g., region, country, home / office classification, etc.), and information about the tools used for creation (software, tools, creation environment, etc.). This information will be declared and entered by the provider user 2x (see Figure 2) on the application screen when submitting the registration application.

[0137] Returning to Figure 11, the review control data 710 stores various data related to the pre-distribution review. The review control data 710 includes, for example, a review target reception ID 711 (corresponding to reception ID 701 in Figure 12) indicating the review target, a candidate user account list 713 indicating candidate users 2k for selecting review user 3, a candidate user sort point 714, a review user account list 715 indicating the selection result of review user 3, a review result 716 for each review user, and an overall review result 717, as shown in Figure 13. Of course, other data can also be included as appropriate.

[0138] Returning to Figure 11, UGC registration data 720 is prepared for each UGC7 that has passed the pre-distribution review and become available for publication and distribution on the content market, and stores various data related to that UGC7. One UGC registration data 720 includes, for example, a unique UGC registration ID 721, registration date and time 723, provider user account 725, registered UGC data 727, registered UGC attributes 728, and usage evaluation summary data 730, as shown in Figure 14. Of course, other data can also be included as appropriate. For example, icon data for displaying UGC7 as an option on the content market, text data of an introductory description about UGC7, usage restriction information such as the age of user 2, and usage charges can also be included as appropriate.

[0139] The usage evaluation aggregate data 730 is accumulated data of user evaluations, i.e., usage evaluations, that arose from users (users) who used the UGC7, such as viewing, reading, or using the UGC7 in games. In this embodiment, the usage evaluation includes the invalid evaluation history data 732, which is a history of invalid evaluations (see Figure 7) entered by user 2c. One invalid evaluation history data 732 is stored, for example, by associating the evaluation date and time with the account of the evaluating user.

[0140] Returning to Figure 11, the play data 750 is created each time the online game is played and stores various data describing the latest play status and game progress. Since the online game is the parent content in this embodiment, the play data 750 can also be said to be parent content provision management data. If the parent content is video distribution, then the control related to the control of the video distribution site will be stored in the play data 750.

[0141] Content market control data 760 is created each time user 2 uses the content market and stores various data describing the latest usage status.

[0142] The UGC creation service control data 770 is created when user 2 uses the UGC creation service and stores various related data. For example, one UGC creation service control data 770 stores the user account that identifies the user and the UGC save data being created. Of course, other data can also be included as appropriate.

[0143] Figure 15 is a functional block diagram showing an example of the functional configuration of the user terminal 1500. The user terminal 1500 comprises an operation input unit 100, a terminal processing unit 200, an audio output unit 390, an image display unit 392, a communication unit 394, and a terminal storage unit 500.

[0144] The operation input unit 100 outputs operation input signals to the terminal processing unit 200 in response to various operation inputs made by the user 2. This can be achieved, for example, by a push switch, joystick, touchpad, trackball, accelerometer, gyroscope, etc.

[0145] The terminal processing unit 200 is implemented by, for example, a microprocessor such as a CPU or GPU, and electronic components such as IC memory, and controls data input and output with each functional unit, including the operation input unit 100 and the terminal storage unit 500. It then controls the operation of the user terminal 1500 by executing various calculation processes based on predetermined programs and data, operation input signals from the operation input unit 100, and various data received from the server system 1100.

[0146] Furthermore, the terminal processing unit 200 in this embodiment includes a client control unit 260, a timing unit 280, a sound generation unit 290, an image generation unit 292, and a communication control unit 294.

[0147] The client control unit 260, as a client control in the game system 1000, performs various controls to enable the user terminal 1500 to function as an MMIF (Man-Machine Interface). Specifically, the client control unit 260 includes an operation input information provision unit 261 and a display control unit 262.

[0148] The operation input information provision unit 261 controls the transmission of operation input information to the server system 1100 in response to input from the operation input unit 100.

[0149] The display control unit 262 performs control to display various images based on data received from the server system 1100.

[0150] The timing unit 280 uses the system clock to determine the current date and time, the time limit, and other time information.

[0151] The sound generation unit 290 is implemented by, for example, a digital signal processor (DSP), a processor such as a speech synthesis IC, and an audio codec capable of playing audio files. It generates sound signals for music, sound effects, and various operation sounds and outputs them to the sound output unit 390. The sound output unit 390 is implemented by a device such as a speaker that outputs sound (emits sound) based on the sound signals input from the sound generation unit 290.

[0152] The image generation unit 292 generates and outputs an image signal that displays an image to the image display unit 392 based on the control of the client control unit 260. In the example in Figure 1, this corresponds to a GPU (Graphics Processing Unit), graphics controller, graphics board, etc., mounted on the control board 1550. The image display unit 392 is implemented by a device that displays images, such as a flat panel display, head-mounted display, or projector.

[0153] The communication control unit 294 performs data processing related to data communication and enables data exchange with external devices via the communication unit 394. The communication unit 394 connects to the network 9 to enable communication. This can be achieved by, for example, a wireless communication device, a modem, a TA (terminal adapter), a jack or control circuit for a wired communication cable, etc. In the example in Figure 1, the communication module 1553 corresponds to this.

[0154] The terminal memory unit 500 stores programs and various data necessary for the terminal processing unit 200 to implement a given function. It is also used as a workspace for the terminal processing unit 200, and temporarily stores calculation results performed by the terminal processing unit 200 according to various programs, as well as input data received from the operation input unit 100. These functions are realized by, for example, IC memory such as RAM or ROM, magnetic disks such as hard disks, and optical disks such as CD-ROMs or DVDs. In the example in Figure 1, the IC memory 1552 mounted on the control board 1550 corresponds to this.

[0155] Specifically, the terminal storage unit 500 stores a client program 504 (application program) for causing the user terminal 1500 to function as a client control unit 260, and the current date and time 900. Of course, other data can also be stored as needed.

[0156] Figures 16 and 17 are flowcharts illustrating the processing flow in the server system 1100. As shown in Figure 16, when the user terminal 1500 inputs an operation to start using a predetermined UGC creation service (YES in step S10), the server system 1100 performs control to provide the UGC creation service, i.e., UGC creation control (step S12).

[0157] Specifically, the server system 1100 sells service usage rights for each UGC attribute of UGC7 and creates UGC creation service usage right ownership data 614 (see Figure 3) in the user information 600 of the user who purchased the service. Then, it provides the UGC creation service for the UGC attribute related to the usage right. For example, user 2, who owns the usage right for the service to create a video with the UGC attribute, is made able to use a web application with video editing functions for creating videos on the user terminal 1500. The latest usage status, data of UGC7 that is being worked on or has been completed, and additional function information such as plugins and add-ins being used are stored in the UGC creation service control data 770.

[0158] User 2 who wishes to publish and distribute the UGC7 they created (i.e., the creator user who wishes to provide the UGC7 they created via the game system 1000 to other user 2) performs the prescribed registration application start operation on the user terminal 1500 to become both the applicant user and the provider user of the UGC7.

[0159] When the server system 1100 detects a registration application start operation (YES in step S14), it displays a predetermined registration application screen on the user terminal 1500 that detected the operation and accepts the necessary information for provision (for example, the title of UGC7, the description, the creator's name, the specification of UGC attributes, the content that will become UGC creation information 709, etc.) and data. Specifically, the server system 1100 accepts the necessary information for provision, such as the user account of the applicant user (provider user) who submitted the registration application (step S16), and accepts the data of the UGC7 to be registered (step S18). Then, it sets the UGC attributes of the accepted UGC7 (step S20) and creates registration application acceptance data 700 (step S22; see Figure 12).

[0160] Then, the server system 1100 executes the process of selecting a review user for the UGC7 received in the registration application, which will be subject to pre-distribution review (step S24).

[0161] Figure 18 is a flowchart illustrating the flow of the user selection process. In the review user selection process, the server system 1100 sets the user account of user 2 whose review officer approval flag 610 is "1" from among all registered users 2 in the candidate user account list 713, and sets it as the initial candidate user 2k for review user 3 (step S40; see Figure 6).

[0162] Next, the server system 1100 excludes user 2 whose ineligible flag 670 is "1 (indicates ineligibility)" from the candidates (step S42), and excludes user 2 whose review user evaluation 642 is below a predetermined standard value from the candidates (step S44).

[0163] Furthermore, the server system 1100 excludes from the candidate users 2k any user 2 whose review user evaluation 642 (see Figure 3), number of review experience (number of review experience data 650 in Figure 5), or review level 658 is lower than that of the provider user (step S46).

[0164] Next, the server system 1100 refers to the provider user's friend list 607 and excludes user 2 who is friends with the user from the candidates (step S48), and excludes user 2 who meets a predetermined age restriction from the candidate users 2k (step S50).

[0165] Furthermore, in steps S42 to S50, before performing the exclusion, it is determined whether the planned number of candidate users 2k remaining after exclusion is less than the number of users 3 selected for review. If it is less than that, the exclusion will not be performed.

[0166] Next, the server system 1100 initializes the sort points associated with each of the remaining 2k candidate users to "0" (step S52), and executes loop A for each of the 2k candidate users to calculate the sort point for each of the 2k candidate users (steps S60 to S68). The server system 1100 calculates the sort points based on the data in the user information 600 that corresponds to the suitability indicators for review.

[0167] In loop A, the server system 1100 first adds points corresponding to the number of UGC attributes 707 of the UGC subject to pre-distribution review and the number of UGC registration application history data 620 for the same UGC attribute to the sort points of the 2k candidate users to be processed (step S62).

[0168] Next, the server system 1100 adds points corresponding to the number of UGC attributes 707 of the UGC subject to pre-distribution review and the number of UGC usage history data 630 for the same UGC attribute to the sort points of the 2k candidate users to be processed (step S64).

[0169] Next, the server system 1100 compares the provider user's hobby and preference declaration data 605 with the hobby and preference declaration data 605 of the candidate users 2k targeted for loop A processing, adds sort points according to the number of matching hobbies and preferences (step S66), and terminates loop A (step S68).

[0170] Then, after executing Loop A for all candidate users 2k, the server system 1100 selects a predetermined number of candidate users 2k from the top of the sum of sort points. The selected predetermined number of candidate users 2k are then ranked according to their respective review user evaluations 642 (step S70), and a predetermined number of the top-ranked users are determined to be review users 3 (step S72).

[0171] Step S70 may also rank candidates based on personal audit information 644, in addition to or instead of the audit user evaluation 642. Specifically, candidates can be ranked based on the number of audit experience data 650, or on the level of their audit level 658.

[0172] Returning to Figure 16, the server system 1100 then performs the pre-distribution review process (step S72).

[0173] Figure 19 is a flowchart illustrating the flow of the pre-distribution review process. In the pre-distribution review process, the server system 1100 communicates with the user terminal 1500 of the review user 3, displays a review screen on the user terminal 1500, and outputs the UGC to be reviewed in a format corresponding to its registered UGC attribute 728 (step S80). For example, if the UGC to be reviewed is a video, the review screen is played so that the review user 3 can view it.

[0174] Next, the server system 1100 receives input of the review results for each review user 3 and stores the review results 716 for each review user (step S82; see Figure 13). It then adds predetermined points as rewards / review compensation to the review user evaluation 642 of each review user 3 and updates the review personal information 644 based on the review user evaluation 642 after the addition (step S84). In other words, it creates review experience data 650 and updates the review level 658.

[0175] The server system 1100 then determines the overall review result 717 from the individual review results 716 (step S86) and notifies the provider user (registration applicant user) of the overall review result 717 (step S88). The notification method can be set as appropriate. For example, a bulletin board may be set up on a designated website and the notification may be made there, or an email notification may be sent to the email address declared during user registration.

[0176] Next, the server system 1100 adds the UGC registration application history data 620 to the content experience information 618 of the provider user's user information 600 (step S90; see Figure 4). Next, if the overall review result 717 is "passed" (YES in step S92), the server system 1100 adds the provided UGC7 to the distribution target (step S94). This creates new UGC registration data 720, and the content market that references this registration data can now use and provide this newly approved UGC7.

[0177] Next, when the server system 1100 detects input of a predetermined market usage start operation on the user terminal 1500 (YES in step S110), it displays the UGC selection screen W4 of the content market on the user terminal 1500, and presents UGC7, which has UGC registration data 720, as an option to be used (step S112).

[0178] The display order of UGC7 (icons) on the UGC selection screen W4 in step S112 can be set as appropriate. For example, it may be set to alphabetical order of the UGC7 title, alphabetical order of Japanese syllabary, order of usage history, order of registration date and time, or order of user usage rating. Alternatively, the display order may be determined based on the results of the pre-distribution review of the UGC7. For example, it may be set in descending order of the number of reviewing users 3 who judged it as "approved". If the pre-distribution review is a scoring system in which reviewing users 3 score the appropriateness of the content to be published and distributed, the display order may be determined by the total score.

[0179] Next, the server system 1100 receives the selection input of UGC7 that the user (user 2 who entered the market usage start operation) wants to use (step S114), adds UGC usage history data 630 to the content experience information 618 of the user information 600 of the user (step S116; see Figure 4), and executes the usage start process for the selected UGC7 (step S118).

[0180] In step S118, specifically, the server system 1100 plays the video on the user terminal 1500 if the selected UGC7 is a video, and outputs the sound if it is music or audio. If it is an illustration, it displays it, and if it is an item or skin usable by the player character 4, it adds them to the game save data 609 (see Figure 3).

[0181] Moving on to Figure 17, the server system 1100 then displays the unsuitable evaluation input screen on the user terminal 1500 if it receives input for a predetermined unsuitable evaluation start operation (YES in step S130) (step S132).

[0182] On the ineligible evaluation input screen, for example, the user's UGC usage history data 630 is referenced, and a list of UGC7 to be evaluated is displayed. User 2 selects one of the UGC7 they deem ineligible from the list. A selection field may be provided asking for the reason why they deem it ineligible (for example, they believe it infringes on other copyrights, the quality of the content is too poor, it contains defamation, etc.), and the user may be asked to input their reason.

[0183] Furthermore, the UGC7 listed as candidates for evaluation in step S132 may be limited to UGC7 that have been available on the content market for a predetermined amount of time (for example, UGC7 whose elapsed time from registration date 723 (see Figure 14) to the current date 900 has reached a predetermined length). In this case, it is possible to prevent situations in which the UGC7 is deemed unsuitable before it has become widely known and available to many users 2.

[0184] The server system 1100 stores the input results on the ineligible evaluation input screen as ineligible evaluation history data 732 (see Figure 14) (step S134), and executes the distribution withdrawal process (step S136).

[0185] Figure 20 is a flowchart illustrating the process of withdrawing distribution. In the distribution withdrawal process, the server system 1100 executes loop B for all UGC7 registered as targets for publication and distribution (steps S150 to S168).

[0186] In Loop B, the server system 1100 calculates the cumulative number of unsuitable evaluations for the UGC7 to be processed. If this number reaches a predetermined threshold (YES in step S152), it deletes the UGC registration data 720 (see Figure 14) of the UGC7 to be processed, thereby deleting and canceling its registration as an object for publication and distribution (step S154). In addition, a step may be added in step S154 to request the operator 8 to input a final decision on whether to proceed with deletion or postpone deletion, and the operator may follow this decision.

[0187] Next, the server system 1100 executes loop C for each review user 3 that has pre-reviewed the UGC7 that is to be processed in loop B (steps S156 to S166). In loop C, the server system 1100 searches the review experience data 650 (see Figure 5) stored in the review personal information 644 of review user 3, which is the target of processing in loop C, for historical data in which the review UGC registration ID 654 matches the registration ID of UGC 7, which is the target of processing in loop B, and refers to the review result 656 for that review user.

[0188] Then, if the referenced review user's review result 656 is "pass" (pass in step S158), the server system 1100 considers that the review user 3 has previously performed an incorrect pre-distribution review, deducts points from the review user evaluation 642 of the review user 3 (step S160), and terminates loop C (step S166).

[0189] In other words, step S160, which is executed as step S136, is a step in which the user 2c evaluates the use of the UGC (evaluation of its suitability) and the results of the review process for the UGC 7 (review results by review user 656), and then evaluates the review user 3 who reviewed the UGC 7.

[0190] If loop C has been executed for all three review users who performed the pre-distribution review of UGC7 which is the target of processing in loop B, then loop B is terminated (step S168). Then, once the server system 1100 has executed loop B for all UGC7 registered for publication and distribution, it terminates the withdrawal process.

[0191] Returning to Figure 17, the server system 1100 then, if it receives an input to start an unsuitable evaluation (YES in step S170), displays an unsuitable evaluation input screen for operator 8 (step S172). The unsuitable evaluation input screen for operator 8 includes, for example, a list for selecting the UGC7 to be evaluated, and input fields for the reasons why it is evaluated as unsuitable (for example, it is thought to infringe on other copyrights, the quality of the work as content is too poor, it contains defamation, etc.).

[0192] Furthermore, the UGC7 listed as candidates for evaluation in step S172 may be limited to UGC7 that have been available on the content market for a predetermined amount of time (for example, UGC7 whose elapsed time from registration date 723 (see Figure 14) to the current date 900 has reached a predetermined length). In this case, it is possible to prevent the operator 8 from evaluating the UGC7 as unsuitable before it has had a proper evaluation period.

[0193] The server system 1100 stores the input results on the ineligible evaluation input screen for operator 8 as ineligible evaluation history data 732 (see Figure 14) (step S174), and executes the distribution withdrawal process (step S176).

[0194] Next, when the server system 1100 receives a direct evaluation start operation from a designated review user (YES in step S190), it displays a direct evaluation input screen (step S192). This input screen may include a list for selecting the review user 3 to be evaluated, an input field for entering the increase or decrease in the review user evaluation 642, a selection field for selecting the reason for the evaluation, and a list for selecting the UGC 7 that served as the reason for the evaluation.

[0195] Based on the input results on the input screen, the server system 1100 modifies the review user evaluation 642 of the review user 3 that was selected for evaluation (step S194), and notifies the review user 3 that was selected for evaluation of the evaluation result (the increase or decrease in the review user evaluation 642, the reason for the evaluation, and the UGC 7 that served as the reason for the evaluation) (step S196). For example, the notification may be sent to a pre-registered email address, or it may be displayed when the review user 3 logs in.

[0196] Next, for each user 2 who has experienced being a review user 3, the server system 1100 searches the reward definition data 512 (see Figure 11) for definition data in which the user's review user evaluation 642 satisfies the review user evaluation requirements, and grants the user 2 a reward according to the reward content associated with that review user evaluation requirement (step S200).

[0197] Next, the server system 1100 searches for each of the users 2 who have experience as review users 3, and for each user 2 who meets the predetermined criteria for being unsuitable as a review officer (for example, the review user evaluation 642 falls below a predetermined lower limit), and sets the unsuitable person flag 670 of that user 2 to "1 (suitable as a review officer)" (step S202).

[0198] In summary, this embodiment provides a technology useful for reviewing UGC7.

[0199] In other words, the game system 1000 can select a review user 3 from among the users 2 and have them review the UGC 7 received from the provider user. By having the review user 3 conduct the review, the human and time costs that the system operator 8 previously required to review UGC 7 can be reduced. In addition, by selecting the review user 3 from among the users 2, the review can be conducted using the review criteria that general users have in mind, compared to when the operator 8 reviews UGC 7.

[0200] [Variation] Although an example of an embodiment to which the present invention is applied has been described above, the forms to which the present invention can be applied are not limited to the above-described form, and components can be added, omitted, or modified as appropriate.

[0201] (Variation 1) In the above embodiment, an example was shown where the parent content was an online game, but the parent content is not limited to online games. For example, the parent content may be a video, music, audio, still image, or text such as a novel. If the parent content has the status of an original work, that original work may be used as the parent content. Also, there may be no parent content, and UGC7 (7a, 7b, ...) may be a primary work. For example, a video work created by user 2 may be used as UGC7.

[0202] (Variation 2) In addition to the functional configuration of the server system 1100 of the above embodiment, it is also possible to add an automated review unit 242, which has been trained to learn the criteria for publication and distribution, as shown in Figure 21, and to utilize the review results of UGC7 by the automated review unit 242.

[0203] The automated review unit 242 manages, for example, a first database 801 (see Figure 22) containing image data and audio data deemed to violate public order and morals, compares it with UGC7 to determine the degree of similarity, and if the degree of similarity is above a certain threshold, it is deemed to be a suspected violation of public order and morals and the review result is "failed". The automated review unit 242 also manages a second database 802 (see Figure 22) containing, for example, image data and audio data published on the internet, compares it with UGC7 to determine the degree of similarity, and if the degree of similarity is above a certain threshold, it is deemed to be a suspected copyright infringement and the review result is "failed". Alternatively, the automated review unit 242 may be implemented as an AI that performs reviews equivalent to those of review user 3 using machine learning.

[0204] Furthermore, in the review by review user 3, specifically in step S86 (see Figure 19), the overall review result 717 may be determined by combining the review user-specific review result of review user 3 with the review result of the automated review unit 242.

[0205] Furthermore, the results of the automated review unit 242 may be used to modify the review user evaluation 642. Specifically, for example, the entity responsible for the non-qualification evaluation from step S130 to step S136, or the entity responsible for the non-qualification evaluation from step S170 to step S176, may be replaced by the automated review unit 242. Alternatively, for example, a step may be added before step S160 in which the automated review unit 242 reviews the UGC7 that is the target of processing in loop B, and step S160 may be executed only if the review result of the automated review unit 242 is also "failure". In other words, in this configuration, the deduction in step S160 is executed only if the automated review unit 242 also determines that it is "failure".

[0206] (Variation 3) Furthermore, in the above embodiment, as an example of the review user evaluation process, steps S130 to S136 (see Figure 17) show an example in which the review user 3 who reviewed the UGC 7 is evaluated based on the user evaluation of "ineligible evaluation" by user 2c and the review results regarding the UGC 7c, but the embodiment is not limited to this.

[0207] For example, this could be replaced with a process that evaluates the user who reviewed the UGC based on a unique usage evaluation when predetermined usage evaluation determination conditions are met that can uniquely determine the usage evaluation of UGC7, and the review results of the review process related to the UGC.

[0208] It is rare for multiple users to give the same rating. Ratings vary from user to user, resulting in a wide range of usage ratings. The conditions for drawing a single conclusion from these various usage ratings are the "predetermined usage rating determination conditions." This single conclusion becomes the "unique usage rating."

[0209] For example, the user evaluation can be entered as either a "Good" or "Bad" choice, or as a score, and the input results of the user evaluation are stored separately for each UGC7 as aggregated user evaluation data 730 (see Figure 14) of the UGC registration data 720. Then, the server system 1100 uniquely determines the user evaluation for a UGC7 that has been registered for a predetermined time or that has reached a predetermined number of user evaluations, if the aggregated user evaluation data 730 meets predetermined user evaluation determination conditions. For example, if the user evaluation determination condition is "80% of the accumulated user evaluations are 'Good' or the average evaluation score is 3 or higher out of 5 points," then the user evaluation for that UGC7 is uniquely determined to be "Eligible." Then, the review user 3 who reviewed the UGC7 is evaluated based on this unique user evaluation and the review results of the review process for that UGC.

[0210] (Variation 4) The above embodiment may be modified to include an element for selecting the review user 3 using UGC creation information 709 (see Figure 12). For example, in step S72 (see Figure 18), the review user evaluation ranking when selecting candidate users 2k as review user 3 may be set so that UGC 7 with longer creation times are ranked higher, and the review user 3 may be selected accordingly.

[0211] For example, the above embodiment may be modified to include a feature that selects a candidate user 2k, whose activity time is similar to that of provider user 2x, as the review user 3. For example, the activity time of candidate user 2k is estimated by referring to the registration application date and time 622 and usage date and time 632 in the content experience information 618 (see Figure 4) of candidate user 2k. Then, in the processing of loop A in Figure 18, a step is added to add sort points based on the activity time corresponding to the creation date and time included in the UGC creation information 709 of the UGC to be reviewed. In this case, for example, UGC 7 created at night is more likely to be selected by a review user 3 who is active at night, and a faster review can be expected.

[0212] For example, user information 600 (see Figure 3) may include the user's place of residence information (e.g., region, administrative district, address, etc.), and UGC creation information 709 (see Figure 12) may include information about the location where UGC 7 was created (e.g., region, country, home / office classification, etc.). Then, in the processing of loop A in Figure 18, a step is added to add higher sort points the closer the location indicated by the place of residence information is to the location where it was created. In this case, it becomes easier to select a review user 3 whose place of residence is close to the region, country, and location where UGC 7 was created, and a quicker review can be expected. Of course, from the opposite perspective, a step may also be added to add higher sort points the further away the location where UGC 7 was created is from the residence of review user 3.

[0213] For example, the UGC creation information 709 (see Figure 12) may include information about the tools used for creation. Then, in the processing of loop A in Figure 18, a step is added in which the UGC creation information 709 of the registration application acceptance data 700, where the candidate user 2k being processed was the provider user 2x, is compared with the UGC creation information 709 of the UGC under review, and higher sort points are added for each user who has used the same tools to submit registration applications for UGC 7. In this case, review user 3, who has used the same tools and is therefore familiar with the techniques used to create UGC, is more likely to be selected, thus allowing for a more appropriate review. [Explanation of Symbols]

[0214] 2: User 3: Reviewing Users 8: Operator 200s: Server Processing Unit 202: User Information Management Department 203: Relations Management Department 210: UGC Provisioning Control Unit 212: UGC Creation Control Unit 214: Reception Department 216: Review User Selection Department 218: Review and Control Section 220:Decision Department 222: Examination Result Notification Control Unit 224: Review and User Evaluation Department 226: Review and Personal Information Management Department 230: Market Management Department 232: UGC Selection Screen Control Unit 234: UGC usage control section 240: Special Offer Department 242: Automated Review Department 500s: Server storage unit 501: Server Program 512: Bonus Definition Data 600: User Information 601: User Account 607: Friend List 618: Content Experience Information 620: UGC registration application history data 630: UGC usage history data 642: Review User Rating 644: Review Personal Information 650: Review experience data 656: Review results by user 658: Review Level 700: Registration application acceptance data 705: Received UGC data 707 :UGC attribute 710: Review control data 713: Candidate User Account List 715: Review User Account List 716: Review results by user 717: Overall Judging Results 720: UGC registration data 730: Usage evaluation summary data 732: Disqualification evaluation history data 760: Content Market Control Data 770: UGC creation service control data 1000: Game System 1100: Server System 1500: User terminal

Claims

1. A computer system that provides User Generated Content (UGC) received from a provider user to multiple users by communicating with each user terminal as prescribed, A receiving means for receiving the UGC from the provider user, A means for selecting review users from among the aforementioned users, A review control means that communicates with the user terminal of the review user and controls the execution of a review process in which the review user reviews the received UGC received by the reception means, A computer system equipped with the following features.

2. User information management means for managing user information, including content experience information related to the use and / or creation of the aforementioned UGC, for each user, Furthermore, The aforementioned user selection means selects the user using the content experience information. The computer system according to claim 1.

3. The aforementioned user selection means further selects the user using the attributes of the received UGC. The computer system according to claim 2.

4. The aforementioned user selection means further selects the user using the information created by the received UGC. The computer system according to claim 2 or 3.

5. The user selection means further selects the user for review using the content experience information of the provider user. The computer system according to any one of claims 2 to 4.

6. Relationship management means for managing relationships between users, Furthermore, The aforementioned user selection means selects the user for review based on the relationships between the users relating to the provider user. The computer system according to any one of claims 1 to 5.

7. A user evaluation control means for controlling the execution of a user evaluation process that evaluates the user based on the evaluation results, A computer system according to any one of claims 1 to 6, further comprising:

8. The review user evaluation control means executes the review user evaluation process after a predetermined time has elapsed since the provision of the received UGC reviewed in the review process began. The computer system according to claim 7.

9. The aforementioned user evaluation process is a process that evaluates the user who reviewed the UGC based on the user's evaluation of the UGC and the review results of the aforementioned review process regarding the UGC. The computer system according to claim 7 or 8.

10. The aforementioned user evaluation process is a process that evaluates the user who reviewed the UGC based on the unique user evaluation when predetermined user evaluation determination conditions that can uniquely determine the user evaluation are met, and the review results of the review process regarding the UGC. The computer system according to claim 9.

11. The aforementioned user evaluation process is a process that evaluates the user who reviewed the UGC based on the evaluation of the UGC by the operator of the computer system and the review results of the aforementioned review process regarding the UGC. The computer system according to claim 7 or 8.

12. A means for managing personal review information, which includes at least review experience and / or review level for each review user, and modifies the personal review information based on the evaluation results of the review user evaluation process. Furthermore, The aforementioned screening user selection means selects the screening user using the aforementioned screening personal information. The computer system according to any one of claims 7 to 11.

13. A reward granting means that grants a reward to the review user based on the evaluation result of the review user evaluation process, A computer system according to any one of claims 7 to 12, further comprising:

14. The aforementioned benefits are information that can be used when creating the aforementioned UGC. The computer system according to claim 13.

15. A means for determining whether or not to provide the received UGC based on the results of the aforementioned review, A computer system according to any one of claims 1 to 14, further comprising:

16. A UGC selection screen control means for controlling the display of the UGC selection screen for the provision of the UGC on the user terminal, the UGC selection screen control means for controlling the display order of the UGC based on the review result, A computer system according to any one of claims 1 to 15, further comprising:

17. A server system which is a computer system according to any one of claims 1 to 16, The user terminal and, A content delivery system equipped with the following features.

18. A content provision method in which a computer system provides User Generated Content (UGC), which is computer-readable content received from a provider user, to multiple users by communicating with each user terminal as prescribed, Receiving the aforementioned UGC from the provider user, Select a review user from among the aforementioned users, To communicate with the user terminal of the aforementioned review user and control the execution of the review process in which the review user reviews the received UGC, The results of the aforementioned review process shall be made public to at least the provider user, Content delivery methods including those mentioned above.

Images