Information processing apparatus, program for information processing apparatus, and program for terminal apparatus

Abstract

To provide a technique which can dynamically change performance in an event in response to cheering for a cheer object and development of music.SOLUTION: The present invention is directed to an information processing apparatus which can be connected through a communication network to a terminal device capable of being operated by a user and displaying an image and which can output data to a display device. The information processing apparatus has an acquiring unit for acquiring gift information transmitted from the terminal device in response to a predetermined input operation during reproduction of musical piece data forming a plurality of sections, a collecting unit for collecting gift information acquired during a first section of the plurality of sections during reproduction of the musical piece data, and a display control unit for displaying a performance image in response to collected values of the gift information collected during the first section in a second section immediately succeeding the first section. Thus, the information processing apparatus solves the problem.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing device-side program, and a terminal device-side program. [Background technology]

[0002] Conventionally, various methods have been devised to enhance the atmosphere of events such as concerts and live performances. For example, methods such as displaying images on a large display in time with the music or changing the color or lighting pattern of spotlights are known.

[0003] As a technology related to such production, for example, a user-participation event production system has been disclosed (for example, Patent Document 1). This event production system provides a production that can enhance the sense of unity between participants and artists by using image data (photos) and sound data (singing voices) uploaded to a server in advance by concert participants in the production of the concert. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-016442 Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, at events such as concerts and live performances, the main characters are not only people such as artists and performers, but also increasingly anime and game characters. When the cheering squad targets such as artists, performers, and characters start to perform, the audience waves glow sticks to cheer on the cheering targets as the song progresses, livening up the song.

[0006] However, in conventional events, the performances were set in advance by the organizers and were carried out based on a schedule, for example, but there was no performance that livened up the event venue in real time in accordance with the development of the music or the mood of the venue at that time. For example, as mentioned above, even in Patent Document 1, image data (photographs) and sound data (singing voices) uploaded to a server by concert participants in advance were used for the performance at the concert, and it was not possible to create a performance that changed according to the cheering situation of the audience during the performance.

[0007] The present invention provides a technique for dynamically changing the presentation of an event in accordance with cheering for a cheer target object and the progression of music. [Means for solving the problem]

[0008] An information processing device according to one aspect of the present invention is an information processing device that can be connected to a terminal device via a communication network, which can be operated by a user and display images, and can output to a display device, and is characterized by comprising: an acquisition unit that acquires gift information transmitted from the terminal device in response to a predetermined operation input while music data consisting of a plurality of sections is being played; a counting unit that tallys up the gift information acquired during a first section of the plurality of sections while the music data is being played; and a display control unit that displays a performance image in a second section that is the section after the first section, in accordance with the tally value of the gift information tallied during the first section.

[0009] In the above information processing device, the aggregation unit adjusts the aggregated value by weighting the values ​​corresponding to each of the gift information according to the length of the first section, and the display control unit changes the presentation form of the presentation image according to the weighted aggregated value of the gift information.

[0010] In the above information processing device, the first division and the second division are repeated while the music data is being played, and the display control unit is characterized in that, depending on the aggregated value of the gift information aggregated in the first division, it carries over part or all of the aggregated value in the first division that arrives after the second division.

[0011] In the above information processing device, the display control unit is further characterized in that it displays a gift object corresponding to the gift information transmitted in response to the operation input while moving the gift object as if it were flying toward the display object displayed on the display device, and changes the shape of the display object in response to the aggregate value of the gift information obtained in the first category.

[0012] The information processing device further includes a background color control unit that controls the background color of the screen displayed on the display unit of the terminal device in accordance with the development of the music being played, and the background color control unit synchronizes the background color based on lighting from a lighting device installed in the venue where the display device is installed, an object selected on the display unit of the terminal device, or location information transmitted from the terminal device.

[0013] The information processing device further includes a location information acquisition unit that acquires location information transmitted from the terminal device, and the display control unit is characterized in that it displays a gift object corresponding to the gift information in an area corresponding to the location information in the display area of ​​the display device based on the operation input.

[0014] The information processing device is further characterized by having a payment control unit that, when the gift information subject to billing is selected on the terminal device, switches between a first payment processing unit that performs payment processing based on the payment method entered on a payment method input screen that is displayed at the time the gift information is selected, and a second payment processing unit that performs payment processing based on a pre-registered payment method that has undergone credit screening, in response to the playback of the music data.

[0015] An information processing device-side program according to one aspect of the present invention is connectable via a communication network to a terminal device capable of user operation and image display, and causes an information processing device capable of outputting to a display device to execute an acquisition process for acquiring gift information transmitted from the terminal device in response to a predetermined operation input during playback of music data consisting of multiple sections, an aggregation process for aggregating the gift information acquired during a first section of the multiple sections during playback of the music data, and a display control process for displaying a performance image in a second section that is the section following the first section, in accordance with the aggregate value of the gift information aggregated during the first section.

[0016] A terminal device-side program according to one aspect of the present invention causes a terminal device that can be connected to an information processing device capable of outputting to a display device via a communication network and that can perform user operations and display images to execute a reception process for receiving a predetermined operation input to the terminal device while music data consisting of a plurality of sections is being played back, and a transmission process for aggregating gift information sent from the terminal device during a first section of the plurality of sections while the music data is being played back, and transmitting the gift information in accordance with the received operation input to an information processing device that displays a performance image in accordance with the aggregate value of the gift information obtained during the first section in a second section that is the section after the first section. [Effects of the Invention]

[0017] In the event, the presentation can be dynamically changed according to the cheering for the cheer target object and the development of the music. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a block diagram of an information processing system 1 according to the present embodiment. [Figure 2] FIG. 1 is a diagram showing an example of a network configuration of an event production system according to an embodiment of the present invention. [Figure 3]1 is a functional and configuration block diagram of an event production system according to an embodiment of the present invention. [Figure 4] 1 is a flowchart for explaining the overall flow of the present embodiment. [Figure 5] FIG. 10 is a sequence diagram of a pre-registration process (S1) in this embodiment. [Figure 6] FIG. 10 is a diagram showing an example of a touch payment setting screen displayed on a terminal device during the pre-registration process in this embodiment. [Figure 7] 10 is a diagram showing an example of the arrangement of two-dimensional barcodes indicating position information within an event venue in this embodiment. FIG. [Figure 8] 1A to 1C are diagrams for explaining an example of the structure and sections of music data in this embodiment. [Figure 9] 10 is a diagram showing an example of an image displayed on the display device when music data starts to be played in this embodiment. FIG. [Figure 10] 10 is a diagram showing an assistance operation input screen displayed on the terminal device when music data is played back in this embodiment. [Figure 11] 10A and 10B are diagrams showing an example of a presentation in which gift objects are displayed gathering around a display object and flying away according to position information in this embodiment. [Figure 12] 10 is a diagram showing an example of a special effect in an effect section in this embodiment. FIG. [Figure 13] FIG. 10 is a sequence diagram of a cheering operation in this embodiment. [Figure 14A] 10 is a flowchart (part 1) of Example 1 of the rendering process (S5) based on the section of music data by the server in this embodiment. [Figure 14B] 10 is a flowchart (part 2) of Example 1 of the rendering process (S5) based on the section of music data by the server in this embodiment. [Figure 15A] 10 is a flowchart (part 1) of Example 2 of the effect processing (S5) based on the section of music data by the server in this embodiment. [Figure 15B]10 is a flowchart (part 2) of Example 2 of the effect processing (S5) based on the section of music data by the server in this embodiment. [Figure 16] FIG. 10 is a sequence diagram showing how the terminal device in this embodiment functions as a glow stick and is synchronized with the lighting in the event venue. [Figure 17] 10 is a flowchart showing how the server in this embodiment causes the terminal device to function as a glow stick and synchronizes it with the lighting in the event venue. [Figure 18] FIG. 10 is a sequence diagram of a normal credit card payment process before or after playback of music data has ended, and a process based on pre-registered information for touch payment during playback of music data, in this embodiment. [Figure 19] 10 is a flowchart of a payment process in which the payment method is switched depending on the playback of music data in this embodiment. [Figure 20] FIG. 1 is a block diagram showing an example of the configuration of a hardware environment of a computer that executes a program according to this embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0019] 1 is a block diagram of an information processing system 1 according to this embodiment. The information processing system 1 includes a terminal device 2, an information processing device 3, and a display device 4. An example of the information processing system 1 is an event production system 11, which will be described later. An example of the terminal device 2 is a terminal device 12, which will be described later. An example of the information processing device 3 is a server 13, which will be described later. An example of the display device 4 is a display device 15, which will be described later.

[0020] The information processing device 3 is an information processing device that can be connected to a terminal device 2 via a communication network, which can be operated by a user and display images, and can output to a display device 4. The information processing device 3 includes an acquisition unit 3a, a counting unit 3b, and a display control unit 3c.

[0021] The acquisition unit 3a acquires gift information transmitted in response to a predetermined operation input from the terminal device 2 during playback of music data made up of a plurality of sections. An example of the acquisition unit 3a is an acquisition unit 34, which will be described later.

[0022] The counting unit 3b counts gift information acquired during a first section (for example, section A or section C, i.e., a non-effect section, described later) among a plurality of sections during playback of music data. An example of the counting unit 3b is the counting unit 35, described later.

[0023] The display control unit 3c displays a performance image in a second section (for example, section B, i.e., an effect section, described later) that follows the first section, according to the total value of the gift information tallied during the first section. An example of the display control unit 3c is the display control unit 36, described later.

[0024] By configuring it in this way, it is possible to dynamically change the presentation at the event venue in accordance with the cheering for the cheer target object and the development of the music.

[0025] The counting unit 3b may adjust the counted value by weighting the value corresponding to each piece of gift information according to the length of the first section. In this case, the display control unit 3c may change the presentation form of the presentation image according to the counted value of the weighted gift information.

[0026] By configuring it in this way, even if the first section is too short to obtain sufficient gift information, the aggregated value can be adjusted by weighting, so that the same effect as accumulating a certain number of gift information points can be obtained.

[0027] The first and second segments are repeated during playback of the music data. In this case, the display control unit 3c may carry over part or all of the total value of the gift information totaled in the first segment to the first segment that comes after the second segment, depending on the total value of the gift information totaled in the first segment.

[0028] By configuring in this way, it is possible to accumulate more gift information points in the next section, so that a more effective effect image can be generated and the excited atmosphere can be continued into the next effect section.

[0029] The display control unit 3c may further display the gift object corresponding to the gift information transmitted in response to the operation input while moving the gift object as if it were flying toward a display object (for example, a display object 72 described later) displayed on the display device. In addition, the display control unit 3c may change the form of the display object in accordance with the aggregate value of the gift information acquired in the first division.

[0030] This configuration makes it possible to express the effect of the display object changing in form as the gift object is absorbed into the display object, thereby improving the sense that the user himself has sent the gift object and the interactivity.

[0031] The information processing device 3 may further include a background color control unit 3d. The background color control unit 3d can control the background color of the screen displayed on the display unit of the terminal device 2 in accordance with the progress of the music being played. In this case, the background color control unit 3d may synchronize the background color based on lighting from a lighting device installed in the venue where the display device 4 is installed, an object selected on the display unit of the terminal device 2, or location information transmitted from the terminal device 2.

[0032] By configuring it in this way, the display screen of the terminal device 2 can have an effect similar to that of a glow stick, creating a sense of unity in the venue. It is also possible to synchronize lighting and adjust the background color depending on the location in the venue. This further enhances the sense of unity in the venue.

[0033] The information processing device 3 may further include a location information acquisition unit 3e. The location information acquisition unit 3e acquires location information transmitted from the terminal device 2. At this time, the display control unit 3c may display a gift object corresponding to the gift information in an area corresponding to the location information in the display area of ​​the display device 4 based on an operation input. An example of the location information acquisition unit 3e is the location information acquisition unit 37.

[0034] With this configuration, for example, when a user located on the right side of the display device 4 sends gift information, the gift object appears to be thrown from the right side toward the center of the display area of ​​the display device 4. This improves the feeling that the user himself sent the gift object and improves interactivity.

[0035] The information processing device 3 may further include a payment control unit 3f. When gift information for which billing is required is selected on the terminal device 2, the payment control unit 3f switches between a first payment process (first payment process S93 described later) and a second payment process (second payment process S95 described later) depending on the playback of music data. The first payment process is a payment process that performs payment processing based on a payment method entered on a payment method input screen that is displayed when the gift information is selected. The second payment process is a payment process that performs payment processing based on a pre-registered payment method that has undergone credit screening. An example of the payment control unit 3f is the payment control unit 39 described later.

[0036] By configuring it in this way, when music data is not being played, normal payment processing such as credit card payment is performed, but while music data is being played, payment can be made easily and quickly based on a pre-registered payment method that has undergone credit screening.

[0037] 2 is a diagram showing an example of the network configuration of an event production system according to this embodiment. Event production system 11 includes terminal device 12, server device (hereinafter referred to as "server") 13, computer (hereinafter referred to as "PC") 14, display device 15, speaker 16, lighting control device 17, credit inquiry and payment system 19, and communication network 20. Terminal device 12, server 13, PC 14, and credit inquiry and payment system 19 are communicatively connected via communication network 20 by wired or wireless communication.

[0038] In this embodiment, as an example, one or more users are gathered at an event venue 18 where a display device 15, a speaker 16, and a lighting control device 17 connected to a PC 14 are installed. Each user carries at least one terminal device 12. Here, at the event venue 18, one or more artists (including groups) made up of characters from anime or games are displayed on the display device 15 or other display devices, and the artists perform music, etc., and users can cheer on the characters in response to the music.

[0039] The terminal device 12 is an electronic terminal device having a communication function that can be connected to the communication network 20, such as a smartphone, tablet terminal, or mobile phone carried by a user. A web browser is installed in the terminal device 12. The terminal device 12 can display images generated by the server 13 via the web browser. The terminal device 12 may also be a so-called personal computer.

[0040] The server 13 is an information processing device that can distribute various contents to the terminal device 12 and display the contents on the display device 15 via the PC 14. The server 13 may be a server system made up of one or more physical information processing devices, or may be a virtual server system made up of one or more virtual server devices.

[0041] The PC 14 is a so-called personal computer, and outputs the content distributed from the server 13 to the display device 15, the speaker 16, and the lighting control device 17. The PC 14 may be a terminal device having a communication function that can be connected to the communication network 20, such as a smartphone, a tablet terminal, or a mobile phone.

[0042] Display device 15 is a display device such as a display that outputs content distributed from server 13. If the distributed content includes sound data (including audio data, music data, etc.), display device 15 outputs the sound data via speaker 16. Display device 15 may be a projector, or may display an image on a screen. Speaker 16 may also be built into display device 15.

[0043] The lighting control device 17 controls a plurality of lighting devices installed in the event venue 18 based on instructions from the server 13.

[0044] When a touch payment, which will be described later, is performed, the credit inquiry and payment system 19 performs a credit inquiry when an inquiry is made by the server 13 or the billing server. A credit inquiry means confirming the credit of the credit card user (confirming validity and credit limit) with the credit card company. If the credit inquiry is approved by the card company, the payment amount is temporarily (provisionally) secured.

[0045] Here, an entrance reception terminal and a payment terminal (not shown) may be installed at the event venue 18. In this case, when entering the event venue 18, it is necessary to register predetermined information in advance as an application for participation (pre-registration). Pre-registration also includes setting up a deferred payment system to facilitate payment for purchasing products and providing services at the event venue. Users who have completed pre-registration are given the right to participate in the event, and are issued with admission permission information (for example, a two-dimensional code such as a QR code (registered trademark)) that permits them to enter the event venue 18. In the following, it is assumed that products also include services, and payment for providing services is included in the purchase of products.

[0046] When entering the event venue 18, the user displays the issued two-dimensional code on their own terminal device 12 at the entrance reception desk. The entrance reception staff then reads the two-dimensional code with the entrance reception terminal, reads the wristband ID of the wristband prepared in advance, and transmits it to the server 13. The server 13 acquires the user information from the two-dimensional code and associates the user information with the wristband ID. After the association is complete, the entrance reception staff hands the user a wristband that holds the associated wristband ID. The user can purchase products at the event venue 18 by using the wristband. In other words, when a user purchases a product, the payment process is completed by holding the wristband over the reader of the settlement terminal. (Hereinafter referred to as "tap payment") will be made. Note that touch payment includes not only payments made directly using a wristband, but also payments made using a payment method that has been registered in advance and has undergone credit screening, with the assumption that payments will be made using a wristband.

[0047] 3 is a functional and structural block diagram of the event production system according to this embodiment. The terminal device 12 includes a communication unit 21 and an operation display unit 22. The communication unit 21 is an interface that enables communication with devices connected to the communication network 20. In this example, the communication unit 21 communicates with the server 13.

[0048] The operation display unit 22 is a touch panel that allows input by input operation and also allows display. In the present embodiment, the operation display unit 22 is used as an example, but is not limited to this, and the input unit and the display unit may be independent. Using the operation display unit 22, the user registers user information and a payment method via the terminal device 12 when applying to participate in an event (in advance).

[0049] The terminal device 12 includes an acceleration sensor that detects the direction of movement and the direction of rotation of the terminal device 12. The terminal device 12 may include a gyro sensor. This allows the terminal device 12 to detect the applied force when the terminal device 12 is shaken, moved in a predetermined direction, or rotated, and perform a predetermined operation.

[0050] The server 13 includes a communication unit 31, a control unit 32, and a storage unit 40. The communication unit 31 is an interface that enables communication with devices connected to the communication network 20, and in this case, communicates with the terminal device 12 and the PC 14.

[0051] The control unit 32 functions as a user information and payment method registration unit 33, an acquisition unit 34, a counting unit 35, a display control unit 36, a glow stick control unit 37, a location information acquisition unit 38, and a payment control unit 39.

[0052] The user information and payment method registration unit 33 acquires the user information and payment method entered by the user via the terminal device 12 when registering for participation in an event (in advance), and registers them in the user information management table 41 and the payment method management table 42.

[0053] The acquisition unit 34 acquires gift information transmitted by an input operation on the terminal device 12 to cheer on an artist (including an animation or game character) (hereinafter referred to as a "cheering target object") displayed on the display device 15 (cheering operation). The cheering operation includes, for example, tapping a predetermined area displayed on the terminal device 12 or shaking the terminal device 12.

[0054] Here, the gift information includes, for example, an item name (including a code or identification information (ID)) that identifies an item (hereinafter referred to as a "gift item") that causes a gift object corresponding to the gift information to be displayed on the display device 15 in response to a cheering operation. Gift information may be set for each support target object. Gift items may also be set according to whether they are free or paid. In the case of paid gift items, the gift items may be set according to a set charge amount. In this case, points are assigned to each gift item in advance, with the lowest points assigned to free gift information and the points assigned increasing as the charge amount increases.

[0055] The counting unit 35 counts the number of pieces of gift information acquired and the points for each piece of gift information acquired for each section preset in the music data. The counting unit 35 can also weight the points according to the intervals between sections preset in the music data.

[0056] The display control unit 36 ​​causes the display device 15 to display the cheering target object. Note that the cheering target object may be displayed on a display device different from the display device 15. Furthermore, when an operation to cheer for the cheering target object (a cheering operation) is performed by an input operation from the terminal device 12 during playback of the music data, the display control unit 36 ​​causes the display device 15 to display an effect image corresponding to the cheering operation.

[0057] The glow stick control unit 37 functions as a light for cheering on the cheer target object on the terminal device 12. The glow stick control unit 38 controls the background color of the screen displayed on the operation display unit 22 of the terminal device 12 in accordance with the progress of the music being played. At this time, the glow stick control unit 37 may synchronize the background color with the color of lighting from a lighting device installed in the venue where the display device 15 is installed. The glow stick control unit 37 may also control and synchronize the background color of the screen in accordance with the cheer target object selected on the operation display unit 22 of the terminal device 12. The glow stick control unit 37 may also control and synchronize the background color of the screen in accordance with location information transmitted from the terminal device 12.

[0058] The location information acquisition 38 acquires location information of the terminal device 12 within the event venue 18. A plurality of two-dimensional barcodes corresponding to location information indicating locations (sections) within the venue are placed within the event venue 18. The terminal device 12 reads the two-dimensional barcodes and transmits the location information corresponding to the two-dimensional barcodes to the server 13, and the location information acquisition 38 acquires the location information.

[0059] When a charging operation is performed on the terminal device 12 to purchase a gift, the payment control unit 39 switches between normal payment processing (first payment processing) and touch payment processing (second payment processing) depending on the playback of music data, and executes the switched payment processing. Normal payment is a payment method that performs payment processing based on a payment method entered into a payment method input screen that is displayed when a gift item is selected on the terminal device 12, such as a commonly used credit card payment. As described above, touch payment is a simple and quick payment method that is based on a pre-registered payment method that has undergone credit screening. The payment control unit 39 performs normal payment processing before the start or end of performance, and performs payment processing based on touch payment processing during performance.

[0060] The memory unit 40 stores a user information management table 41, a payment method management table 42, user interface (hereinafter referred to as "UI") data 43 for the terminal device, gift object data 44, character data 45, music data 46, effect data 47, and a billing management database (hereinafter referred to as "DB").

[0061] The user information management table 41 is a table for managing information about users participating in an event. The payment method management table 42 is a table for managing payment methods registered in advance for use in touch payment or payment based on touch payment. The payment method management table 42 includes information for credit card payment and information such as the address to which the user's bill will be sent for later payment at a store such as a convenience store. The UI data 43 is data related to the support input interface to be displayed on the terminal device 12, the background color, and the input display screen for determining charges.

[0062] The gift object data 44 is data relating to a gift object corresponding to the gift information to be displayed on the display device 15, and includes information relating to points for the gift information. The character data 45 is data relating to a character whose performance is displayed as an animation on the display device 15 (information relating to the visual and movement (animation) of the object being cheered on). The music data 46 is music data that is played in accordance with the performance movements of the character, and has preset intervals as described below. The effect data 47 is various performance images that are displayed on the display device from the start to the end of the performance, and includes, for example, various display highlighting effects that liven up the performance or music performance in accordance with cheering operations (including data relating to the glow stick function).

[0063] The billing management DB 49 is a database that manages billing processes (including normal payment processes, touch payment processes, and payment processes based on touch payment processes). In Fig. 3, the billing management DB 49 is stored in the storage unit 40, but this is just an example and the DB may be stored in a different storage device.

[0064] The PC 14 includes a communication unit 51 and an output unit 52. The communication unit 51 is an interface that enables communication with devices connected to the communication network 20, and in this case, communicates with the server 13. The output unit 52 is an output interface that connects to the display device 15, speaker 16, and lighting control device 17 and outputs data and commands.

[0065] 4 is a flowchart for explaining the overall flow of this embodiment. First, when applying to participate in an event (in advance), a user uses the terminal device 12 to register user information and a payment method (S1).

[0066] Next, at the event venue 18, when the performance (playback of music data) starts, the user uses the terminal device 12 to read a two-dimensional barcode placed near the position (section) where the user is cheering (S2). The two-dimensional barcode serves as information for identifying the position (section) at the event venue 18.

[0067] At the event venue 18, before the performance (playback of music data) begins, the user operates the terminal device 12 to purchase a gift item to support the support target object, as needed (S3). In S3, the payment method is the normal payment process described above.

[0068] The performance (playback of music data) begins (S4). Then, the user performs a cheering operation on the terminal device 12 in response to the playback of the music, and transmits gift information based on the selected gift item to the server 13. Then, the server 13 performs various effect processes to liven up the performance in accordance with the development of the music and the aggregated value of the transmitted and aggregated gift information (S5).

[0069] The server 13 also controls the background color of the display screen displayed on the terminal device 12 via the web browser in accordance with the progression of the music in the music data (S6). This allows the display screen via the web browser to have an effect similar to that of glow sticks, creating a sense of unity in the venue.

[0070] Even during a performance, the user can purchase a gift item to support the support target object by operating the terminal device 12 as needed (S7). In this case, since a performance is in progress, the server 13 performs payment processing based on touch payment in order to reduce the burden of payment operations on the user.

[0071] Below, we will explain in detail each process and procedure in the flow explained in Figure 4. First, we will explain S1 in Figure 4.

[0072] Fig. 5 is a sequence diagram of the pre-registration process (S1) in this embodiment. Fig. 6 is a diagram showing an example of a touch payment setting screen displayed on a terminal device in the pre-registration process in this embodiment. Fig. 5 will be explained below with reference to Fig. 6. For ease of explanation, displaying on the operation display unit 22 of the terminal device 12 may also be described as displaying on the terminal device 12.

[0073] First, in order to participate in an event, the user must first make certain settings to apply for participation. The user then accesses a certain portal site using a web browser installed on terminal device 12 (S11). The user then performs certain input operations on the portal site to apply for participation in the event, and a settings screen (touch payment screen) for registering a payment method at the event venue is displayed (S12).

[0074] When the user presses "Proceed with use" on the touch payment screen, the terminal device 12 transmits a payment method setting request to the server 13 (S13). In response, the server 13 causes the terminal device 12 to display a payment method setting screen 61 as shown in Fig. 6 (S14).

[0075] The user uses the terminal device 12 to input a payment method into the payment method setting screen 61. For example, if the user selects credit card payment on the payment method setting screen 61, the user inputs the necessary information into the credit card payment setting field 62. If one or more credit card details have already been registered, the last four digits of those credit cards are displayed, and the user can select one of the credit cards. In addition, by pressing the "Add credit card" button 63, a new credit card can be registered.

[0076] Furthermore, on the payment method setting screen 61, if you select deferred payment (a method in which you pay at a convenience store using a bill that will be mailed to you at a later date), you enter the necessary information in the deferred payment setting field 64. If one or more billing addresses have already been registered, those billing addresses will be displayed and you can select one of them. Furthermore, if you press the "Add new delivery address" button 65, you can register a new billing address.

[0077] Payment is not limited to convenience stores, and payment may be made at a bank, post office, etc. if the invoice allows payment at such a bank, post office, etc.

[0078] Furthermore, the above-mentioned "upper limit" can be set in the credit card payment setting field 62 and / or deferred payment setting field 64 on the payment method setting screen 61.

[0079] When the user finishes inputting the necessary information on the payment method setting screen 61 and presses the "Confirm application" button 66 in FIG. 6, the terminal device 12 sends a user information registration request to the server 13 (S15). In response, the server 13 performs a credit inquiry with the credit inquiry and payment system 19 based on the user's name, telephone number, and address (which may also include credit card information) (S16) and receives the credit verification result (S17). The server 13 then causes a setting completion screen (not shown) to be displayed on the terminal device 12 (S18). The server 13 displays on the setting completion screen (not shown) a message that the touch payment setting has been completed and the registered details.

[0080] Note that short mail service authentication (SMS authentication) may be used for pre-registration. This can improve security during pre-registration. Note that pressing the "Back" button 67 in Figure 6 will return to the previous screen.

[0081] Next, S2 in Fig. 4 will be described. Fig. 7 is a diagram showing an example of the placement of two-dimensional barcodes indicating location information within an event venue in this embodiment. Two-dimensional barcodes X1 to X12 are placed within the event venue 18, and each of the two-dimensional barcodes X1 to X12 indicates the location where it is placed. The two-dimensional barcodes may be printed on paper and attached to a fixed object, for example. Furthermore, the management staff may hold the paper on which the two-dimensional barcodes are printed, or the paper may be displayed on the management staff's terminal device.

[0082] Fig. 8 is a diagram illustrating an example of the structure and sections of music data in this embodiment. The horizontal axis in Fig. 8 represents the development of a song. A song begins with an intro and is made up of sections called the A melody, B melody, C melody, and chorus, for example. The horizontal axis represents the emotional ups and downs (the user's mood and excitement). The color of the bars indicates the melody.

[0083] In this embodiment, as an example, the basic structure of the performance is divided into the following three sections, A, B, and C. Section A (A1, A2) is a melody section where you hear the music. Section B (B1, B2, B3) is a chorus section. Section C (C1) is a section where the excitement continues following the chorus section. These sections are set in advance.

[0084] In this embodiment, gift information is transmitted to the server 13 through a cheering operation performed by a user on the terminal device 12. The server 13 controls the special effect in section B based on the gift information points accumulated in sections A and C. For example, in section A, the user is asked to gradually participate in cheering operations. As a result, gift information points are gradually accumulated in the server 13. If a certain number of gift information points are accumulated in section B, a special effect, which will be described later, is activated. In section C, the excitement continues following the chorus, and the user is asked to actively participate in cheering operations toward the final special effect. For example, a special effect is activated in section B1 as a result of accumulating gift information points collected in section A1. A special effect is activated in section B2 as a result of accumulating gift information points collected in section A2. A special effect is activated in section B3 as a result of accumulating gift information points collected in section C1. Note that, hereinafter, a section corresponding to section B may be referred to as an "effect section." In addition, a section corresponding to section A or section C may be referred to as a "non-effect section."

[0085] Next, steps S4 and S5 in Fig. 4 will be described. Note that step S3 will be described later together with step S7.

[0086] FIG. 9 is a diagram showing an example of an image displayed on a display device when playback of music data begins in this embodiment. Three cheering target objects 73a, 73b, and 73c are displayed as cheering target objects 73 in the lower portion of a display area 71 of the display device 15. As an example, the music used in this embodiment is set to be performed by the cheering target objects 73a, 73b, and 73c. ​​A display object 72 is displayed in the display area above the cheering target objects 73a, 73b, and 73c. ​​The display object 72 changes its appearance, for example, by growing larger, changing shape, or changing color as it absorbs gift information transmitted through cheering operations. The cheering target objects 73a, 73b, and 73c may be displayed on a separate display device. The display object 72 is not limited to a circular or spherical shape and may have any shape, form, color, or appearance, and may move using animation or the like.

[0087] 10 shows a support operation input screen 81 displayed on the terminal device when music data is being played in this embodiment. The support operation input screen 81 can be displayed via a web browser.

[0088] In support target object selection field 84, one of support target objects 73a, 73b, and 73c can be selected. When one of the support target objects is selected in support target object selection field 84, an image of the selected support target object is displayed in display area 82. In addition, the background color of background area 85 changes depending on the selected support target object.

[0089] The gift selection field 83 allows the user to select a gift item to send by a support operation. When a gift item is selected in the gift selection field 83, an image of the selected gift item is displayed in the display area 82. The gift information displayed in the gift selection field 83 changes depending on the support target object selected in the support target object selection field 84. Some gift items are free of charge, while others require payment. For example, if 1 yen = 1 point (pt), the gift item in the gift selection field 83a can be used free of charge (0 pt). The gift item in the gift selection field 83b can be used for 100 pt and has already been purchased for 100 yen. A locked padlock object is displayed in the gift selection field 83c, indicating that a 500 pt gift item has not yet been purchased.

[0090] In this state, gift information corresponding to the selected gift item can be sent to the server 13 by performing a predetermined operation such as tapping or sliding the support operation input area 86 with a finger or shaking the terminal device 12.

[0091] 11 is a diagram showing an example of an effect in which gift objects are displayed gathering around a display object and flying away according to position information in this embodiment. Here, FIG. 11 shows an effect image in a section corresponding to the above-mentioned section A or section C (i.e., a non-effect section).

[0092] For example, in FIG. 10, a presentation image is displayed so that the transmitted gift object 91 is absorbed into the display object 72.

[0093] Furthermore, an effect image is displayed that looks like a gift object is being thrown from a position corresponding to the position information based on the two-dimensional barcode read in S2 of Fig. 4. For example, when two-dimensional barcode X8 is read in Fig. 7, an effect image is displayed that looks like a gift object 91 is being thrown from the right side of display area 71 to display object 72 in the center.

[0094] 12 is a diagram showing an example of a special effect in an effect section in this embodiment. Here, Fig. 12 shows an effect image (special effect image 92) for a special effect in a section (effect section) corresponding to the above-mentioned section B.

[0095] When an effect section is reached during playback of music data, a special effect image 92 is displayed according to the total number of gift information points accumulated in the previous non-effect section. The greater the total number of points, the greater the effect of the special effect image 92.

[0096] The special effect image 92 may be, for example, an image of a mass of gift information collected up to that point exploding, an image of fireworks going off, or an image of falling stars. The effect of the special effect image increases as the end of the song approaches, with the effect section at the final chorus being the strongest. As one of the effects, a cutout of the object to be cheered on may be displayed large in the center of the display area 71 at a predetermined timing or according to the total number of points.

[0097] 13 is a sequence diagram of a cheering operation in this embodiment. First, the user reads a two-dimensional barcode placed near the user's seat at the event venue 18 with the terminal device 12 (S21). The terminal device 12 stores the position information indicated by the two-dimensional barcode.

[0098] As explained in FIG. 9, the server 13 displays the display object 72 and the support target object on the display device 15 in time with the start of the performance, and also starts playing back the music data (S22).

[0099] The user transmits gift information to the server 13 by performing a cheering operation using the terminal device 12. At this time, the terminal device 12 also transmits the location information acquired in S21 to the server 13 (S23). The server 13 displays effect images (including special effect images) on the display device 15 in accordance with the gift information and location information transmitted from the terminal device 12 and the section set in the music data (S24). S23 and S24 are repeated while the music data is being played.

[0100] When the performance (playback of music data) ends, the server 13 displays the end credits on the display device 15 (S25). The end credits may, for example, display the user's nickname in large letters or in a predetermined order depending on the points of the gift information sent.

[0101] 14A and 14B are flowcharts of Example 1 of the performance processing (S5) based on the section of music data by the server in this embodiment. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device, and functions as an acquisition unit 34, a counting unit 35, a display control unit 36, and a position information acquisition unit 38, and executes the flow of FIGS. 14A and 14B. Hereinafter, the processing by the control unit 32 will be described as processing by the server 13 for convenience.

[0102] When the server 13 receives an instruction to play a song, it starts playing the song data (S31). The server 13 initializes a parameter P (total value of points) for tallying points to 0 (S32). The server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0103] The server 13 acquires the gift information and the location information transmitted from the terminal device 12 (S34). The server 13 identifies the acquired gift information by referring to the gift object data 44 (S35). The server 13 displays gift objects corresponding to the identified gifts based on the location information so that they gather around the display object 72 (S36). The server 13 changes the form of the display object as the gift objects are absorbed into the display object (S37).

[0104] The server 13 identifies the points Pi corresponding to the identified gift information by referring to the gift object data 44 (S38), and adds the points Pi to the total point value P (S39).

[0105] The server 13 determines whether the effect section has arrived (S40). If the effect section has not arrived (NO in S40), the server 13 returns to the process of S34. The processes of S34 to S39 are repeated until the effect section arrives.

[0106] When the effect division arrives (YES in S40), the server 13 generates a special effect image according to the total value P (S41) and displays it (S42). Here, when the total value P exceeds a predetermined value, the special effect image may be displayed, for example, as if the points have reached full. The predetermined value may be changed each time, for example, depending on the number of participating users or the points set for the gift item.

[0107] The server 13 determines whether the effect section has ended (S43). If the effect section has not ended (NO in S43), the server 13 returns to the process of S41. The processes of S41 to S42 are repeated until the effect section has ended.

[0108] If the effect section has ended (YES in S43), the server 13 determines whether playback of the music has ended (S43). If playback of the music has not ended (NO in S44), the server 13 initializes the count value P to 0 or reduces it to a predetermined value (S45), and returns to the processing of S34. The processing of S34 to S45 is repeated until playback of the music has ended.

[0109] When the playback of the music has finished (YES in S44), the server 13 fades out the effect image (S46) and finally displays the end credits (S47). As described above, in the end credits, the server 13 may, for example, display the user's nickname in a large font or display it in a determined order according to the points of the gift information transmitted.

[0110] 15A and 15B are flowcharts of Example 2 of the performance processing (S5) based on the section of music data by the server in this embodiment. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device, and functions as an acquisition unit 34, a counting unit 35, a display control unit 36, and a position information acquisition unit 38, and executes the flow of FIGS. 15A and 15B. Hereinafter, the processing by the control unit 32 will be described as processing by the server 13 for convenience.

[0111] 15A and 15B are flowcharts in which the processes of S32-1 and S32-2 are added to those of Fig. 14A and 14B, S39 is replaced with the process of S39-1, and S45 is replaced with the processes of S45-1, S45-2, and S45-3. In the second embodiment, gift points are weighted according to the length of the section before the effect section in the first embodiment.

[0112] When the server 13 receives an instruction to play a song, it starts playing the song data (S31).The server 13 initializes a parameter (point total value) P for tallying points to 0 (S32).

[0113] The server 13 calculates the time T until the effect section (S32-1). The server 13 sets a weight W according to the calculated time T (S32-2). For example, the shorter the time T, the heavier the weight set by the server 13.

[0114] The server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0115] The server 13 acquires the gift information and the location information transmitted from the terminal device 12 (S34). The server 13 identifies the acquired gift information by referring to the gift object data 44 (S35). The server 13 displays gift objects corresponding to the identified gifts based on the location information so that they gather around the display object 72 (S36). The server 13 changes the form of the display object as the gift objects are absorbed into the display object (S37).

[0116] The server 13 refers to the gift object data 44 and identifies the points Pi corresponding to the identified gift information (S38). The server 13 adds a value obtained by multiplying the points Pi by the weight W to the total point value P (S39-1).

[0117] The server 13 determines whether the effect section has arrived (S40). If the effect section has not arrived (NO in S40), the server 13 returns to the process of S34. The processes of S34 to S39 are repeated until the effect section arrives.

[0118] When the effect division arrives (YES in S40), the server 13 generates a special effect image according to the total value P (S41) and displays it (S42). Here, when the total value P exceeds a predetermined value, the special effect image may be displayed, for example, as if the points have reached full. The predetermined value may be changed each time, for example, depending on the number of participating users or the points set for the gift item.

[0119] The server 13 determines whether the effect section has ended (S43). If the effect section has not ended (NO in S43), the server 13 returns to the process of S41. The processes of S41 to S42 are repeated until the effect section has ended.

[0120] If the effect section has ended (YES in S43), the server 13 determines whether playback of the music has ended (S43). If playback of the music has not ended (NO in S44), the server 13 calculates the time T until the effect section (S45-1). The server 13 sets a weight W according to the calculated time T (S45-2). For example, the shorter the time T, the heavier the weight set by the server 13. The server 13 also reduces the aggregate value P to a predetermined value according to the time T (S45-5), and returns to the process of S34. The processes of S34 to S45 are repeated until playback of the music has ended.

[0121] When the playback of the music has finished (YES in S44), the server 13 fades out the effect image (S46) and finally displays the end credits (S47). As described above, in the end credits, the server 13 may, for example, display the user's nickname in a large font or display it in a determined order according to the points of the gift information transmitted.

[0122] In addition, by reducing the aggregated value P instead of initializing it in the process of S45-3, the aggregated value can be carried over to the next section A or section C (non-effect section), allowing the excitement to continue even further.

[0123] Next, S6 in Fig. 4 will be described. Fig. 16 is a sequence diagram in which a terminal device in this embodiment is made to function as a glow stick and synchronized with the lighting in the event venue. The server 13 changes the background color of the display area 85 of the terminal device via a web browser in accordance with the progression of the music (S51). Furthermore, the server 13 may control the lighting control device 17 in accordance with the change in background color, and synchronize the lighting devices in the event venue to change the color and direction of the lighting (S52).

[0124] Fig. 17 is a flowchart showing how the server in this embodiment causes a terminal device to function as a glow stick and synchronize with the lighting in the event venue. The control unit 32 of the server 13 reads the program according to this embodiment from a storage device, functions as a glow stick control unit 37 and a position information acquisition unit 38, and executes the flow shown in Fig. 17. For convenience, the processing by the control unit 32 will be described below as processing by the server 13.

[0125] The server 13 acquires the position information transmitted from the terminal device 12 (S61). The server 13 determines the background color of the display area 85 for each terminal device 12 according to the progression of the music, the position information, and / or the selected support target object (S62). The server 13 notifies the terminal device 12 of information about the determined background color. The server 13 also notifies the lighting control device 17 of a command to perform lighting processing according to the background color (S63).

[0126] The server 13 repeats the processes of S62 to S64 until the playback of the music data is completed (NO in S64), and when the playback of the music data is completed, this flow ends (YES in S64).

[0127] This allows the display screen of the web browser to have an effect similar to that of a glow stick, and by controlling the lighting in the event venue 18, a sense of unity can be achieved within the event venue.

[0128] Next, we will explain the payment processing of S3 and S7 in Fig. 4. Fig. 18 is a sequence diagram of a normal credit card payment processing before or after playback of music data has ended, and a processing based on pre-registered information for touch payment during playback of music data, in this embodiment.

[0129] Before or after the playback of the music data is completed, the user performs an operation to purchase an item as gift information using the terminal device 12 (S71). For example, in Fig. 10, when the lock object in the gift selection field 83c is tapped, a list of gift items worth 500 points is displayed, and the user can select the gift item they wish to purchase.

[0130] When the server 13 acquires the gift information relating to the selected gift item, it causes the terminal device 12 to display a payment method input screen for purchasing the gift item (S72).

[0131] The user inputs a payment method into the payment method input screen using the terminal device 12 (S73). The server 13 causes the terminal device 12 to display a confirmation screen for the user to confirm the content input into the payment method input screen (S74).

[0132] The user uses the terminal device 12 to check the confirmation screen and tap the OK button (S75). The server 13 then makes a credit inquiry to the credit inquiry and settlement system 19 (S76). When the server 13 receives the credit inquiry result from the credit inquiry and settlement system 19 (S77), the server 13 notifies the terminal device 12 whether the payment is complete or not, depending on whether the sum of the cumulative payment amount for a predetermined period and the current payment amount exceeds a preset upper limit, or depending on the credit inquiry result. (S76) If payment is not possible, the terminal device 12 displays a message saying "Payment not possible," and the selected gift item cannot be purchased.

[0133] Meanwhile, while the music data is being played, the user performs an operation to purchase an item as gift information using the terminal device 12 (S81). For example, in Fig. 10, when the lock object in the gift selection field 83c is tapped, a list of gift items worth 500 points is displayed, and the user can select the gift item they wish to purchase.

[0134] When the server 13 acquires the gift information regarding the selected gift item, it causes the terminal device 12 to display a confirmation screen on which the purchase details and payment method for the gift item are entered based on the information previously registered in S1 of Figure 4 (S82).

[0135] The user uses the terminal device 12 to check the confirmation screen and tap the OK button (S83). The server 13 then makes a credit inquiry to the credit inquiry and payment system 19 (S84). When the server 13 receives the credit inquiry result from the credit inquiry and payment system 19 (S85), the server 13 notifies the terminal device 12 whether the payment is complete or not, depending on whether the sum of the cumulative payment amount for a predetermined period and the current payment amount exceeds a preset upper limit, or depending on the credit inquiry result. (S86) If payment is not possible, the terminal device 12 displays a message saying "Payment not possible," and the selected gift item cannot be purchased.

[0136] Fig. 19 is a flowchart of a payment process in this embodiment in which the payment method is switched depending on the playback of music data. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device, functions as the payment control unit 39, and executes the flow of Fig. 19. Hereinafter, the processing by the control unit 32 will be described as the processing by the server 13 for convenience.

[0137] When the server 13 receives a gift item purchase request from the terminal device 12 (S91), it determines whether music data is currently being played (S92). If music data is not currently being played (NO in S92), the server 13 performs a first payment process (S93).

[0138] In the first payment process (S93), the server 13 displays a payment method input screen on the terminal device 12 (S93a). When the input of the payment method on the payment method input screen on the terminal device 12 is completed, the server 13 accepts the payment method (S93b).

[0139] The server 13 displays a confirmation screen on the terminal device 12 to allow the user to confirm the accepted payment method (S93c). When the user confirms the confirmation screen using the terminal device 12 and taps the confirm button, the server 13 accepts the confirmation instruction (S93d).

[0140] The server 13 performs payment processing for the amount of the gift item based on the acquired payment method (S93e). If the acquired payment method is "credit card payment," the server 13 acquires valid credit card information corresponding to the user ID from the payment method management table 42. Based on the acquired credit card information, the server 13 performs a credit inquiry with the credit inquiry / payment system 19 and performs payment processing for the amount.

[0141] If the acquired payment method is deferred payment, the server 13 acquires valid billing address information corresponding to the user ID from the payment method management table 42. The server 13 performs payment processing for the amount based on the acquired billing address information. Note that the server 13 may suspend payment processing if the sum of the cumulative payment amount over a specified period and the current payment amount exceeds a preset upper limit. The server 13 notifies the terminal device 12 of the result of the payment processing (S93f).

[0142] In S92, if music data is being played (YES in S92), the server 13 refers to the payment method management table 42 and determines whether the user has pre-registered for touch payment (S94). If the result of S94 is NO, the server 13 performs the first payment process (S93). If the pre-registration for the touch payment is registered (YES in S94), the server 13 performs the second payment process. (S95).

[0143] In the second payment process (S95), the server 13 causes the terminal device 12 to display a confirmation screen on which the purchase details and payment method for the gift item are entered, based on the information previously registered in the payment method management table 42 in S1 of Fig. 4 (S95a). When the user checks the confirmation screen using the terminal device 12 and taps the confirm button, the server 13 accepts the confirmation instruction (S95b).

[0144] The server 13 performs payment processing for the amount of the gift item based on the acquired payment method (S95c). If the acquired payment method is "credit card payment," the server 13 acquires valid credit card information corresponding to the user ID from the payment method management table 42. Based on the acquired credit card information, the server 13 performs a credit inquiry with the credit inquiry / payment system 19 and performs payment processing for the amount.

[0145] If the acquired payment method is deferred payment, the server 13 acquires valid billing address information corresponding to the user ID from the payment method management table 42. The server 13 performs payment processing for the amount based on the acquired billing address information. Note that the server 13 may also suspend payment processing if the sum of the cumulative payment amount over a specified period and the current payment amount exceeds a preset upper limit. The server 13 notifies the terminal device 12 of the result of the payment processing (S95d).

[0146] 20 is an example of a configuration block diagram of a hardware environment of a computer that executes a program in this embodiment. A computer 101 functions as a terminal device 12 or a server 13. The computer 101 is composed of a CPU 102, a ROM 103, a RAM 104, a storage device 105, an input I / F 106, an output I / F 107, a communication I / F 108, a reading device 109, and a bus 120.

[0147] Here, CPU refers to a central processing unit. ROM refers to a read-only memory. RAM refers to a random access memory. I / F refers to an interface. The bus 140 is connected to the CPU 102, ROM 103, RAM 104, storage device 105, input I / F 106, output I / F 107, communication I / F 108, and, if necessary, a reading device 109.

[0148] The CPU 102 reads the program according to this embodiment from the storage device 105. When functioning as the server 13, the CPU 102 executes the program as a user information / payment method registration unit 33, an acquisition unit 34, a counting unit 35, a display control unit 36, a glow stick control unit 37, a location information acquisition unit 38, and a payment control unit 39. The CPU 102 also reads the program according to this embodiment from the storage device 105. When functioning as the terminal device 12, the CPU 102 executes the program as a reception processing unit and a transmission processing unit. When functioning as the reception processing unit, the CPU 102 accepts a predetermined operation input to the terminal device 12 during playback of music data consisting of multiple sections. When functioning as the reception processing unit, the CPU 102 aggregates gift information transmitted from the terminal device 12 during a first segment of multiple segments during playback of the music data, and transmits the gift information in response to the accepted operation input to the server 13, which displays a performance image in a second segment following the first segment, according to the aggregate value of the gift information acquired during the first segment. The ROM 103 is a read-only memory. The RAM 104 is a temporary storage memory.

[0149] The storage device 105 is a device that stores large amounts of information. Various types of storage devices can be used as the storage device 105, such as a hard disk, a solid state drive (SSD), or a flash memory card. The storage device 105 stores a program according to an embodiment of the present invention and various types of data stored in the storage unit 40.

[0150] The input I / F 106 can be connected to input devices such as a keyboard, a mouse, an electronic camera, a web camera, a microphone, a scanner, a sensor, a tablet, a touch panel, an information reading device, etc. The output I / F 107 can be connected to output devices such as a display, a touch panel, a projector, a printer, a speaker, etc.

[0151] The communication I / F 108 is an interface such as a port for connecting to a communication network and communicating with other devices. The communication network may be the Internet, a local area network (LAN), a wide area network (WAN), a dedicated line, a wired line, a wireless line, etc. The reading device 109 is a device for reading portable recording media.

[0152] The program for realizing the processes described in the above embodiments may be stored in, for example, the storage device 105 from a program provider via a communication network and the communication I / F 108. The program for realizing the processes described in the above embodiments may also be stored in a commercially available portable storage medium. In this case, the portable storage medium may be set in the reading device 105, and the program may be read and executed by the CPU 102. Various types of storage media can be used as the portable storage medium, such as a CD-ROM, a flexible disk, an optical disk, a magneto-optical disk, an IC card, a USB memory device, or a semiconductor memory card. The program stored in such a storage medium is read by the reading device 109.

[0153] The program may be installed on a stand-alone computer, or may be installed by a cloud computer and provide only the functions to the user. Although the screen display in this embodiment is performed using a web browser on the terminal device 12, the screen display in this embodiment may be performed by installing an application program capable of communicating with the server 13 on the terminal device 12.

[0154] According to this embodiment, the effects can be dynamically changed in response to cheering for the cheer target object and the progression of the music during the event. Furthermore, the reaction to the cheering operation is visually reflected in the effects in real time, which improves the sense that the user themselves has sent the gift object and the interactivity.

[0155] Furthermore, the support target object is not limited to a character from an anime or game, but may be a human artist, or may be a non-human entity such as an animal or a robot. Furthermore, the support target object is not limited to the effect content of the effect image (special effect image), and may be any effect content. Furthermore, in this embodiment, the sections are set in advance in the music data, but the sections may be formed in real time at a predetermined timing depending on the atmosphere of the place. Furthermore, the sections are not limited to the A melody, B memo, chorus, etc., but may be set arbitrarily.

[0156] This aspect has been described above based on embodiments and modifications. However, the above-described embodiments are intended to facilitate understanding of this aspect and are not intended to limit this aspect. This aspect may be modified or improved without departing from the spirit and scope of the claims, and equivalents thereof are included in this aspect. Furthermore, if a technical feature is not described as essential in this specification, it may be deleted as appropriate. [Explanation of symbols]

[0157] 1. Information Processing Systems 2. Terminal Device 3. Information processing equipment 3a Acquisition part 3b Tally section 3c Display control section 3D background color control section 3e Location information acquisition section 3f Payment control section 4 Display device 5 Acquisition part 6 Payment amount determination section 7 Payment processing section 8 Amount Management Department 11 Event Production System 12 Terminal Equipment 13 Server 14 PC 15 Display device 16 speakers 17 Lighting control device 18 Event Venues 19 Credit Inquiry and Payment System 20. Communication Networks 21 Communications Department 22 Operation display section 31 Communications Department 32 Control section 33 User information and payment method registration section 34 Acquisition Department 35 Counting Department 36 Display control unit 37 Psyllium control unit 38 Location information acquisition section 39 Payment Control Unit 40 Storage section 51 Communications Department 52 Output section

Claims

1. An information processing device that can be connected to a terminal device that can be operated by a user and display images via a communication network, and that can output to a display device, an acquisition unit that acquires gift information transmitted from the terminal device in response to a predetermined operation input while music data consisting of a plurality of sections is being played; a counting unit that counts the gift information acquired during a first segment of the plurality of segments while the music data is being played; a display control unit that displays a performance image in a second section that is a section after the first section, according to a total value of the gift information totaled during the first section; An information processing device comprising:

2. the counting unit adjusts the counted value by weighting the value corresponding to each of the gift information items according to the length of the first section; The display control unit changes the presentation form of the presentation image according to the total value of the weighted gift information.

2. The information processing apparatus according to claim 1, wherein:

3. the first and second divisions are repeated during playback of the music data; The display control unit carries over a part or all of the total value of the gift information totaled in the first division to the first division that comes after the second division, depending on the total value of the gift information totaled in the first division.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The display control unit further displays a gift object corresponding to the gift information transmitted in response to the operation input while moving the gift object as if the gift object were flying toward a display object displayed on the display device, and changes the form of the display object in response to the total value of the gift information acquired in the first classification.

4. The information processing device according to claim 1, wherein the information processing device is a computer.

5. The information processing device further comprises: a background color control unit that controls a background color of a screen displayed on a display unit of the terminal device in accordance with the development of the music being played; Equipped with The background color control unit synchronizes the background color based on lighting from a lighting device installed in a venue where the display device is installed, an object selected on a display unit of the terminal device, or location information transmitted from the terminal device.

5. The information processing device according to claim 1, wherein the information processing device is a computer.

6. The information processing device further comprises: a location information acquisition unit that acquires location information transmitted from the terminal device; An information processing device described in any one of claims 1 to 5, characterized in that the display control unit displays a gift object corresponding to the gift information in an area corresponding to the location information in the display area of ​​the display device based on the operation input.

7. The information processing device further comprises: a payment control unit that switches between a first payment process that performs payment processing based on a payment method input on a payment method input screen that is displayed when the gift information to be charged is selected on the terminal device, and a second payment processing unit that performs payment processing based on a pre-registered payment method that has undergone credit screening, in response to playback of the music data, when the gift information to be charged is selected on the terminal device; 7. The information processing device according to claim 1, further comprising:

8. an information processing device that can be connected to a terminal device via a communication network, which can be operated by a user and can display images, and that can output to a display device; an acquisition process for acquiring gift information transmitted from the terminal device in response to a predetermined operation input during playback of music data consisting of a plurality of sections; a counting process for counting the gift information acquired during a first segment of the plurality of segments while the music data is being played; a display control process for displaying a performance image in a second section that is a section following the first section, according to a total value of the gift information totaled during the first section; A program on the information processing device that executes the above.

9. A terminal device that can be connected to an information processing device that can output to a display device via a communication network and that can be operated by a user and display images, a receiving process for receiving a predetermined operation input to the terminal device during playback of music data consisting of a plurality of sections; a transmission process for summarizing gift information transmitted from the terminal device during a first section of the plurality of sections while the music data is being played, and transmitting the gift information in response to the received operation input to an information processing device that displays a performance image in a second section that is a section after the first section according to the sum of the gift information obtained during the first section; A terminal device side program that executes the above.

Images