Information processing apparatus, program for information processing apparatus, and program for terminal apparatus

Abstract

To provide a technique which can dynamically change performance in an event in response to cheering for a cheer object and development of music.SOLUTION: The present invention is directed to an information processing apparatus which can be connected through a communication network to a terminal device capable of being operated by a user and displaying an image and which can output data to a display device. The information processing apparatus has an acquiring unit for acquiring gift information transmitted from the terminal device in response to a predetermined input operation during reproduction of musical piece data forming a plurality of sections, a collecting unit for collecting gift information acquired during a first section of the plurality of sections during reproduction of the musical piece data, and a display control unit for displaying a performance image in response to collected values of the gift information collected during the first section in a second section immediately succeeding the first section. Thus, the information processing apparatus solves the problem.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing apparatus side program, and a terminal apparatus side program.

Background Art

[0002] Conventionally, in events such as concerts and live shows, various production methods have been devised to liven up the atmosphere. For example, production methods such as displaying images on a large display in sync with the music or changing the color and lighting pattern of spotlights are known.

[0003] As a technology related to such production, for example, a user participation type event production system has been disclosed (for example, Patent Document 1). The event production system provides a production that can enhance the sense of unity between participants and artists by using, for example, image data (photos) and acoustic data (singing voices) uploaded by concert participants to the server in advance for the production at the concert.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In recent years, in events such as concerts and live shows, not only humans such as artists and performers but also, for example, characters from anime and games are increasingly being used as main characters in the event. When a performance by a cheering target such as an artist, performer, or character starts, the audience waves light sticks in response to the development of the song to cheer for the cheering target and liven up the song.

[0006] However, in conventional events, the performances were set in advance by the organizers and were carried out based on a schedule, for example, but there was no performance that livened up the event venue in real time in accordance with the development of the music or the mood of the venue at that time. For example, as mentioned above, even in Patent Document 1, image data (photographs) and sound data (singing voices) uploaded to a server by concert participants in advance were used for the performance at the concert, and it was not possible to create a performance that changed according to the cheering situation of the audience during the performance.

[0007] The present invention provides a technique for dynamically changing the presentation of an event in accordance with cheering for a cheer target object and the progression of music. [Means for solving the problem]

[0008] An information processing device according to one aspect of the present invention is an information processing device that can be connected to a terminal device via a communication network, which can be operated by a user and display images, and can output to a display device, and is characterized by comprising: an acquisition unit that acquires gift information transmitted from the terminal device in response to a predetermined operation input while music data consisting of a plurality of sections is being played; a counting unit that tallys up the gift information acquired during a first section of the plurality of sections while the music data is being played; and a display control unit that displays a performance image in a second section that is the section after the first section, in accordance with the tally value of the gift information tallied during the first section.

[0009] In the above information processing device, the aggregation unit adjusts the aggregated value by weighting the values corresponding to each of the gift information according to the length of the first section, and the display control unit changes the presentation form of the presentation image according to the weighted aggregated value of the gift information.

[0010] In the above information processing apparatus, during the reproduction of the music data, the first section and the second section are repeated, and the display control unit, according to the total value of the gift information aggregated in the first section, inherits part or all of the total value in the first section that comes after the second section.

[0011] In the above information processing apparatus, the display control unit further displays the gift object while moving the gift object corresponding to the gift information transmitted according to the operation input so as to fly toward the display object displayed on the display device, and changes the form of the display object according to the total value of the gift information acquired in the first section.

[0012] The information processing apparatus further includes a background color control unit that controls the background color of the screen to be displayed on the display unit of the terminal device according to the development of the reproduced music. The background color control unit synchronizes the background color based on the illumination from the lighting device installed in the venue where the display device is installed, the object selected on the display unit of the terminal device, or the position information transmitted from the terminal device.

[0013] The information processing apparatus further includes a position information acquisition unit that acquires the position information transmitted from the terminal device. The display control unit displays a gift object corresponding to the gift information in a region corresponding to the position information based on the operation input in the display area of the display device.

[0014] The information processing apparatus further includes a settlement control unit that switches between a first settlement process that performs a settlement process based on the settlement method input on the settlement method input screen displayed at the timing when the gift information is selected according to the reproduction of the music data when the gift information subject to charging is selected in the terminal device, and a second settlement process unit that performs a settlement process based on a pre-registered settlement method that has passed a credit review.

[0015] An information processing apparatus side program according to an aspect of the present invention is connectable to a terminal device capable of performing operations by a user and displaying images via a communication network, and is also capable of outputting to a display device. The information processing apparatus includes an acquisition process of acquiring gift information transmitted from the terminal device in response to a predetermined operation input during reproduction of music data composed of a plurality of sections, a totaling process of totaling the gift information acquired during a first section among the plurality of sections during the reproduction of the music data, and a display control process of displaying a production image according to the total value of the gift information totaled during the first section in a second section which is a section after the first section.

[0016] A terminal device side program according to an aspect of the present invention is a terminal device capable of performing operations by a user and displaying images, and is connectable to an information processing apparatus capable of outputting to a display device via a communication network. The terminal device includes a reception process of receiving a predetermined operation input to the terminal device during reproduction of music data composed of a plurality of sections, a totaling process of totaling gift information transmitted from the terminal device during a first section among the plurality of sections during the reproduction of the music data, and a transmission process of transmitting the gift information according to the received operation input to the information processing apparatus that displays a production image according to the total value of the gift information acquired during the first section in a second section which is a section after the first section.

Effects of the Invention

[0017] During an event, the production can be dynamically changed according to the support for the object to be supported and the development of the music.

Brief Description of the Drawings

[0018]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14A

Figure 14B

Figure 15A

Figure 15B

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Mode for Carrying Out the Invention

[0019] FIG. 1 is a block diagram of the information processing system 1 in this embodiment. The information processing system 1 includes a terminal device 2, an information processing device 3, and a display device 4. As an example of the information processing system 1, an event production system 11 described later can be cited. As an example of the terminal device 2, a terminal device 12 described later can be cited. As an example of the information processing device 3, a server 13 described later can be cited. As an example of the display device 4, a display device 15 described later can be cited.

[0020] The information processing device 3 is an information processing device that can be connected to the terminal device 2 that can perform operations by the user and display images via a communication network, and can output information to the display device 4. The information processing device 3 includes an acquisition unit 3a, a totaling unit 3b, and a display control unit 3c.

[0021] The acquisition unit 3a acquires gift information transmitted from the terminal device 2 in response to a predetermined operation input during the reproduction of music data composed of a plurality of sections. As an example of the acquisition unit 3a, the acquisition unit 34 described later can be mentioned.

[0022] The aggregation unit 3b aggregates the gift information acquired during the reproduction of the music data between the first sections (for example, section A or section C described later, that is, the non-effect section described later) among the plurality of sections. As an example of the aggregation unit 3b, the aggregation unit 35 described later can be mentioned.

[0023] The display control unit 3c causes an effect image to be displayed in the second section (for example, section B described later, that is, the effect section), which is the section after the first section, according to the aggregated value of the gift information aggregated during the first section. As an example of the display control unit 3c, the display control unit 36 described later can be mentioned.

[0024] By configuring in this way, the performance can be dynamically changed according to the support for the object to be supported and the development of the music at the event venue.

[0025] The aggregation unit 3b may adjust the aggregated value by weighting the values corresponding to the respective gift information according to the length of the first section. In this case, the display control unit 3c may change the performance form by the effect image according to the aggregated value of the weighted gift information.

[0026] By configuring in this way, for example, even when the first section is short and sufficient gift information cannot be acquired, the aggregated value can be adjusted by weighting, so that the same effect as accumulating points of gift information above a certain level can be obtained.

[0027] During the reproduction of the music data, the first section and the second section are repeated. In this case, the display control unit 3c may inherit part or all of the aggregated value in the first section that comes after the second section according to the aggregated value of the gift information aggregated in the first section.

[0028] By configuring in this way, it is possible to further accumulate points of gift information in the next section, so that a production image with a higher production effect can be generated, or a lively atmosphere can be connected to the next effect section.

[0029] The display control unit 3c may further display the gift object while moving it toward a display object (for example, the display object 72 described later) in which the gift object corresponding to the gift information transmitted in response to the operation input is displayed on the display device. At the same time, the display control unit 3c may change the form of the display object according to the total value of the gift information acquired in the first section.

[0030] By configuring in this way, it is possible to express the effect that the form of the display object changes as the gift object is absorbed by the display object. As a result, the feeling that the user himself / herself has sent the gift object and the interactivity can be improved.

[0031] The information processing apparatus 3 may further include a background color control unit 3d. The background color control unit 3d can control the background color of the screen to be displayed on the display unit of the terminal device 2 according to the development of the music to be played. At this time, the background color control unit 3d may synchronize the background color based on the illumination from the lighting device installed in the venue where the display device 4 is installed, the object selected on the display unit of the terminal device 2, or the position information transmitted from the terminal device 2.

[0032] By configuring in this way, the display screen of the terminal device 2 can exhibit an effect like that of a cyllium, and a sense of unity in the venue can be obtained. Also, the lighting may be synchronized or the background color may be adjusted according to the position in the venue. As a result, the sense of unity in the venue can be further improved.

[0033] The information processing apparatus 3 may further include a position information acquisition unit 3e. The position information acquisition unit 3e acquires the position information transmitted from the terminal device 2. At this time, the display control unit 3c may display a gift object corresponding to the gift information in the area corresponding to the position information based on the operation input in the display area of the display device 4. As an example of the position information acquisition unit 3e, a position information acquisition unit 37 can be cited.

[0034] With such a configuration, for example, when a user located at a position on the right side of the display device 4 transmits gift information, it is reflected as if a gift object is thrown from the right side to the center of the display area of the display device 4. Thereby, the feeling that the user himself / herself has sent the gift object and the interactivity can be improved.

[0035] The information processing apparatus 3 may further include a settlement control unit 3f. When gift information subject to charging is selected in the terminal device 2, the settlement control unit 3f switches between a first settlement process (a first settlement process S93 described later) and a second settlement process (a second settlement process S95 described later) in response to the reproduction of music data. The first settlement process is a settlement process that performs a settlement process based on the settlement method input on the settlement method input screen displayed at the timing when the gift information is selected. The second settlement process performs a settlement process based on a pre-registered settlement method that has passed a credit review. As an example of the settlement control unit 3f, a settlement control unit 39 described later can be cited.

[0036] With such a configuration, when the music data is not being reproduced, a normal settlement process such as credit card settlement is performed, but during the reproduction of the music data, it can be performed simply and quickly based on a pre-registered settlement method that has passed a credit review.

[0037] FIG. 2 is a diagram showing an example of the network configuration of the event production system in the present embodiment. The event production system 11 includes a terminal device 12, a server device (hereinafter referred to as "server") 13, a computer (hereinafter referred to as "PC") 14, a display device 15, a speaker 16, a lighting control device 17, a credit inquiry and settlement system 19, and a communication network 20. The terminal device 12, the server 13, the PC 14, and the credit inquiry / settlement system 19 are communicably connected via the communication network 20 by wired communication or wireless communication.

[0038] In the present embodiment, as an example, it is assumed that one or more users are gathered in an event venue 18 where a display device 15, a speaker 16, and a lighting control device 17 connected to the PC 14 are installed. And each user is assumed to carry at least one terminal device 12. Here, in the event venue 18, one or more artists (including groups) composed of anime and game characters are displayed on the display device 15 and other display devices, and the artists perform etc., and the user can cheer for the characters in response to the performance.

[0039] The terminal device 12 is an electronic terminal device having a communication function connectable to the communication network 20 such as a smartphone, a tablet terminal, or a mobile phone carried by a user. A web browser is installed in the terminal device 12. The terminal device 12 can display an image generated by the server 13 via the web browser. Note that the terminal device 12 may be a so-called personal computer.

[0040] The server 13 is an information processing device that can distribute various contents to the terminal device 12 and can display the contents on the display device 15 via the PC 14. The server 13 may be a server system composed of one or more physical information processing devices, or may be a virtual server system composed of one or more virtual server devices.

[0041] PC14 is a so-called personal computer that outputs the content distributed from the server 13 to the display device 15, the speaker 16, and the lighting control device 17. Note that the PC14 may be a terminal device having a communication function connectable to a communication network 20 such as a smartphone, a tablet terminal, or a mobile phone.

[0042] The display device 15 is a display device such as a display that outputs the content distributed from the server 13. Further, when the distributed content includes sound data (including voice data, music data, etc.), the sound data is output via the speaker 16. Note that the display device 15 may be a projector, and may display a screen on a screen. Also, the speaker 16 may be built in the display device 15.

[0043] The lighting control device 17 controls a plurality of lighting devices installed in the event venue 18 based on an instruction from the server 13.

[0044] When touch payment described later is performed or when an inquiry is made by the server 13 or the charging server, the credit inquiry and settlement system 19 performs a credit inquiry. A credit inquiry means to confirm the credit of a credit card user (confirmation of validity and confirmation of usage limit) with respect to a credit card company. When the credit inquiry is approved by the card company, the settlement amount is temporarily (temporarily) secured.

[0045] Here, an admission reception terminal and a settlement terminal (not shown) may be installed at the event venue 18. In this case, when entering the event venue 18, it is necessary to register (pre-register) predetermined information as a participation application in advance. In the pre-registration, settings regarding a deferred payment method for facilitating the payment of the consideration for the purchase of goods or the provision of services at the event venue are also made. Users who have completed the pre-registration are given event participation qualifications, and admission permission information (for example, a two-dimensional code such as a QR code (registered trademark)) for permitting entry into the event venue 18 is issued. Hereinafter, services are included in goods, and the payment of the consideration for the provision of services is included in the purchase of goods.

[0046] When entering the event venue 18, the user causes the issued two-dimensional code to be displayed on the user's terminal device 12 at the admission reception. Then, the admission reception staff reads the two-dimensional code with the admission reception terminal, reads the list band ID of the list band prepared in advance, and transmits it to the server 13. The server 13 acquires user information from the two-dimensional code and associates the user information with the list band ID. After the association is completed, the admission reception staff hands over the list band that holds the associated list band ID to the user. The user can purchase goods by using the list band at the event venue 18. That is, when the user purchases goods, settlement processing (hereinafter referred to as "touch settlement") is performed. Note that the touch settlement includes not only settlement using the list band directly but also settlement based on a pre-registered and credit-approved settlement method premised on settlement using the list band.

[0047] FIG. 3 is a functional and configuration block diagram of the event production system in the present embodiment. The terminal device 12 includes a communication unit 21 and an operation display unit 22. The communication unit 21 is an interface that enables communication with devices connected to the communication network 20. Here, the communication unit 21 communicates with the server 13.

[0048] The operation display unit 22 is a touch panel that enables input by an input operation and also enables display. In this embodiment, as an example, the operation display unit 22 is used, but it is not limited thereto, and the input unit and the display unit may be independent of each other. Using the operation display unit 22, the user registers user information and a payment method via the terminal device 12 when applying to participate in an event (beforehand).

[0049] Note that the terminal device 12 may include an acceleration sensor (gyro sensor) that detects the moving direction and rotational direction of the terminal device 12. As a result, when the terminal device 12 is shaken or moved or rotated in a predetermined direction, the terminal device 12 can detect the applied force and perform a predetermined operation.

[0050] The server 13 includes a communication unit 31, a control unit 32, and a storage unit 40. The communication unit 31 is an interface that enables communication with devices connected to the communication network 20. Here, it communicates with the terminal device 12 and the PC 14.

[0051] The control unit 32 functions as a user information / payment method registration unit 33, an acquisition unit 34, a totaling unit 35, a display control unit 36, a sylium control unit 37, a position information acquisition unit 38, and a settlement control unit 39.

[0052] The user information / payment method registration unit 33 acquires user information and a payment method input by the user via the terminal device 12 when applying to participate in an event (beforehand), and registers them in the user information management table 41 and the payment method management table 42.

[0053] The acquisition unit 34 acquires gift information transmitted by an operation (support operation) to support an artist (including characters in animation and games) (hereinafter referred to as "support target object") displayed on the display device 15 by an input operation of the terminal device 12. The support operation includes, for example, tapping a predetermined area displayed on the terminal device 12 or shaking the terminal device 12.

[0054] Here, the gift information includes, for example, an item name (including a code or identification information (ID)) that identifies an item (hereinafter referred to as a "gift item") for causing a gift object corresponding to the gift information to be displayed on the display device 15 in response to a support operation. The gift information may be set for each support target object. Also, the gift items may be set according to whether they are free or paid. In the case of a paid gift item, it may be set according to the set charge amount. At this time, points are assigned to each of the gift items in advance, and the points are assigned such that the free gift information has the lowest points assigned, and the points increase as the charge amount increases.

[0055] The aggregating unit 35 aggregates the number of acquired gift information and the points of each of the acquired gift information for each section preset in the music data. Also, the aggregating unit 35 can weight the points according to the interval of the section preset in the music data.

[0056] The display control unit 36 causes the support target object to be displayed on the display device 15. Note that the support target object may be displayed on a display device different from the display device 15. Also, when an operation (support operation) for supporting the support target object is performed by an input operation from the terminal device 12 during the reproduction of the music data, the display control unit 36 causes a production image corresponding to the support operation to be displayed on the display device 15.

[0057] The Cyllium control unit 37 functions as a rim for the terminal device 12 to support the object to be supported. The Cyllium control unit 38 controls the background color of the screen to be displayed on the operation display unit 22 of the terminal device 12 according to the development of the music to be played. At this time, the Cyllium control unit 37 may synchronize the background color with the color of the illumination from the illumination device installed in the venue where the display device 15 is installed. Also, the Cyllium control unit 37 may control and synchronize the background color of the screen according to the object to be supported selected on the operation display unit 22 of the terminal device 12. Further, the Cyllium control unit 37 may control and synchronize the background color of the screen according to the position information transmitted from the terminal device 12.

[0058] The position information acquisition unit 38 acquires the position information of the terminal device 12 within the event venue 18. A plurality of two-dimensional barcodes corresponding to the position information indicating the position (section) within the venue are arranged within the event venue 18. When the terminal device 12 reads the two-dimensional barcode and transmits the position information corresponding to the two-dimensional barcode to the server 13, the position information acquisition unit 38 acquires the position information.

[0059] When a charging operation is performed to purchase a gift on the terminal device 12, the settlement control unit 39 switches between a normal settlement process (first settlement process) and a touch settlement process (second settlement process) according to the reproduction of the music data, and executes the switched settlement process. Normal settlement is a settlement method in which settlement processing is performed based on the settlement method input on the settlement method input screen displayed at the timing when a gift item is selected on the terminal device 12, and is, for example, the commonly used credit card settlement. Touch settlement is a settlement method that is performed simply and quickly based on a pre-registered settlement method that has passed a credit review. The settlement control unit 39 performs normal settlement processing before the performance starts or after the performance ends, and performs settlement processing based on the touch settlement process during the performance.

[0060] The storage unit 40 stores a user information management table 41, a payment method management table 42, user interface (hereinafter referred to as "UI") data 43 for a terminal device, gift object data 44, character data 45, music data 46, effect data 47, and a billing management database (hereinafter, the database is referred to as "DB").

[0061] The user information management table 41 is a table for managing information of users participating in an event. The payment method management table 42 is a table for managing payment methods registered in advance for using touch payment or payment based on touch payment. The payment method management table 42 includes information such as credit card payment information and the delivery destination of a user's bill for making a deferred payment at a store such as a convenience store at a later date. The UI data 43 is data regarding a support input interface to be displayed on the terminal device 12, a background color, and an input display screen for determining billing.

[0062] The gift object data 44 is data regarding a gift object corresponding to gift information for display on the display device 15, and includes information regarding points of the gift information. The character data 45 is data regarding a character (information regarding the visual and motion (animation) of a support target object) whose performance is to be displayed as an animation on the display device 15. The music data 46 is music data that is reproduced according to the performance motion of the character, and intervals are set in advance as will be described later. The effect data 47 is various production images to be displayed on the display device from the start to the end of the performance, and includes data (data regarding the syruium function is also included) including various display enhancement effects for livening up the performance or performance according to a support operation, for example.

[0063] The billing management DB49 is a database that manages billing processes (including normal payment processes, touch payment processes, payment processes based on touch payment processes, etc.). In FIG. 3, the billing management DB49 is stored in the storage unit 40, but this is just an example and it may be stored in another storage device.

[0064] The PC 14 includes a communication unit 51 and an output unit 52. The communication unit 51 is an interface that enables communication with devices connected to the communication network 20. Here, it communicates with the server 13. The output unit 52 is an output interface that is connected to the display device 15, the speaker 16, and the lighting control device 17 and outputs data and commands.

[0065] FIG. 4 is a flowchart for explaining the overall flow of this embodiment. First, when the user applies to participate in an event (in advance), the user registers user information and a payment method using the terminal device 12 (S1).

[0066] Next, at the event venue 18, when the performance (reproduction of music data) starts, the user reads a two-dimensional barcode arranged near the position (section) where the user cheers using the terminal device 12 (S2). That two-dimensional barcode serves as information for specifying that position (section) at the event venue 18.

[0067] Before the performance (reproduction of music data) starts at the event venue 18, the user purchases a gift item for cheering for the cheering target object by operating the terminal device 12 as needed (S3). In S3, the payment method is a payment process by the above-mentioned normal payment.

[0068] The performance (reproduction of music data) starts (S4). Then, in response to the reproduction of the music, the user performs a cheering operation on the terminal device 12 and transmits gift information based on the selected gift item to the server 13. Then, at the server 13, various effect processes for livening up the performance are performed according to the development of the song and the total value of the gift information transmitted and aggregated (S5).

[0069] Also, the server 13 controls the background color of the display screen to be displayed on the terminal device 12 via the web browser in accordance with the development of the music in the music data (S6). Thereby, the display screen by the web browser exhibits an effect like that of a cymbal, and a sense of unity at the venue can be obtained.

[0070] Even during the performance, the user can, if necessary, operate the terminal device 12 to purchase a gift item for cheering for the cheering target object (S7). In this case, since it is during the performance, the server 13 performs settlement processing based on touch settlement in order to reduce the burden on the user's settlement operation.

[0071] Hereinafter, each process and procedure of the flow described in FIG. 4 will be specifically described. First, S1 in FIG. 4 will be described.

[0072] FIG. 5 is a sequence diagram of the pre-registration process (S1) in the present embodiment. FIG. 6 is a diagram showing an example of a touch settlement setting screen displayed on the terminal device in the pre-registration process in the present embodiment. Hereinafter, FIG. 5 will be described with reference to FIG. 6. For convenience of explanation, hereinafter, displaying on the operation display unit 22 of the terminal device 12 may sometimes be described as displaying on the terminal device 12.

[0073] First, in order for the user to participate in the event, it is necessary to make a predetermined setting in advance as an application for participation. Therefore, the user accesses a predetermined portal site using the web browser installed in the terminal device 12 (S11). Then, a predetermined input operation is performed on the portal site to apply for participation in a predetermined event and to display a setting screen (touch settlement screen) for registering the settlement method at the event venue (S12).

[0074] When the user presses "Proceed with the procedure" on the touch payment screen, the terminal device 12 sends a request to the server 13 to set the payment method (S13). In response, the server 13 causes the terminal device 12 to display a payment method setting screen 61 as shown in FIG. 6 (S14).

[0075] The user inputs the payment method into the payment method setting screen 61 using the terminal device 12. For example, on the payment method setting screen 61, when the user selects credit card payment, the user inputs the necessary information into the credit card payment setting field 62. If one or more credit card information has already been registered, the last four digits of the credit card are displayed and any of the credit cards can be selected. Also, when the "Add Credit Card" button 63 is pressed, a new credit card can be registered.

[0076] Also, on the payment method setting screen 61, when selecting deferred payment (a form of paying the price at a convenience store using a bill mailed at a later date), the necessary information is input into the deferred payment setting field 64. If one or more bill delivery addresses have already been registered, the bill delivery address is displayed and any of the bill delivery addresses can be selected. Also, when the "Add New Delivery Address" button 65 is pressed, a new bill delivery address can be registered.

[0077] Note that the payment of the price is not limited to convenience stores, and if payment at a bank, post office, etc. using the bill is also allowed, it may be paid at a bank, post office, etc.

[0078] Also, in the credit card payment setting field 62 and / or the deferred payment setting field 64 of the payment method setting screen 61, the above-mentioned "upper limit" can be set.

[0079] When the user finishes entering the necessary information on the payment method setting screen 61 and presses the "Confirm Application" button 66 in Fig. 6, the terminal device 12 sends a registration request for user information to the server 13 (S15). In response, the server 13 makes a credit inquiry to the credit inquiry and payment system 19 based on the user's name, phone number, and address (which may further include credit card information) (S16), and receives the credit check result (S17). Then, the server 13 causes the terminal device 12 to display a setting completion screen (not shown) (S18). On the setting completion screen (not shown), the server 13 displays that the touch payment setting has been completed and the registered content.

[0080] Note that in the pre-registration, short message service authentication (SMS authentication) may be used. This can improve the security during pre-registration. In Fig. 6, when the "Back" button 67 is pressed, the screen returns to the previous screen.

[0081] Next, S2 in Fig. 4 will be described. Fig. 7 is a diagram showing an arrangement example of two-dimensional barcodes indicating position information within the event venue in this embodiment. In the event venue 18, two-dimensional barcodes X1 to X12 are arranged, and the two-dimensional barcodes X1 to X12 each indicate the arranged position. The two-dimensional barcode may be, for example, a sheet on which it is printed and attached to a fixed object. Also, the operation staff may hold the sheet on which the two-dimensional barcode is printed, or it may be displayed on the terminal device of the operation staff.

[0082] Fig. 8 is a diagram for explaining a configuration example and section of music data in this embodiment. The horizontal axis in Fig. 8 represents the development of the song. The song starts, for example, from the intro and is composed of parts such as A melody, B melody, C melody, and the refrain. The horizontal axis represents the emotional ups and downs (the user's tempo, excitement). The color of the bar indicates the tune.

[0083] In this embodiment, as an example, the basic composition of the performance is divided into the following three sections: A, B, and C. Section A (A1, A2) is the melody section for listening to the music. Section B (B1, B2, B3) is the refrain section. Section C (C1) is the section where the excitement continues following the refrain section. These sections are preset.

[0084] In this embodiment, gift information is transmitted to the server 13 by a support operation on the user's terminal device 12. The server 13 controls a special effect in section B based on the points of the gift information accumulated in sections A and C. For example, in section A, the user is invited to participate in the support operation gently. As a result, the points of the gift information gradually accumulate in the server 13. If the points of the gift information have accumulated to a certain level or more in section B, the special effect described later is activated. Also, section C is the section where the excitement continues following the refrain, and is the section where the user is invited to participate in the support operation more actively towards the final special effect. For example, as a result of accumulating the points of the gift information collected in section A1, the special effect is activated in section B1. As a result of accumulating the points of the gift information collected in section A2, the special effect is activated in section B2. As a result of accumulating the points of the gift information collected in section C1, the special effect is activated in section B3. Incidentally, hereinafter, the section corresponding to section B may be referred to as the "effect section". Also, the section corresponding to section A or section C may be referred to as the "non-effect section".

[0085] Next, S4 and S5 in FIG. 4 will be described. Note that S3 will be described later together with S7.

[0086] FIG. 9 is a diagram showing an example of an image displayed on the display device at the start of playing music data in the present embodiment. Below the display area 71 of the display device 15, as a support target object 73, three character support target objects 73a, 73b, and 73c are displayed. As an example, the music used in the present embodiment is set to be played by the support target objects 73a, 73b, and 73c. Also, a display object 72 is displayed in the display area above the support target objects 73a, 73b, and 73c. The display object 72 is designed to change its form, such as growing larger, changing its shape, or changing its color, as it absorbs the gift information transmitted by the support operation. Note that the support target objects 73a, 73b, and 73c may be displayed on another display device. Also, the display object 72 is not limited to a circular or spherical shape, and may have any shape, form, color, or appearance, and may move by animation or the like.

[0087] FIG. 10 is a support operation input screen to be displayed on the terminal device during the playback of music data in the present embodiment. The support operation input screen 81 can be displayed via a web browser.

[0088] In the support target object selection bar 84, any one of the support target objects 73a, 73b, and 73c can be selected. When any one of the support target objects is selected in the support target object selection bar 84, an image of the selected support target object is displayed in the display area 82. Also, the background color of the background area 85 is switched according to the selected support target object.

[0089] The gift selection column 83 can be used to select a gift item to be sent by a cheering operation. When any gift item is selected in the gift selection column 83, an image of the selected gift item is displayed in the display area 82. The gift information displayed in the gift selection column 83 changes according to the cheering target object selected in the cheering target object selection column 84. Gift items include both free and paid ones. Here, for example, if 1 yen = 1 point (pt), the gift items in the gift selection column 83a can be used for free (0 pt). The gift items in the gift selection column 83b can be used with 100 pt and have already been purchased by charging 100 yen. A locked lock object is displayed in the gift selection column 83c, indicating that the 500-pt gift item has not been purchased.

[0090] In this state, by performing a predetermined operation such as tapping, sliding, or shaking the terminal device 12 with a finger on the cheering operation input area 86, the gift information corresponding to the selected gift item can be sent to the server 13.

[0091] FIG. 11 is a diagram showing an example of an effect display in which gift objects gather and fly towards the display object according to the position information in the present embodiment. Here, FIG. 11 is an effect image in a section (i.e., a non-effect section) corresponding to the above-described section A or section C.

[0092] For example, an effect image is displayed such that the gift object 91 transmitted in FIG. 10 is absorbed by the display object 72.

[0093] Also, based on the position information read from the two-dimensional barcode in S2 of FIG. 4, an effect image is displayed as if a gift object is thrown from a position corresponding to the position information. For example, when the two-dimensional barcode X8 is being read in FIG. 7, an effect image is displayed as if the gift object 91 is thrown from the right side of the display area 71 towards the central display object 72.

[0094] FIG. 12 is a diagram showing an example of a special effect in the effect section in the present embodiment. Here, FIG. 12 shows an effect image (special effect image 92) for a special effect in a section (effect section) corresponding to section B described above.

[0095] When the effect section arrives during the reproduction of the music data, the special effect image 92 is displayed according to the total of the points of the gift information stored in the non-effect section before that. The greater the total of the points, the greater the degree of the effect of the special effect image 92.

[0096] As the special effect image 92, for example, it may be an image in which a mass of gift information collected so far ruptures, or an image in which fireworks go off, or an image in which stars fall. Also, the effect of the special effect of the special effect image becomes greater as the end of the music approaches, and the effect section of the last refrain part becomes the largest. In addition, as one of the effects, at a predetermined timing or according to the total number of points, a large cut of the support target object may be displayed at the center of the display area 71.

[0097] FIG. 13 is a sequence diagram related to the support operation in the present embodiment. First, the user reads a two-dimensional barcode arranged near his / her seat at the event venue 18 with the terminal device 12 (S21). The terminal device 12 holds the position information indicated by the two-dimensional barcode.

[0098] As described with reference to FIG. 9, the server 13 causes the display device 15 to display the display object 72 and the support target object and starts the reproduction of the music data in accordance with the start of the performance (S22).

[0099] The user transmits gift information to the server 13 by performing a support operation using the terminal device 12. At this time, the terminal device 12 also transmits the position information acquired in S21 to the server 13 (S23). The server 13 displays a production image (including a special production image) on the display device 15 according to the gift information, position information, and the section set in the music data transmitted from the terminal device 12 (S24). S23 and S24 are repeated during the reproduction of the music data.

[0100] When the performance (reproduction of music data) ends, the server 13 displays an end roll on the display device 15 (S25). The end roll, for example, largely displays the user's nickname according to the points of the transmitted gift information, or is displayed in a determined order.

[0101] FIGS. 14A and 14B are flowcharts of Example 1 of the production process (S5) based on the section of music data by the server in the present embodiment. The control unit 32 of the server 13 reads out the program according to the present embodiment from the storage device and functions as an acquisition unit 34, a totaling unit 35, a display control unit 36, and a position information acquisition unit 38, and executes the flows of FIGS. 14A and 14B. Hereinafter, the process by the control unit 32 is described as the process by the server 13 for convenience.

[0102] When the server 13 acquires an instruction to reproduce a music, the server 13 starts reproducing the music data (S31). The server 13 initializes a parameter (total value of points) P for totaling points to 0 (S32). The server 13 displays a support target object 73 and a display object 72 on the display device 15 (S33).

[0103] Server 13 acquires the gift information and location information transmitted from terminal device 12 (S34). Server 13 refers to gift object data 44 to identify the acquired gift information (S35). Server 13 causes the gift objects corresponding to the identified gifts to be displayed so as to gather at display object 72 based on the location information (S36). Server 13 changes the form of the display object as the gift objects are absorbed by the display object (S37).

[0104] Server 13 refers to gift object data 44 to specify the points Pi corresponding to the identified gift information (S38). Server 13 adds the points Pi to the point total value P (S39).

[0105] Server 13 determines whether an effect category has arrived (S40). If the effect category has not arrived (NO in S40), Server 13 returns to the process of S34. The processes of S34 to S39 are repeated until the effect category arrives.

[0106] If the effect category has arrived (YES in S40), Server 13 generates a special effect image according to the total value P (S41) and causes it to be displayed (S42). Here, when the total value P exceeds a predetermined value, for example, assuming that the points are full, a special effect image may be displayed. The predetermined value may vary each time according to, for example, the number of users participating or the points set for the gift items.

[0107] Server 13 determines whether the effect category has ended (S43). If the effect category has not ended (NO in S43), Server 13 returns to the process of S41. The processes of S41 to S42 are repeated until the effect category ends.

[0108] When the effect section ends (YES in S43), the server 13 determines whether the playback of the music has ended (S44). If the playback of the music has not ended (NO in S44), the server 13 initializes the aggregated value P to 0 or reduces it to a predetermined value (S45), and returns to the process of S34. The processes of S34 to S45 are repeated until the playback of the music ends.

[0109] When the playback of the music ends (YES in S44), the server 13 fades out the production image (S46) and finally displays the end roll (S47). As described above, in the end roll, the server 13, for example, largely displays the user's nickname or displays it in a determined order according to the points of the transmitted gift information.

[0110] FIGS. 15A and 15B are flowcharts of Example 2 of the production process (S5) based on the music data section by the server in the present embodiment. The control unit 32 of the server 13 reads out the program according to the present embodiment from the storage device and functions as the acquisition unit 34, the aggregation unit 35, the display control unit 36, and the position information acquisition unit 38, and executes the flows of FIGS. 15A and 15B. Hereinafter, the process by the control unit 32 is described as the process by the server 13 for convenience.

[0111] FIGS. 15A and 15B are flowcharts in which the processes of S32-1 and S32-2 are added to FIGS. 14A and 14B, S39 is replaced with the process of S39-1, and further, S45 is replaced with the processes of S45-1, S45-2, and S45-3. In Example 2, the gift points are weighted according to the length of the section before the effect section of Example 1.

[0112] When the server 13 acquires a music playback instruction, it starts playing the music data (S31). The server 13 initializes a parameter (point aggregation value) P for aggregating points to 0 (S32).

[0113] Server 13 calculates the time T until the effect section (S32-1). Server 13 sets the weight W according to the calculated time T (S32-2). For example, the shorter the time T is, the heavier the weight set by Server 13 is.

[0114] Server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0115] Server 13 acquires the gift information and the position information transmitted from the terminal device 12 (S34). Server 13 identifies the acquired gift information with reference to the gift object data 44 (S35). Based on the position information, Server 13 causes the gift object corresponding to the identified gift to be displayed so as to gather at the display object 72 (S36). Server 13 changes the form of the display object as the gift object is absorbed by the display object (S37).

[0116] Server 13 identifies the point Pi corresponding to the identified gift information with reference to the gift object data 44 (S38). Server 13 adds the value obtained by multiplying the point Pi by the weight W to the point total value P (S39-1).

[0117] Server 13 determines whether the effect section has arrived (S40). If the effect section has not arrived (NO in S40), Server 13 returns to the process of S34. The processes of S34 to S39 are repeated until the effect section arrives.

[0118] When the effect section has arrived (YES in S40), Server 13 generates a special effect image according to the total value P (S41) and displays it (S42). Here, when the total value P exceeds a predetermined value, for example, assuming that the points are full, a special effect image may be displayed. The predetermined value may vary each time according to, for example, the number of users participating and the points set for the gift item.

[0119] Server 13 determines whether the effect section has ended (S43). If the effect section has not ended (NO in S43), server 13 returns to the process of S41. The processes of S41 to S42 are repeated until the effect section ends.

[0120] If the effect section has ended (YES in S43), server 13 determines whether the playback of the music has ended (S44). If the playback of the music has not ended (NO in S44), server 13 calculates the time T until the effect section (S45-1). Server 13 sets the weight W according to the calculated time T (S45-2). For example, the shorter the time T, the heavier the weight set by server 13. Also, server 13 reduces the aggregated value P to a predetermined value according to the time T (S45-5), and returns to the process of S34. The processes of S34 to S45 are repeated until the playback of the music ends.

[0121] If the playback of the music has ended (YES in S44), server 13 fades out the production image (S46), and finally displays the end roll (S47). As described above, in the end roll, server 13, for example, largely displays the user's nickname or displays it in a determined order according to the points of the transmitted gift information.

[0122] Note that in the process of S45-3, by reducing the aggregated value P without initializing it, the aggregated value can be carried over to the next section A or section C (non-effect section), and the excitement can be continued.

[0123] Next, S6 in FIG. 4 will be described. FIG. 16 is a sequence diagram for making the terminal device in the present embodiment function as a syrinx and synchronizing it with the lighting in the event venue. Server 13 switches the background color of the display area 85 of the terminal device according to the development of the music via the web browser (S51). Further, server 13 may control the lighting control device 17 in accordance with the switching of the background color, synchronize the lighting devices in the event venue, and switch the color and irradiation direction of the lighting (S52).

[0124] Figure 17 is a flowchart for causing the server in the present embodiment to function as a cymbal for the terminal device and synchronizing it with the lighting in the event venue. The control unit 32 of the server 13 reads out the program according to the present embodiment from the storage device, functions as a cymbal control unit 37 and a position information acquisition unit 38, and executes the flow of Figure 17. Hereinafter, for convenience, the processing by the control unit 32 will be described as the processing by the server 13.

[0125] The server 13 acquires the position information transmitted from the terminal device 12 (S61). For each terminal device 12, the server 13 determines the background color of the display area 85 according to the music development, position information, and / or the selected support target object (S62). The server 13 notifies the terminal device 12 of the information regarding the determined background color. Further, the server 13 notifies the lighting control device 17 of an instruction for performing lighting processing according to the background color (S63).

[0126] The server 13 repeats the processing of S62 to S64 until the reproduction of the music data ends (NO in S64). When the reproduction of the music data ends, this flow ends (YES in S64).

[0127] Thereby, the display screen by the web browser exhibits an effect like that of a cymbal, and further, by controlling the lighting in the event venue 18, a sense of unity within the event venue can be obtained.

[0128] Next, the settlement processing of S3 and S7 in Figure 4 will be described. Figure 18 is a sequence diagram of the normal credit card settlement processing before or after the reproduction of the music data in the present embodiment and the processing based on the pre-registered information for touch settlement during the reproduction of the music data.

[0129] Before or after the reproduction of music data, the user operates the terminal device 12 to purchase an item as gift information (S71). For example, in FIG. 10, when the lock-off object in the gift selection column 83c is tapped, a list of 500-pt gift items is displayed, and the user can select a gift item to purchase.

[0130] When the server 13 acquires gift information regarding the selected gift item, it causes the terminal device 12 to display a payment method input screen for purchasing the gift item (S72).

[0131] The user uses the terminal device 12 to input a payment method on the payment method input screen (S73). The server 13 causes the terminal device 12 to display a confirmation screen for the user to confirm the content input on the payment method input screen (S74).

[0132] The user uses the terminal device 12 to confirm the confirmation screen and taps the confirmation button (S75). Then, the server 13 makes a credit inquiry to the credit inquiry and payment system 19 (S76). When receiving a credit inquiry result from the credit inquiry and payment system 19 (S77), the server 13 notifies the terminal device 12 whether the payment is completed or not according to whether the sum of the cumulative payment amount within a predetermined period and the current payment amount exceeds a preset upper limit amount or according to the credit inquiry result (S76). In the case of non-payment, the content "Payment could not be made." is displayed on the terminal device 12, and the selected gift item cannot be purchased.

[0133] On the other hand, during the reproduction of music data, the user operates the terminal device 12 to purchase an item as gift information (S81). For example, in FIG. 10, when the lock-off object in the gift selection column 83c is tapped, a list of 500-pt gift items is displayed, and the user can select a gift item to purchase.

[0134] When the server 13 acquires the gift information regarding the selected gift item, it causes the terminal device 12 to display a confirmation screen on which the purchase details and payment method of the gift item are entered, based on the information registered in advance in S1 of FIG. 4 (S82).

[0135] The user uses the terminal device 12 to check the confirmation screen and taps the confirmation button (S83). Then, the server 13 makes a credit inquiry to the credit inquiry and settlement system 19 (S84). When receiving the credit inquiry result from the credit inquiry and settlement system 19 (S85), the server 13 notifies the terminal device 12 whether the settlement is completed or not according to whether the sum of the cumulative payment amount within a predetermined period and the current payment amount exceeds a preset upper limit amount, or according to the credit inquiry result (S86). In the case of non - settlement, the content "Settlement could not be made." is displayed on the terminal device 12, and the selected gift item cannot be purchased.

[0136] FIG. 19 is a flowchart of a settlement process in which the settlement method is switched according to the reproduction of music data in the present embodiment. The control unit 32 of the server 13 reads out the program according to the present embodiment from the storage device, functions as the settlement control unit 39, and executes the flow of FIG. 19. Hereinafter, for convenience, the processing by the control unit 32 is described as the processing by the server 13.

[0137] When the server 13 acquires a purchase request for a gift item from the terminal device 12 (S91), it determines whether music data is being reproduced (S92). If the music data is not being reproduced (NO in S92), the server 13 performs the first settlement process (S93).

[0138] In the first settlement process (S93), the server 13 causes the terminal device 12 to display a settlement method input screen (S93a). When the input of the settlement method is completed on the settlement method input screen on the terminal device 12, the server 13 accepts the settlement method (S93b).

[0139] Server 13 causes the terminal device 12 to display a confirmation screen for the user to confirm the received payment method (S93c). When the user uses the terminal device 12 to confirm the confirmation screen and taps the confirmation button, server 13 receives the confirmation instruction (S93d).

[0140] Based on the obtained payment method, server 13 performs payment processing for the amount of the gift item (S93e). When the obtained payment method is "credit card payment", server 13 obtains valid credit card information corresponding to the user ID from the payment method management table 42. Server 13 makes a credit inquiry to the credit inquiry and payment system 19 based on the obtained credit card information and performs payment processing for the amount.

[0141] When the obtained payment method is post-payment, server 13 obtains valid invoice delivery destination information corresponding to the user ID from the payment method management table 42. Server 13 performs payment processing for the amount based on the obtained invoice delivery destination information. Note that server 13 may stop the payment processing when the sum of the cumulative payment amount within a predetermined period and the current payment amount exceeds a preset upper limit. Server 13 notifies the terminal device 12 of the result of the payment processing (S93f).

[0142] In S92, when the music data is being played (YES in S92), server 13 refers to the payment method management table 42 to determine whether the user has made a prior registration for touch payment (S94). When no prior registration for touch payment is registered (NO in S94), server 13 performs the first payment processing (S93). When a prior registration for touch payment is registered (YES in S94), server 13 performs the second payment processing (S95).

[0143] In the second payment process (S95), the server 13 causes the terminal device 12 to display a confirmation screen (S95a) in which the purchase details of the gift item and the payment method are entered, based on the information pre-registered in the payment method management table 42 in S1 of FIG. 4. When the user uses the terminal device 12 to check the confirmation screen and taps the confirmation button, the server 13 accepts the confirmation instruction (S95b).

[0144] Based on the acquired payment method, the server 13 performs a payment process for the amount of the gift item (S95c). When the acquired payment method is "credit card payment", the server 13 acquires valid credit card information corresponding to the user ID from the payment method management table 42. The server 13 makes a credit inquiry to the credit inquiry and payment system 19 based on the acquired credit card information and performs a payment process for the amount.

[0145] When the acquired payment method is deferred payment, the server 13 acquires valid invoice delivery destination information corresponding to the user ID from the payment method management table 42. The server 13 performs a payment process for the amount based on the acquired invoice delivery destination information. Note that the server 13 may stop the payment process when the sum of the cumulative payment amount within a predetermined period and the current payment amount exceeds a preset upper limit. The server 13 notifies the terminal device 12 of the result of the payment process (S95d).

[0146] FIG. 20 is an example of a configuration block diagram of the hardware environment of a computer that executes the program in the present embodiment. The computer 101 functions as the terminal device 12 or the server 13. The computer 101 includes a CPU 102, a ROM 103, a RAM 104, a storage device 105, an input I / F 106, an output I / F 107, a communication I / F 108, a reading device 109, and a bus 120.

[0147] Here, CPU indicates a central processing unit. ROM indicates a read-only memory. RAM indicates a random access memory. I / F indicates an interface. Connected to bus 140 are CPU 102, ROM 103, RAM 104, storage device 105, input I / F 106, output I / F 107, communication I / F 108, and, if necessary, reading device 109.

[0148] When CPU 102 reads out the program according to this embodiment from storage device 105 and functions as server 13, it executes the program as user information / payment method registration unit 33, acquisition unit 34, aggregation unit 35, display control unit 36, sylium control unit 37, position information acquisition unit 38, and settlement control unit 39. Also, when CPU 102 reads out the program according to this embodiment from storage device 105 and functions as terminal device 12, it executes the program as reception processing unit and transmission processing unit. When functioning as the reception processing unit, CPU 102 receives a predetermined operation input to terminal device 12 during the reproduction of music data composed of a plurality of sections. When functioning as the reception processing unit, CPU 102 aggregates the gift information transmitted from terminal device 12 during the first section among the plurality of sections during the reproduction of the music data, and transmits the gift information according to the received operation input to server 13 that displays a production image according to the aggregated value of the gift information acquired during the first section in the second section, which is the section after the first section. ROM 103 indicates a read-only memory. RAM 104 is a memory for temporary storage.

[0149] Storage device 105 is a device for storing a large amount of information. As storage device 105, various types of storage devices such as a hard disk, a solid state drive (SSD), and a flash memory card can be used. Stored in storage device 105 are the program according to the embodiment of the present invention and various data stored in storage unit 40.

[0150] The input I / F 106 can be connected to input devices such as a keyboard, mouse, electronic camera, web camera, microphone, scanner, sensor, tablet, touch panel, information reading device, etc. Also, the output I / F 107 can be connected to output devices such as a display, touch panel, projector, printer, speaker, etc.

[0151] The communication I / F 108 is an interface such as a port for connecting to a communication network and communicating with other devices. The communication network may be a communication network such as the Internet, local area network (LAN), wide area network (WAN), dedicated line, wired, wireless, etc. The reading device 109 is a device for reading a portable recording medium.

[0152] The program for realizing the processing described in the above embodiment may be stored in, for example, the storage device 105 from the program provider side via the communication network and the communication I / F 108. Also, the program for realizing the processing described in the above embodiment may be stored in a commercially available and distributed portable recording medium. In this case, this portable recording medium may be set in the reading device 105, and the program may be read and executed by the CPU 102. As the portable recording medium, various types of recording media such as CD-ROM, flexible disk, optical disk, magneto-optical disk, IC card, USB memory device, semiconductor memory card, etc. can be used. The program stored in such a recording medium is read by the reading device 109.

[0153] Also, the program may be installed in a stand-alone type computer, or may be installed by a cloud computer and only the functions may be provided to the user. Also, in the terminal device 12, the screen display in this embodiment was performed using a web browser, but an application program capable of communicating with the server 13 may be installed in the terminal device 12 to perform the screen display in this embodiment.

[0154] According to this embodiment, in an event, the effects can be dynamically changed according to the support for the object to be supported and the development of the music. Also, since the reaction by the support operation is visually reflected in the effects in real time, the feeling that the user himself / herself has sent the gift object and the interactivity can be improved.

[0155] Also, the object to be supported is not limited to characters in anime, games, etc., and may be a human artist, or may be something other than a human such as an animal or a robot. Also, the content of the effects of the effect image (special effect image) is not limited, and any content of the effects may be used. Also, in this embodiment, intervals are set in advance in the music data, but intervals may be formed in real time at a predetermined timing according to the atmosphere at the scene. Also, the intervals are not limited to A melody, B melody, refrain, etc., and may be set arbitrarily.

[0156] As described above, the present aspect has been described based on the embodiment and the modification examples. However, the embodiments of the above-described aspects are for facilitating the understanding of the present aspect and do not limit the present aspect. The present aspect can be changed and improved without departing from the gist and the scope of the claims, and equivalents thereof are included in the present aspect. Also, if the technical features are not described as essential in this specification, they can be deleted as appropriate.

Explanation of Reference Numerals

[0157] 1 Information Processing System 2 Terminal Device 3 Information Processing Device 3a Acquisition Unit 3b Aggregation Unit 3c Display Control Unit 3d Background Color Control Unit 3e Position Information Acquisition Unit 3f Settlement Control Unit 4 Display Device 5 Acquisition Unit 6 Payment Amount Determination Unit 7 Settlement Processing Unit 8 Amount Management Unit 11 Event production system 12 Terminal device 13 Server 14 PC 15 Display device 16 Speaker 17 Lighting control device 18 Event venue 19 Authentication inquiry and settlement system 20 Communication network 21 Communication unit 22 Operation display unit 31 Communication unit 32 Control unit 33 User information and payment method registration unit 34 Acquisition unit 35 Aggregation unit 36 Display control unit 37 Thallium control unit 38 Location information acquisition unit 39 Settlement control unit 40 Memory unit 51 Communication unit 52 Output unit

Claims

1. An information processing device that is connectable to a terminal device capable of performing operations by a user and displaying images via a communication network and is capable of outputting to a display device, an acquisition unit that acquires gift information transmitted from the terminal device in response to a predetermined operation input during reproduction of music data composed of a plurality of sections; an aggregation unit that aggregates the gift information acquired during a first section among the plurality of sections during the reproduction of the music data; a display control unit that causes an effect image to be displayed in a second section, which is a section after the first section, according to the aggregation value of the gift information aggregated during the first section; An information processing apparatus comprising the above.

2. The aggregation unit adjusts the aggregation value by weighting values corresponding to the respective pieces of gift information according to the length of the first section, The display control unit changes the effect form by the effect image according to the aggregation value of the gift information that has been weighted. The information processing apparatus according to claim 1, characterized in that.

3. During the reproduction of the music data, the first section and the second section are repeated, The display control unit takes over part or all of the aggregation value in a first section that comes after the second section according to the aggregation value of the gift information aggregated in the first section. The information processing apparatus according to claim 1 or 2, characterized in that.

4. The display control unit further displays while moving the gift object so that the gift object corresponding to the gift information transmitted in response to the operation input flies toward the display object displayed on the display device, and changes the form of the display object according to the aggregation value of the gift information acquired in the first section. The information processing apparatus according to any one of claims 1 to 3, characterized in that.

5. The information processing apparatus further includes a background color control unit that controls the background color of the screen to be displayed on the display unit of the terminal device according to the development of the reproduced music; Comprising The background color control unit synchronizes the background color based on the illumination from an illumination device installed in the venue where the display device is installed, an object selected on the display unit of the terminal device, or position information transmitted from the terminal device. The information processing apparatus according to any one of claims 1 to 4, characterized in that.

6. The information processing apparatus further includes a position information acquisition unit that acquires the position information transmitted from the terminal device, wherein the display control unit causes a gift object corresponding to the gift information to be displayed in a region corresponding to the position information based on the operation input in a display area of the display device, according to any one of claims 1 to 5. **Claim 7** The information processing apparatus further when the gift information to be charged is selected in the terminal device, includes a first settlement process that performs a settlement process based on a settlement method input to a settlement method input screen displayed at the timing when the gift information is selected, in response to the reproduction of the music data, and a second settlement process unit that performs a settlement process based on a pre-registered and credit-approved settlement method, and a settlement control unit that switches between them, according to any one of claims 1 to 6. **Claim 8** An information processing apparatus capable of being connected to a terminal device capable of performing operations by a user and displaying images via a communication network, and outputting to a display device, an acquisition process of acquiring gift information transmitted in response to a predetermined operation input from the terminal device during reproduction of music data composed of a plurality of sections, an aggregation process of aggregating the gift information acquired during a first section among the plurality of sections during the reproduction of the music data, a display control process of displaying a production image according to an aggregation value of the gift information aggregated during the first section in a second section that is a section after the first section, wherein the information processing apparatus side program is executed. **Claim 9** A terminal device capable of performing operations by a user and displaying images, and capable of being connected to an information processing apparatus capable of outputting to a display device via a communication network, a reception process of receiving a predetermined operation input to the terminal device during reproduction of music data composed of a plurality of sections, an aggregation process of aggregating gift information transmitted from the terminal device during a first section among the plurality of sections during the reproduction of the music data, and a transmission process of transmitting the gift information in response to the received operation input to the information processing apparatus that displays a production image according to an aggregation value of the gift information acquired during the first section in a second section that is a section after the first section, wherein the terminal device side program is executed.

Images