Information processing device, information processing device side program, and terminal device side program

Abstract

To provide a technique which can dynamically change performance in an event in response to cheering for a cheer object and development of music.SOLUTION: The present invention is directed to an information processing apparatus which can be connected through a communication network to a terminal device capable of being operated by a user and displaying an image and which can output data to a display device. The information processing apparatus has an acquiring unit for acquiring gift information transmitted from the terminal device in response to a predetermined input operation during reproduction of musical piece data forming a plurality of sections, a collecting unit for collecting gift information acquired during a first section of the plurality of sections during reproduction of the musical piece data, and a display control unit for displaying a performance image in response to collected values of the gift information collected during the first section in a second section immediately succeeding the first section. Thus, the information processing apparatus solves the problem.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing device-side program, and a terminal device-side program. [Background technology]

[0002] Conventionally, various production methods have been devised to enliven the atmosphere of events such as concerts and live performances. For example, production methods such as displaying images on a large display in time with the music and changing the color and lighting pattern of spotlights are known.

[0003] As a technology related to such production, for example, a user-participation event production system has been disclosed (for example, Patent Document 1). This event production system provides a production that can enhance the sense of unity between participants and the artist by using image data (photos) and audio data (vocals) uploaded to a server in advance by concert participants in the production of the concert. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-016442 A Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, in concerts, live shows, and other events, the main characters are not only people such as artists and performers, but also, for example, anime and game characters. When the cheering team targets such as artists, performers, and characters start to play, the audience waves their glow sticks to cheer on the cheering targets according to the progress of the song, livening up the song.

[0006] However, in conventional events, the production was set up in advance by the organizers based on a schedule, for example, but there was no production that could liven up the event venue in real time in accordance with the progression of the music or the mood of the venue at that time. For example, as mentioned above, in Patent Document 1, image data (photos) and audio data (vocals) uploaded to a server by concert participants in advance are used for the concert production, and it is not possible to create a production that changes according to the cheering situation of the audience during the performance.

[0007] The present invention provides a technique for dynamically changing the presentation of an event in accordance with cheering for a cheer target object and the progression of music. [Means for solving the problem]

[0008] An information processing device according to one aspect of the present invention is an information processing device that is connectable via a communications network to a terminal device that can perform user operations and display images, and is capable of outputting to a display device, and is characterized in that it comprises: an acquisition unit that acquires gift information transmitted from the terminal device in response to a predetermined operation input during playback of music data consisting of a plurality of sections; a counting unit that counts the gift information acquired during a first section of the plurality of sections during playback of the music data; and a display control unit that displays a performance image in a second section that is the section following the first section, in accordance with the aggregate value of the gift information counted during the first section.

[0009] In the above information processing device, the aggregation unit adjusts the aggregated value by weighting values ​​corresponding to each of the gift information according to the length of the first section, and the display control unit changes the presentation form of the presentation image according to the weighted aggregated value of the gift information.

[0010] In the above information processing device, the first division and the second division are repeated during playback of the music data, and the display control unit carries over part or all of the aggregated value in the first division arriving after the second division depending on the aggregated value of the gift information aggregated in the first division.

[0011] In the above information processing device, the display control unit is further characterized in that it displays a gift object corresponding to the gift information transmitted in response to the operation input while moving the gift object as if flying toward a display object displayed on the display device, and changes the shape of the display object in response to the aggregate value of the gift information obtained in the first category.

[0012] The information processing device further includes a background color control unit that controls the background color of the screen displayed on the display unit of the terminal device in accordance with the development of the music being played, and the background color control unit synchronizes the background color based on lighting from a lighting device installed in the venue where the display device is installed, an object selected on the display unit of the terminal device, or location information transmitted from the terminal device.

[0013] The information processing device further includes a location information acquisition unit that acquires location information transmitted from the terminal device, and the display control unit is characterized in that a gift object corresponding to the gift information is displayed in an area corresponding to the location information in the display area of ​​the display device based on the operation input.

[0014] The information processing device is further characterized in that, when the gift information subject to charging is selected on the terminal device, a payment control unit switches between a first payment processing unit that performs payment processing based on a payment method input into a payment method input screen that is displayed at the time the gift information is selected, and a second payment processing unit that performs payment processing based on a pre-registered payment method that has been credit-screened, in response to the playback of the music data.

[0015] An information processing device side program according to one aspect of the present invention is connectable via a communications network to a terminal device capable of user operation and image display, and causes an information processing device capable of outputting to a display device to execute an acquisition process for acquiring gift information transmitted from the terminal device in response to a predetermined operation input during playback of music data consisting of a plurality of sections, a counting process for counting the gift information acquired during a first section of the plurality of sections during playback of the music data, and a display control process for displaying a performance image in a second section which is the section following the first section, in accordance with the count value of the gift information counted during the first section.

[0016] A terminal device-side program according to one aspect of the present invention causes a terminal device that can be connected to an information processing device capable of outputting to a display device via a communication network, and that can perform user operations and display images, to execute a reception process for receiving a predetermined operation input to the terminal device while playing music data consisting of a plurality of sections, and a transmission process for aggregating gift information transmitted from the terminal device during a first section of the plurality of sections while playing the music data, and transmitting the gift information in response to the received operation input to an information processing device that displays a performance image in accordance with the aggregate value of the gift information obtained during the first section in a second section that is the section after the first section. Effect of the Invention

[0017] In the event, the presentation can be dynamically changed according to the cheering for the cheer target object and the development of the music. [Brief description of the drawings]

[0018] [Figure 1] 1 is a block diagram of an information processing system 1 according to the present embodiment. [Diagram 2] FIG. 1 is a diagram showing an example of a network configuration of an event production system according to an embodiment of the present invention. [Diagram 3]1 is a functional and configuration block diagram of an event production system according to an embodiment of the present invention. [Figure 4] 2 is a flowchart for explaining an overall flow of the present embodiment. [Diagram 5] FIG. 2 is a sequence diagram of a pre-registration process (S1) in this embodiment. [Figure 6] FIG. 13 is a diagram showing an example of a touch payment settings screen displayed on a terminal device during the pre-registration process in this embodiment. [Figure 7] 10 is a diagram showing an example of the arrangement of two-dimensional barcodes indicating position information within an event venue in this embodiment. FIG. [Figure 8] 1A to 1C are diagrams for explaining an example configuration and sections of music data in this embodiment. [Figure 9] 11 is a diagram showing an example of an image displayed on the display device when playback of music data starts in this embodiment. FIG. [Figure 10] 13 is an assistance operation input screen displayed on the terminal device when music data is played back in this embodiment. [Figure 11] 13 is a diagram showing an example of a presentation in which gift objects are displayed gathering around a display object and flying away according to position information in this embodiment. FIG. [Figure 12] 13 is a diagram showing an example of a special effect in an effect section in this embodiment. FIG. [Figure 13] FIG. 11 is a sequence diagram of a cheering operation in this embodiment. [Figure 14A] 13 is a flowchart (part 1) of Example 1 of the performance process (S5) based on a section of music data by the server in this embodiment. [Figure 14B] 13 is a flowchart (part 2) of Example 1 of the rendering process (S5) based on a section of music data by the server in this embodiment. [Figure 15A] 13 is a flowchart (part 1) of Example 2 of the performance process (S5) based on a section of music data by the server in this embodiment. [Figure 15B]13 is a flowchart (part 2) of Example 2 of the performance process (S5) based on a section of music data by the server in this embodiment. [Figure 16] FIG. 11 is a sequence diagram showing how the terminal device in this embodiment functions as a glow stick and is synchronized with the lighting in an event venue. [Figure 17] 11 is a flowchart showing how the server in this embodiment causes a terminal device to function as a glow stick and synchronizes it with the lighting in an event venue. [Figure 18] FIG. 11 is a sequence diagram of a normal credit card payment process before or after music data is played back, and a process based on pre-registration information for touch payment during music data playback in this embodiment. [Figure 19] 11 is a flowchart of a payment process in which the payment method is switched depending on the reproduction of music data in the present embodiment. [Figure 20] FIG. 2 is an example of a configuration block diagram of a hardware environment of a computer that executes a program in this embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] 1 is a block diagram of an information processing system 1 in this embodiment. The information processing system 1 includes a terminal device 2, an information processing device 3, and a display device 4. An example of the information processing system 1 is an event production system 11 described later. An example of the terminal device 2 is a terminal device 12 described later. An example of the information processing device 3 is a server 13 described later. An example of the display device 4 is a display device 15 described later.

[0020] The information processing device 3 is an information processing device that can be connected to a terminal device 2 that can perform user operations and display images via a communication network, and can output to a display device 4. The information processing device 3 includes an acquisition unit 3a, a counting unit 3b, and a display control unit 3c.

[0021] The acquisition unit 3a acquires gift information transmitted in response to a predetermined operation input from the terminal device 2 during playback of music data made up of a plurality of sections. An example of the acquisition unit 3a is an acquisition unit 34, which will be described later.

[0022] The counting unit 3b counts gift information acquired during a first section (for example, section A or section C, i.e., a non-effect section, described later) among a plurality of sections during playback of music data. An example of the counting unit 3b is the counting unit 35, described later.

[0023] The display control unit 3c displays a performance image in a second section (for example, section B described later, i.e., an effect section) following the first section, according to the total value of the gift information totaled during the first section. An example of the display control unit 3c is the display control unit 36 ​​described later.

[0024] By configuring it in this way, the presentation can be changed dynamically in the event venue in response to the cheering for the cheer target object and the development of the music.

[0025] The counting unit 3b may adjust the counted value by weighting the value corresponding to each of the gift information items according to the length of the first section. In this case, the display control unit 3c may change the presentation form of the presentation image according to the counted value of the weighted gift information items.

[0026] By configuring it in this manner, even if, for example, the first section is too short to obtain sufficient gift information, the aggregate value can be adjusted by weighting, so that the same effect can be obtained as by accumulating a certain number of gift information points.

[0027] The first and second divisions are repeated during the reproduction of the music data. In this case, the display control unit 3c may take over a part or all of the total value of the gift information totaled in the first division in the first division that comes after the second division, depending on the total value of the gift information totaled in the first division.

[0028] By configuring in this manner, it is possible to accumulate more gift information points in the next section, so that a more effective presentation image can be generated and the excited atmosphere can be continued into the next effect section.

[0029] The display control unit 3c may further display the gift object corresponding to the gift information transmitted in response to the operation input while moving the gift object as if the gift object were flying toward a display object (for example, a display object 72 described later) displayed on the display device. In addition, the display control unit 3c may change the form of the display object in response to the total value of the gift information acquired in the first division.

[0030] With this configuration, it is possible to express an effect in which the form of the display object changes as the gift object is absorbed into the display object, thereby improving the sense that the user himself has sent the gift object and the interactivity.

[0031] The information processing device 3 may further include a background color control unit 3d. The background color control unit 3d can control the background color of the screen displayed on the display unit of the terminal device 2 according to the progress of the music being played. At this time, the background color control unit 3d may synchronize the background color based on lighting from a lighting device installed in the venue where the display device 4 is installed, an object selected on the display unit of the terminal device 2, or location information transmitted from the terminal device 2.

[0032] By configuring it in this way, the display screen of the terminal device 2 can have an effect similar to that of a glow stick, creating a sense of unity in the venue. In addition, lighting can be synchronized, and the background color can be adjusted according to the position in the venue. This can further enhance the sense of unity in the venue.

[0033] The information processing device 3 may further include a location information acquisition unit 3e. The location information acquisition unit 3e acquires location information transmitted from the terminal device 2. At this time, the display control unit 3c may display a gift object corresponding to the gift information in an area corresponding to the location information in the display area of ​​the display device 4 based on an operation input. An example of the location information acquisition unit 3e is the location information acquisition unit 37.

[0034] With this configuration, for example, when a user located on the right side of the display device 4 sends gift information, the gift object appears to have been thrown from the right side toward the center of the display area of ​​the display device 4. This improves the feeling that the user himself has sent the gift object and improves interactivity.

[0035] The information processing device 3 may further include a payment control unit 3f. When gift information for which a charge is required is selected on the terminal device 2, the payment control unit 3f switches between a first payment process (first payment process S93 described later) and a second payment process (second payment process S95 described later) depending on the reproduction of music data. The first payment process is a payment process that performs payment processing based on a payment method inputted into a payment method input screen that is displayed at the timing when the gift information is selected. The second payment process performs payment processing based on a preregistered payment method that has been credit-screened. An example of the payment control unit 3f is a payment control unit 39 described later.

[0036] By configuring it in this manner, when music data is not being played, normal payment processing such as credit card payment is performed, but while music data is being played, payment can be made easily and quickly based on a pre-registered payment method that has been credit-screened.

[0037] 2 is a diagram showing an example of a network configuration of an event production system in this embodiment. The event production system 11 includes a terminal device 12, a server device (hereinafter referred to as "server") 13, a computer (hereinafter referred to as "PC") 14, a display device 15, a speaker 16, a lighting control device 17, a credit inquiry and payment system 19, and a communication network 20. The terminal device 12, the server 13, the PC 14, and the credit inquiry and payment system 19 are communicatively connected via the communication network 20 by wired communication or wireless communication.

[0038] In this embodiment, as an example, one or more users are gathered at an event venue 18 where a display device 15, a speaker 16, and a lighting control device 17 connected to a PC 14 are installed. Each user is assumed to carry at least one terminal device 12. Here, at the event venue 18, one or more artists (including groups) consisting of characters from anime or games are displayed on the display device 15 and other display devices, and the artists perform music, etc., and users can cheer on the characters in response to the music.

[0039] The terminal device 12 is an electronic terminal device having a communication function that can be connected to the communication network 20, such as a smartphone, a tablet terminal, or a mobile phone carried by a user. A web browser is installed in the terminal device 12. The terminal device 12 can display images generated by the server 13 via the web browser. The terminal device 12 may be a so-called personal computer.

[0040] The server 13 is an information processing device capable of distributing various contents to the terminal device 12 and displaying the contents on the display device 15 via the PC 14. The server 13 may be a server system configured with one or more physical information processing devices, or may be a virtual server system configured with one or more virtual server devices.

[0041] The PC 14 is a so-called personal computer, and outputs the content distributed from the server 13 to the display device 15, the speaker 16, and the lighting control device 17. The PC 14 may be a terminal device having a communication function that can be connected to the communication network 20, such as a smartphone, a tablet terminal, or a mobile phone.

[0042] The display device 15 is a display device such as a display that outputs the content distributed by the server 13. If the distributed content includes sound data (including voice data, music data, etc.), the display device 15 outputs the sound data via a speaker 16. The display device 15 may be a projector, or may display an image on a screen. The speaker 16 may be built into the display device 15.

[0043] The lighting control device 17 controls a plurality of lighting devices installed in the event venue 18 based on instructions from the server 13.

[0044] When a touch payment is performed, as described below, the credit inquiry and settlement system 19 performs a credit inquiry when an inquiry is made by the server 13 or the billing server. A credit inquiry refers to confirming the credit of a credit card user with the credit card company (confirming validity and credit limit). If the credit inquiry is approved by the card company, the settlement amount is temporarily (provisionally) secured.

[0045] Here, an entrance reception terminal and a payment terminal (not shown) may be installed at the event venue 18. In this case, when entering the event venue 18, it is necessary to register (pre-register) predetermined information in advance as an application for participation. Pre-registration also includes setting a post-payment method to facilitate payment of the price for purchasing products and providing services at the event venue. A user who has completed pre-registration is given the right to participate in the event, and is issued with admission permission information (for example, a two-dimensional code such as a QR code (registered trademark)) that permits admission to the event venue 18. In the following, it is assumed that products also include services, and payment of the price for providing services is included in the purchase of products.

[0046] When entering the event venue 18, the user displays the issued two-dimensional code on their own terminal device 12 at the entrance reception. The entrance reception staff then reads the two-dimensional code with the entrance reception terminal, reads the wristband ID of the wristband prepared in advance, and transmits it to the server 13. The server 13 obtains user information from the two-dimensional code and links the user information to the wristband ID. After the linking is complete, the entrance reception staff hands the user a wristband that holds the linked wristband ID. The user can purchase products at the event venue 18 by using the wristband. In other words, when a user purchases a product, the payment process is completed by holding the wristband over the reader of the settlement terminal. (Hereinafter referred to as "touch payment.") Note that touch payment includes not only payments made directly using a wristband, but also payments made using a credit-screened payment method that is registered in advance and is based on the premise of using a wristband for payment.

[0047] 3 is a functional and configuration block diagram of the event production system in this embodiment. The terminal device 12 includes a communication unit 21 and an operation display unit 22. The communication unit 21 is an interface that enables communication with devices connected to the communication network 20. Here, the communication unit 21 communicates with the server 13.

[0048] The operation display unit 22 is a touch panel that allows input by input operation and also allows display. In the present embodiment, the operation display unit 22 is used as an example, but is not limited to this, and the input unit and the display unit may be independent of each other. Using the operation display unit 22, the user registers user information and a payment method via the terminal device 12 when applying to participate in an event (in advance).

[0049] The terminal device 12 is equipped with an acceleration sensor that detects the direction of movement and the direction of rotation of the terminal device 12. In this case, when the terminal device 12 is shaken or moved or rotated in a predetermined direction, the terminal device 12 can detect the applied force and perform a predetermined operation.

[0050] The server 13 includes a communication unit 31, a control unit 32, and a storage unit 40. The communication unit 31 is an interface that enables communication with devices connected to the communication network 20. Here, the communication unit 31 communicates with the terminal device 12 and the PC 14.

[0051] The control unit 32 functions as a user information / payment method registration unit 33, an acquisition unit 34, a counting unit 35, a display control unit 36, a glow stick control unit 37, a position information acquisition unit 38, and a payment control unit 39.

[0052] The user information and payment method registration unit 33 acquires the user information and payment method input by the user via the terminal device 12 when registering for participation in the event (in advance), and registers them in the user information management table 41 and the payment method management table 42.

[0053] The acquisition unit 34 acquires gift information transmitted by an operation (cheer operation) to cheer for an artist (including animation or game characters) (hereinafter referred to as a "cheering target object") displayed on the display device 15 through an input operation of the terminal device 12. The cheer operation includes, for example, tapping a predetermined area displayed on the terminal device 12 or shaking the terminal device 12.

[0054] Here, the gift information includes an item name (including a code and identification information (ID)) that identifies an item (hereinafter referred to as a "gift item") that causes a gift object corresponding to the gift information to be displayed on display device 15 in response to a cheering operation. Gift information may be set for each support target object. Gift items may also be set according to whether they are free or paid. If they are paid, the gift item may be set according to a set charge amount. At this time, each gift item is assigned points in advance, with the lowest points being assigned to free gift information and the points being assigned in the order of increasing charge amount.

[0055] The tallying unit 35 tallies the number of pieces of gift information acquired and the points of each piece of gift information acquired for each section preset in the music data. The tallying unit 35 can also weight the points according to the intervals of the sections preset in the music data.

[0056] The display control unit 36 ​​causes the display device 15 to display the cheering target object. Note that the cheering target object may be displayed on a display device different from the display device 15. Furthermore, when an operation to cheer for the cheering target object (cheer operation) is performed by an input operation from the terminal device 12 during playback of music data, the display control unit 36 ​​causes the display device 15 to display an effect image corresponding to the cheering operation.

[0057] The glow stick control unit 37 functions as a light for cheering on the cheer target object of the terminal device 12. The glow stick control unit 38 controls the background color of the screen displayed on the operation display unit 22 of the terminal device 12 in accordance with the progress of the music being played. At this time, the glow stick control unit 37 may synchronize the background color with the color of the lighting from the lighting device installed in the venue where the display device 15 is installed. The glow stick control unit 37 may also control and synchronize the background color of the screen in accordance with the cheer target object selected on the operation display unit 22 of the terminal device 12. The glow stick control unit 37 may also control and synchronize the background color of the screen in accordance with the position information transmitted from the terminal device 12.

[0058] The location information acquisition 38 acquires location information of the terminal device 12 within the event venue 18. A plurality of two-dimensional barcodes corresponding to location information indicating locations (sections) within the venue are placed within the event venue 18. The terminal device 12 reads the two-dimensional barcodes and transmits the location information corresponding to the two-dimensional barcodes to the server 13, and the location information acquisition 38 acquires the location information.

[0059] When a charging operation is performed on the terminal device 12 to purchase a gift, the payment control unit 39 switches between normal payment processing (first payment processing) and touch payment processing (second payment processing) according to the reproduction of music data, and executes the switched payment processing. Normal payment is a payment method that performs payment processing based on a payment method input on a payment method input screen that is displayed when a gift item is selected on the terminal device 12, such as a commonly used credit card payment. As described above, touch payment is a simple and quick payment method that is performed based on a pre-registered payment method that has been credit-screened. The payment control unit 39 performs normal payment processing before the start or end of performance, and performs payment processing based on touch payment processing during performance.

[0060] The memory unit 40 stores a user information management table 41, a payment method management table 42, user interface (hereinafter referred to as "UI") data 43 for terminal device, gift object data 44, character data 45, music data 46, effect data 47, and a billing management database (hereinafter referred to as "DB").

[0061] The user information management table 41 is a table for managing information of users participating in an event. The payment method management table 42 is a table for managing payment methods registered in advance for use in touch payment or payment based on touch payment. The payment method management table 42 includes information for credit card payment and information such as the delivery address of the user's bill for later payment at a store such as a convenience store. The UI data 43 is data related to the cheering input interface to be displayed on the terminal device 12, the background color, and the input display screen for determining charges.

[0062] The gift object data 44 is data on a gift object corresponding to the gift information to be displayed on the display device 15, and includes information on points of the gift information. The character data 45 is data on a character (information on the visual and movement (animation) of the cheering object) whose performance is displayed as an animation on the display device 15. The music data 46 is music data that is played according to the performance movement of the character, and has a preset section as described later. The effect data 47 is various performance images that are displayed on the display device from the start to the end of the performance, and includes, for example, various display highlighting effects that liven up the performance or music performance in response to the cheering operation (including data on the glow stick function).

[0063] The billing management DB 49 is a database that manages billing processes (including normal payment processes, touch payment processes, payment processes based on touch payment processes, etc.). In FIG. 3, the billing management DB 49 is stored in the storage unit 40, but this is just an example and the billing management DB 49 may be stored in another storage device.

[0064] The PC 14 includes a communication unit 51 and an output unit 52. The communication unit 51 is an interface that enables communication with devices connected to the communication network 20, and in this case, communicates with the server 13. The output unit 52 is an output interface that is connected to the display device 15, the speaker 16, and the lighting control device 17, and outputs data and commands.

[0065] 4 is a flowchart for explaining the overall flow of this embodiment. First, when applying to participate in an event (in advance), a user uses the terminal device 12 to register user information and a payment method (S1).

[0066] Next, when the performance (playback of music data) starts at the event venue 18, the user reads a two-dimensional barcode placed near the position (section) where the user is cheering using the terminal device 12 (S2). The two-dimensional barcode becomes information for identifying the position (section) at the event venue 18.

[0067] At the event venue 18, before the performance (playback of music data) begins, the user operates the terminal device 12 to purchase a gift item for cheering on the cheer target object, as necessary (S3). In S3, the payment method is the normal payment process described above.

[0068] The performance (playback of music data) starts (S4). Then, the user performs a cheering operation on the terminal device 12 in response to the playback of the music, and transmits gift information based on the selected gift item to the server 13. Then, the server 13 performs various effect processes to liven up the performance according to the development of the music and the total value of the transmitted and tallied gift information (S5).

[0069] The server 13 also controls the background color of the display screen displayed on the terminal device 12 via the Web browser in accordance with the progression of the music in the music data (S6). This allows the display screen of the Web browser to have an effect similar to that of glow sticks, creating a sense of unity in the venue.

[0070] Even during a performance, the user can operate the terminal device 12 to purchase a gift item for supporting the support target object as necessary (S7). In this case, since a performance is in progress, the server 13 performs a payment process based on a touch payment in order to reduce the burden of the payment operation on the user.

[0071] Below, we will specifically explain each process and procedure in the flow explained in Figure 4. First, we will explain S1 in Figure 4.

[0072] Fig. 5 is a sequence diagram of the pre-registration process (S1) in this embodiment. Fig. 6 is a diagram showing an example of a touch payment setting screen displayed on a terminal device in the pre-registration process in this embodiment. Fig. 5 will be described below with reference to Fig. 6. For ease of explanation, hereinafter, displaying on the operation display unit 22 of the terminal device 12 may also be described as displaying on the terminal device 12.

[0073] First, in order to participate in an event, the user must make certain settings in advance as an application to participate. The user then accesses a certain portal site using a Web browser installed in the terminal device 12 (S11). The user then performs a certain input operation on the portal site to apply to participate in the event, and a setting screen (touch payment screen) for registering a payment method at the event venue is displayed (S12).

[0074] When the user presses "Proceed with payment" on the touch payment screen, the terminal device 12 transmits a payment method setting request to the server 13 (S13). In response, the server 13 causes the terminal device 12 to display a payment method setting screen 61 as shown in FIG. 6 (S14).

[0075] The user inputs a payment method into the payment method setting screen 61 using the terminal device 12. For example, when selecting credit card payment on the payment method setting screen 61, the user inputs the necessary information into the credit card payment setting field 62. If one or more credit card details have already been registered, the last four digits of the credit cards are displayed, and one of the credit cards can be selected. In addition, when the "Add credit card" button 63 is pressed, a new credit card can be registered.

[0076] Furthermore, when selecting deferred payment (a method in which payment is made at a convenience store using a bill that is mailed at a later date) on the payment method setting screen 61, the necessary information is entered in the deferred payment setting field 64. If one or more billing addresses have already been registered, those addresses are displayed and one of the billing addresses can be selected. Furthermore, by pressing the "Add new delivery address" button 65, a new billing address can be registered.

[0077] It should be noted that payment is not limited to being made at a convenience store, and if the invoice allows payment at a bank, post office, etc., payment may be made at a bank, post office, etc.

[0078] Furthermore, in the credit card payment setting field 62 and / or deferred payment setting field 64 on the payment method setting screen 61, the above-mentioned "upper limit amount" can be set.

[0079] When the user finishes inputting the necessary information on the payment method setting screen 61 and presses the "Confirm application" button 66 in FIG. 6, the terminal device 12 sends a user information registration request to the server 13 (S15). In response, the server 13 makes a credit inquiry to the credit inquiry and payment system 19 based on the user's name, telephone number, and address (which may also include credit card information) (S16), and receives the credit matching result (S17). The server 13 then causes the terminal device 12 to display a setting completion screen (not shown) (S18). The server 13 displays on the setting completion screen (not shown) that the touch payment setting has been completed and the registered details.

[0080] Note that short mail service authentication (SMS authentication) may be used for advance registration. This can improve security during advance registration. Note that in FIG. 6, pressing the "Back" button 67 returns to the screen before transition.

[0081] Next, S2 in Fig. 4 will be described. Fig. 7 is a diagram showing an example of the arrangement of two-dimensional barcodes indicating position information in an event venue in this embodiment. Two-dimensional barcodes X1 to X12 are arranged in the event venue 18, and each of the two-dimensional barcodes X1 to X12 indicates the position where it is arranged. The two-dimensional barcodes may be printed on paper and attached to a fixed object, for example. Furthermore, the management staff may hold the paper on which the two-dimensional barcodes are printed, or the paper may be displayed on the management staff's terminal device.

[0082] Fig. 8 is a diagram for explaining an example of the structure and sections of music data in this embodiment. The horizontal axis in Fig. 8 represents the development of a song. A song begins with an intro and is made up of sections called an A melody, a B melody, a C melody, and a chorus. The horizontal axis represents emotional ups and downs (the user's mood and excitement). The color of the bars indicates the melody of the song.

[0083] In this embodiment, as an example, the basic structure of the performance is divided into the following three sections, A, B, and C. Section A (A1, A2) is a melody section where the music is heard. Section B (B1, B2, B3) is a chorus section. Section C (C1) is a section where the excitement continues following the chorus section. These sections are set in advance.

[0084] In this embodiment, the gift information is transmitted to the server 13 by the cheering operation on the terminal device 12 of the user. The server 13 controls the special effect in the B section based on the points of the gift information accumulated in the A section and the C section. For example, in the A section, the user is asked to participate in the cheering operation gradually. As a result, the points of the gift information are gradually accumulated in the server 13. If the points of the gift information are accumulated to a certain extent or more in the B section, the special effect described later is activated. In addition, the C section is a section where the excitement continues after the chorus, and the user is asked to actively participate in the cheering operation toward the final special effect. For example, as a result of accumulating the points of the gift information collected in the A1 section, the special effect is activated in the B1 section. As a result of accumulating the points of the gift information collected in the A2 section, the special effect is activated in the B2 section. As a result of accumulating the points of the gift information collected in the C1 section, the special effect is activated in the B3 section. In the following, the section corresponding to the B section may be referred to as the "effect section". In addition, the section corresponding to the A section or the C section may be referred to as the "non-effect section".

[0085] Next, S4 and S5 in Fig. 4 will be described. S3 will be described later together with S7.

[0086] FIG. 9 is a diagram showing an example of an image displayed on the display device when the music data playback starts in this embodiment. In the lower part of the display area 71 of the display device 15, three characters of cheering target objects 73a, 73b, and 73c are displayed as cheering target objects 73. As an example, the music used in this embodiment is set to be played by the cheering target objects 73a, 73b, and 73c. ​​In addition, a display object 72 is displayed in the display area above the cheering target objects 73a, 73b, and 73c. ​​The display object 72 is designed to change its form, for example, by becoming larger, changing its shape, or changing its color, as it absorbs the gift information transmitted by the cheering operation. The cheering target objects 73a, 73b, and 73c may be displayed on another display device. In addition, the display object 72 is not limited to a circle or a sphere, and may have any shape, form, color, or appearance, and may move by animation or the like.

[0087] 10 shows a support operation input screen 81 displayed on the terminal device when music data is being played back in this embodiment. The support operation input screen 81 can be displayed via a Web browser.

[0088] In the cheering target object selection field 84, one of the cheering target objects 73a, 73b, and 73c can be selected. When one of the cheering target objects is selected in the cheering target object selection field 84, an image of the selected cheering target object is displayed in the display area 82. In addition, the background color of the background area 85 changes depending on the selected cheering target object.

[0089] In the gift selection field 83, a gift item to be sent by a cheering operation can be selected. When any gift item is selected in the gift selection field 83, an image of the selected gift item is displayed in the display area 82. The gift information displayed in the gift selection field 83 changes depending on the support target object selected in the support target object selection field 84. Some gift items are free of charge, while others require payment. Here, for example, if 1 yen = 1 point (pt), the gift items in the gift selection field 83a can be used free of charge (0 pt). The gift items in the gift selection field 83b can be used for 100 pt, and have already been purchased for a charge of 100 yen. A locked padlock object is displayed in the gift selection field 83c, which indicates that a gift item worth 500 pt has not yet been purchased.

[0090] In this state, gift information corresponding to the selected gift item can be sent to the server 13 by performing a specified operation such as tapping or sliding the support operation input area 86 with a finger or shaking the terminal device 12.

[0091] Fig. 11 is a diagram showing an example of a presentation in which gift objects are displayed gathering around a display object and flying away according to position information in this embodiment. Here, Fig. 11 shows a presentation image in a section (i.e., a non-effect section) corresponding to the above-mentioned section A or section C.

[0092] For example, a presentation image is displayed so that the transmitted gift object 91 in FIG.

[0093] In addition, an effect image is displayed that looks as if the gift object is being thrown from a position corresponding to the position information based on the two-dimensional barcode read in S2 of Fig. 4. For example, when the two-dimensional barcode X8 is read in Fig. 7, an effect image is displayed that looks as if the gift object 91 is being thrown from the right side of the display area 71 to the display object 72 in the center.

[0094] Fig. 12 is a diagram showing an example of a special effect in an effect section in this embodiment. Here, Fig. 12 shows an effect image (special effect image 92) for a special effect in a section (effect section) corresponding to the above-mentioned section B.

[0095] When an effect section is reached during playback of music data, a special effect image 92 is displayed according to the total number of gift information points accumulated in the preceding non-effect section. The greater the total number of points, the greater the effect of the special effect image 92.

[0096] The special effect image 92 may be, for example, an image in which a mass of gift information collected up to that point explodes, an image in which fireworks are shot up, or an image in which stars fall. The effect of the special effect image becomes stronger as the end of the song approaches, and the effect section of the final chorus is the strongest. As one of the effects, a cut out image of the object to be cheered on may be displayed large in the center of the display area 71 at a predetermined timing or according to the total number of points.

[0097] 13 is a sequence diagram of the cheering operation in this embodiment. First, the user reads a two-dimensional barcode placed near the user's seat at the event venue 18 with the terminal device 12 (S21). The terminal device 12 holds the position information indicated by the two-dimensional barcode.

[0098] The server 13 causes the display device 15 to display the display object 72 and the support target object in synchronization with the start of the performance as described with reference to FIG. 9, and also starts playing the music data (S22).

[0099] The user transmits gift information to the server 13 by performing a cheering operation using the terminal device 12. At this time, the terminal device 12 also transmits the location information acquired in S21 to the server 13 (S23). The server 13 displays a performance image (including a special performance image) on the display device 15 according to the gift information and location information transmitted from the terminal device 12 and the section set in the music data (S24). S23 and S24 are repeated during the playback of the music data.

[0100] When the performance (playback of music data) ends, the server 13 displays the end credits on the display device 15 (S25). The end credits may, for example, display the user's nickname in a large font or in a predetermined order according to the points of the transmitted gift information.

[0101] 14A and 14B are flowcharts of Example 1 of the performance process (S5) based on the section of music data by the server in this embodiment. The control unit 32 of the server 13 reads out the program according to this embodiment from the storage device, and functions as an acquisition unit 34, a counting unit 35, a display control unit 36, and a position information acquisition unit 38, and executes the flow of Fig. 14A and Fig. 14B. Hereinafter, the process by the control unit 32 will be described as the process by the server 13 for convenience.

[0102] When the server 13 receives an instruction to play a song, the server 13 starts playing the song data (S31). The server 13 initializes a parameter (aggregated point value) P for tallying points to 0 (S32). The server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0103] The server 13 acquires the gift information and the position information transmitted from the terminal device 12 (S34). The server 13 identifies the acquired gift information by referring to the gift object data 44 (S35). The server 13 displays the gift objects corresponding to the identified gifts so as to gather around the display object 72 based on the position information (S36). The server 13 changes the form of the display object in response to the gift objects being absorbed into the display object (S37).

[0104] The server 13 refers to the gift object data 44 to identify the points Pi corresponding to the identified gift information (S38). The server 13 adds the points Pi to the total point value P (S39).

[0105] The server 13 judges whether the effect section has arrived (S40). If the effect section has not arrived (NO in S40), the server 13 returns to the process of S34. The processes of S34 to S39 are repeated until the effect section arrives.

[0106] When the effect division arrives (YES in S40), the server 13 generates a special effect image according to the total value P (S41) and displays it (S42). Here, when the total value P exceeds a predetermined value, the special effect image may be displayed as if the points are full. The predetermined value may be changed each time, for example, according to the number of participating users or the points set for the gift item.

[0107] The server 13 judges whether the effect section has ended (S43). If the effect section has not ended (NO in S43), the server 13 returns to the process of S41. The processes of S41 to S42 are repeated until the effect section ends.

[0108] When the effect section has ended (YES in S43), the server 13 judges whether the playback of the music has ended (S43). When the playback of the music has not ended (NO in S44), the server 13 initializes the count value P to 0 or reduces it to a predetermined value (S45), and returns to the process of S34. The processes of S34 to S45 are repeated until the playback of the music has ended.

[0109] When the playback of the music ends (YES in S44), the server 13 fades out the effect image (S46) and finally displays the end credits (S47). As described above, in the end credits, the server 13 displays the user's nickname in a large size or in a determined order according to the points of the transmitted gift information, for example.

[0110] 15A and 15B are flowcharts of Example 2 of the performance process (S5) based on the section of music data by the server in this embodiment. The control unit 32 of the server 13 reads out the program according to this embodiment from the storage device, and functions as an acquisition unit 34, a counting unit 35, a display control unit 36, and a position information acquisition unit 38, and executes the flow of Fig. 15A and Fig. 15B. Hereinafter, the process by the control unit 32 will be described as the process by the server 13 for convenience.

[0111] 15A and 15B are flowcharts in which the processes of S32-1 and S32-2 are added to the processes of Fig. 14A and Fig. 14B, S39 is replaced with the process of S39-1, and S45 is replaced with the processes of S45-1, S45-2, and S45-3. In the second embodiment, the gift points are weighted according to the length of the section before the effect section in the first embodiment.

[0112] When the server 13 receives an instruction to play a song, the server 13 starts playing the song data (S31).The server 13 initializes a parameter (point total value) P for tallying up points to 0 (S32).

[0113] The server 13 calculates the time T until the effect section (S32-1). The server 13 sets a weight W in accordance with the calculated time T (S32-2). For example, the shorter the time T, the heavier the weight set by the server 13.

[0114] The server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0115] The server 13 acquires the gift information and the position information transmitted from the terminal device 12 (S34). The server 13 identifies the acquired gift information by referring to the gift object data 44 (S35). The server 13 displays the gift objects corresponding to the identified gifts so as to gather around the display object 72 based on the position information (S36). The server 13 changes the form of the display object in response to the gift objects being absorbed into the display object (S37).

[0116] The server 13 refers to the gift object data 44 and identifies the points Pi corresponding to the identified gift information (S38). The server 13 adds a value obtained by multiplying the points Pi by the weight W to the total point value P (S39-1).

[0117] The server 13 judges whether the effect section has arrived (S40). If the effect section has not arrived (NO in S40), the server 13 returns to the process of S34. The processes of S34 to S39 are repeated until the effect section arrives.

[0118] When the effect division arrives (YES in S40), the server 13 generates a special effect image according to the total value P (S41) and displays it (S42). Here, when the total value P exceeds a predetermined value, the special effect image may be displayed as if the points are full. The predetermined value may be changed each time, for example, according to the number of participating users or the points set for the gift item.

[0119] The server 13 judges whether the effect section has ended (S43). If the effect section has not ended (NO in S43), the server 13 returns to the process of S41. The processes of S41 to S42 are repeated until the effect section ends.

[0120] When the effect section has ended (YES in S43), the server 13 judges whether the playback of the music has ended (S43). When the playback of the music has not ended (NO in S44), the server 13 calculates the time T until the effect section (S45-1). The server 13 sets a weight W according to the calculated time T (S45-2). For example, the server 13 sets a heavier weight as the time T becomes shorter. The server 13 also reduces the aggregate value P to a predetermined value according to the time T (S45-5), and returns to the process of S34. The processes of S34 to S45 are repeated until the playback of the music ends.

[0121] When the playback of the music ends (YES in S44), the server 13 fades out the effect image (S46) and finally displays the end credits (S47). As described above, in the end credits, the server 13 displays the user's nickname in a large size or in a determined order according to the points of the transmitted gift information, for example.

[0122] Furthermore, by reducing the aggregate value P rather than initializing it in the process of S45-3, the aggregate value can be carried over to the next section A or section C (non-effect section), allowing the excitement to continue even further.

[0123] Next, S6 in Fig. 4 will be described. Fig. 16 is a sequence diagram in which the terminal device in this embodiment functions as a glow stick and is synchronized with the lighting in the event venue. The server 13 changes the background color of the display area 85 of the terminal device via the Web browser in accordance with the progression of the music (S51). Furthermore, the server 13 may control the lighting control device 17 in accordance with the change in background color, and synchronize the lighting devices in the event venue to change the color and irradiation direction of the lighting (S52).

[0124] Fig. 17 is a flow chart showing how the server in this embodiment causes a terminal device to function as a glow stick and synchronize with the lighting in the event venue. The control unit 32 of the server 13 reads out a program according to this embodiment from a storage device, functions as a glow stick control unit 37 and a position information acquisition unit 38, and executes the flow of Fig. 17. For convenience, the processing by the control unit 32 will be described below as processing by the server 13.

[0125] The server 13 acquires the position information transmitted from the terminal device 12 (S61). The server 13 determines the background color of the display area 85 for each terminal device 12 according to the progression of the music, the position information, and / or the selected support target object (S62). The server 13 notifies the terminal device 12 of information related to the determined background color. The server 13 also notifies the lighting control device 17 of a command to perform lighting processing according to the background color (S63).

[0126] The server 13 repeats the process of S62 to S64 until the playback of the music data is completed (NO in S64), and when the playback of the music data is completed, this flow ends (YES in S64).

[0127] This allows the display screen on the web browser to have an effect similar to that of a glow stick, and by controlling the lighting in the event venue 18 as well, a sense of unity can be achieved within the event venue.

[0128] Next, the payment processing of S3 and S7 in Fig. 4 will be described. Fig. 18 is a sequence diagram of a normal credit card payment processing before or after the playback of music data is completed, and a processing based on pre-registered information for touch payment during the playback of music data in this embodiment.

[0129] Before or after the music data is played, the user performs an operation to purchase an item as gift information using the terminal device 12 (S71). For example, in Fig. 10, when the lock object in the gift selection field 83c is tapped, a list of gift items worth 500 points is displayed, and the user can select the gift item he or she wishes to purchase.

[0130] When the server 13 acquires the gift information regarding the selected gift item, it causes the terminal device 12 to display a payment method input screen for purchasing the gift item (S72).

[0131] The user inputs a payment method into the payment method input screen using the terminal device 12 (S73). The server 13 causes the terminal device 12 to display a confirmation screen for the user to confirm the content input into the payment method input screen (S74).

[0132] The user uses the terminal device 12 to check the confirmation screen and tap the confirmation button (S75). The server 13 then makes a credit inquiry to the credit inquiry and settlement system 19 (S76). Upon receiving the credit inquiry result from the credit inquiry and settlement system 19 (S77), the server 13 notifies the terminal device 12 whether the payment is complete or not depending on whether the sum of the cumulative payment amount for a predetermined period and the current payment amount exceeds a preset upper limit or depending on the credit inquiry result. (S76). If the payment is not possible, the message "Payment not possible" is displayed on the terminal device 12, and the selected gift item cannot be purchased.

[0133] Meanwhile, while the music data is being played, the user performs an operation to purchase an item as gift information using the terminal device 12 (S81). For example, in Fig. 10, when the lock object in the gift selection field 83c is tapped, a list of gift items worth 500 points is displayed, and the user can select the gift item he or she wishes to purchase.

[0134] When the server 13 acquires the gift information regarding the selected gift item, it causes the terminal device 12 to display a confirmation screen on which the purchase details and payment method for the gift item are entered based on the information previously registered in S1 of FIG. 4 (S82).

[0135] The user uses the terminal device 12 to check the confirmation screen and tap the confirmation button (S83). The server 13 then makes a credit inquiry to the credit inquiry and settlement system 19 (S84). Upon receiving the credit inquiry result from the credit inquiry and settlement system 19 (S85), the server 13 notifies the terminal device 12 whether the payment is complete or not depending on whether the sum of the cumulative payment amount for a predetermined period and the current payment amount exceeds a preset upper limit or depending on the credit inquiry result. (S86). If the payment is not possible, the message "Payment not possible" is displayed on the terminal device 12, and the selected gift item cannot be purchased.

[0136] Fig. 19 is a flowchart of a payment process in this embodiment in which the payment method is switched depending on the playback of music data. The control unit 32 of the server 13 reads out a program according to this embodiment from a storage device, functions as a payment control unit 39, and executes the flow of Fig. 19. Hereinafter, the process by the control unit 32 will be described as the process by the server 13 for convenience.

[0137] When the server 13 receives a gift item purchase request from the terminal device 12 (S91), it determines whether music data is being played (S92). If music data is not being played (NO in S92), the server 13 performs a first payment process (S93).

[0138] In the first payment process (S93), the server 13 causes the terminal device 12 to display a payment method input screen (S93a). When input of the payment method is completed on the payment method input screen on the terminal device 12, the server 13 accepts the payment method (S93b).

[0139] The server 13 causes the terminal device 12 to display a confirmation screen for the user to confirm the accepted payment method (S93c). When the user uses the terminal device 12 to confirm the confirmation screen and tap a confirm button, the server 13 accepts the confirmation instruction (S93d).

[0140] The server 13 performs payment processing for the amount of the gift item based on the acquired payment method (S93e). If the acquired payment method is "credit card payment", the server 13 acquires valid credit card information corresponding to the user ID from the payment method management table 42. The server 13 performs a credit inquiry with the credit inquiry / payment system 19 based on the acquired credit card information, and performs payment processing for the amount.

[0141] If the acquired payment method is deferred payment, the server 13 acquires valid billing address information corresponding to the user ID from the payment method management table 42. The server 13 performs payment processing for the amount based on the acquired billing address information. Note that the server 13 may halt the payment processing if the sum of the cumulative payment amount for a specified period and the current payment amount exceeds a preset upper limit. The server 13 notifies the terminal device 12 of the result of the payment processing (S93f).

[0142] In S92, if music data is being played back (YES in S92), the server 13 refers to the payment method management table 42 and determines whether or not the user has pre-registered for touch payment (S94). If the result of S94 is NO, the server 13 performs the first payment process (S93). If the pre-registration for the touch payment has been registered (S94 is YES), the server 13 performs the second payment process. (S95).

[0143] In the second payment process (S95), the server 13 causes the terminal device 12 to display a confirmation screen on which the purchase details and the payment method of the gift item are input based on the information previously registered in the payment method management table 42 in S1 of Fig. 4 (S95a). When the user uses the terminal device 12 to check the confirmation screen and tap the confirm button, the server 13 accepts the confirmation instruction (S95b).

[0144] The server 13 performs payment processing for the amount of the gift item based on the acquired payment method (S95c). If the acquired payment method is "credit card payment", the server 13 acquires valid credit card information corresponding to the user ID from the payment method management table 42. The server 13 performs a credit inquiry with the credit inquiry / payment system 19 based on the acquired credit card information, and performs payment processing for the amount.

[0145] If the acquired payment method is deferred payment, the server 13 acquires valid billing address information corresponding to the user ID from the payment method management table 42. The server 13 performs payment processing for the amount based on the acquired billing address information. Note that the server 13 may halt the payment processing if the sum of the cumulative payment amount for a specified period and the current payment amount exceeds a preset upper limit. The server 13 notifies the terminal device 12 of the result of the payment processing (S95d).

[0146] 20 is an example of a configuration block diagram of a hardware environment of a computer that executes a program in this embodiment. A computer 101 functions as a terminal device 12 or a server 13. The computer 101 is composed of a CPU 102, a ROM 103, a RAM 104, a storage device 105, an input I / F 106, an output I / F 107, a communication I / F 108, a reading device 109, and a bus 120.

[0147] Here, CPU refers to a central processing unit. ROM refers to a read-only memory. RAM refers to a random access memory. I / F refers to an interface. The bus 140 is connected to the CPU 102, ROM 103, RAM 104, storage device 105, input I / F 106, output I / F 107, communication I / F 108, and, if necessary, a reading device 109.

[0148] The CPU 102 reads out the program according to this embodiment from the storage device 105, and when functioning as the server 13, executes the program as the user information / payment method registration unit 33, the acquisition unit 34, the tally unit 35, the display control unit 36, the glow stick control unit 37, the location information acquisition unit 38, and the settlement control unit 39. The CPU 102 also reads out the program according to this embodiment from the storage device 105, and when functioning as the terminal device 12, executes the program as the reception processing unit and the transmission processing unit. When functioning as the reception processing unit, the CPU 102 accepts a predetermined operation input to the terminal device 12 during the reproduction of music data consisting of a plurality of sections. When functioning as the reception processing unit, the CPU 102 tallys up gift information transmitted from the terminal device 12 during the first section of a plurality of sections during the reproduction of the music data, and transmits the gift information in response to the accepted operation input to the server 13 that displays a performance image in response to the tally value of the gift information acquired during the first section in the second section that is the section following the first section. The ROM 103 indicates a read-only memory. The RAM 104 is a memory for temporary storage.

[0149] The storage device 105 is a device that stores a large amount of information. As the storage device 105, various types of storage devices such as a hard disk, a solid state drive (SSD), a flash memory card, etc. are usable. The storage device 105 stores a program according to an embodiment of the present invention and various data stored in the storage unit 40.

[0150] The input I / F 106 can be connected to input devices such as a keyboard, a mouse, an electronic camera, a web camera, a microphone, a scanner, a sensor, a tablet, a touch panel, an information reading device, etc. The output I / F 107 can be connected to output devices such as a display, a touch panel, a projector, a printer, a speaker, etc.

[0151] The communication I / F 108 is an interface such as a port for connecting to a communication network and communicating with other devices. The communication network may be the Internet, a local area network (LAN), a wide area network (WAN), a dedicated line, a wired line, a wireless line, etc. The reading device 109 is a device for reading a portable recording medium.

[0152] The program for realizing the process described in the above embodiment may be stored, for example, in the storage device 105 from the program provider via the communication network and the communication I / F 108. The program for realizing the process described in the above embodiment may be stored in a portable storage medium that is commercially available and distributed. In this case, the portable storage medium may be set in the reading device 105, and the program may be read and executed by the CPU 102. As the portable storage medium, various types of storage media such as CD-ROM, flexible disk, optical disk, magneto-optical disk, IC card, USB memory device, and semiconductor memory card can be used. The program stored in such a storage medium is read by the reading device 109.

[0153] The program may be installed on a stand-alone computer, or may be installed by a cloud computer to provide only the functions to the user. Although the screen display in this embodiment is performed using a Web browser on the terminal device 12, the screen display in this embodiment may be performed by installing an application program capable of communicating with the server 13 on the terminal device 12.

[0154] According to this embodiment, the performance can be dynamically changed in response to cheering for the cheer target object and the progression of the music in the event. In addition, the reaction to the cheering operation is visually reflected in the performance in real time, which improves the feeling that the user himself has sent the gift object and the interactivity.

[0155] Furthermore, the support target object is not limited to a character from an anime or game, but may be a human artist, or may be a non-human object such as an animal or a robot. Furthermore, the support target object is not limited to the content of the performance image (special performance image), but may be any type of performance content. Furthermore, in this embodiment, the sections are set in advance in the music data, but the sections may be formed in real time at a predetermined timing according to the atmosphere of the venue. Furthermore, the sections are not limited to the A melody, B memo, chorus, etc., but may be set arbitrarily.

[0156] Although the present aspect has been described above based on the embodiment and modified examples, the above-mentioned embodiment of the aspect is intended to facilitate understanding of the present aspect and does not limit the present aspect. The present aspect may be modified or improved without departing from the spirit and scope of the claims, and equivalents are included in the present aspect. Furthermore, if a technical feature is not described as essential in this specification, it may be deleted as appropriate. [Explanation of symbols]

[0157] 1. Information Processing Systems 2 Terminal Equipment 3. Information processing equipment 3a Acquisition part 3b Tally section 3c Display control section 3d background color control section 3e Location information acquisition section 3f Payment control section 4 Display device 5 Acquisition part 6 Payment amount determination section 7 Payment Processing Unit 8 Amount Management Department 11 Event Production System 12 Terminal Equipment 13 Server 14 PC 15 Display device 16 Speakers 17 Lighting control device 18 Event Venues 19 Credit Inquiry and Payment System 20. Communication Networks 21 Communications Department 22 Operation display section 31 Communications Department 32 Control section 33 User information and payment method registration section 34 Acquisition Department 35 Counting Department 36 Display control section 37 Psyllium control unit 38 Location information acquisition section 39 Payment Control Unit 40 Storage section 51 Communications Department 52 Output section

Claims

1. displaying a gift selection field displaying a plurality of gift items together with corresponding points on a display of a terminal device operated by the user while the music data is being played; displaying, on a display of the terminal device, a gift item displayed in the gift selection field in accordance with a part of characters selected from a plurality of characters based on an operation of the user; causing the terminal device to execute a process of accepting a selection of a gift item from among the gift items displayed in the gift selection field from a user of the terminal device; While the music data is being played, a display device on which the part of the characters is displayed executes a process of moving a performance image corresponding to the selected gift item toward a display object displayed together with the part of the characters and displaying the performance image on the display device on which the part of the characters is displayed. program.

2. the processor causes a display to display a gift selection section displaying a plurality of gift items together with corresponding points while the music data is being played; a processor causes the gift items displayed in the gift selection field to be switched based on a part of characters selected from a plurality of characters based on an operation by the user, a processor accepts a selection of a gift item from among the gift items displayed in the gift selection section; a processor, while the music data is being played, causing a display device on which the part of the characters is displayed to display a performance image corresponding to the selected gift item such that the performance image moves toward a display object displayed together with the part of the characters; Information processing methods.

3. A terminal device and a server are provided, The terminal device displaying on the display a gift selection field showing a plurality of gift items together with the corresponding points while the music data is being played; switching and displaying the gift items displayed in the gift selection field based on a part of characters selected from a plurality of characters based on a user operation; Accepting a selection of a gift item from among the gift items displayed in the gift selection field; The server, displaying the part of the characters on a display device while the music data is being played; a performance image corresponding to the selected gift item is displayed by moving it toward a display object displayed together with the part of the characters; system.

Images