Information processing device, information processing device-side program, and terminal device-side program

Abstract

To provide a technique which can dynamically change performance in an event in response to cheering for a cheer object and development of music.SOLUTION: The present invention is directed to an information processing apparatus which can be connected through a communication network to a terminal device capable of being operated by a user and displaying an image and which can output data to a display device. The information processing apparatus has an acquiring unit for acquiring gift information transmitted from the terminal device in response to a predetermined input operation during reproduction of musical piece data forming a plurality of sections, a collecting unit for collecting gift information acquired during a first section of the plurality of sections during reproduction of the musical piece data, and a display control unit for displaying a performance image in response to collected values of the gift information collected during the first section in a second section immediately succeeding the first section. Thus, the information processing apparatus solves the problem.SELECTED DRAWING: Figure 1

Description

Technical Field

[0006] , ,

[0001] The present invention relates to an information processing apparatus, an information processing apparatus side program, and a terminal apparatus side program.

Background Art

[0002] Conventionally, in events such as concerts and live shows, various production methods have been devised to enhance the atmosphere. For example, production methods such as displaying images on a large display in accordance with music or changing the color and lighting pattern of spotlight illumination are known.

[0003] As a technology related to such production, for example, a user participation type event production system has been disclosed (for example, Patent Document 1). The event production system provides a production that can enhance the sense of unity between participants and artists by using, for example, image data (photos) and acoustic data (singing voices) uploaded by concert participants to the server in advance for production in that concert.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

[0007] This invention provides a technology that dynamically changes the performance at an event in accordance with the cheering directed at the target object and the progression of the music. [Means for solving the problem]

[0008] An information processing device according to one aspect of the present invention is an information processing device that can be connected to a terminal device that can be operated by a user and display images via a communication network, and can output to a display device, and is characterized by comprising: an acquisition unit that acquires gift information transmitted from the terminal device in response to a predetermined operation input during the playback of music data composed of a plurality of sections; an aggregation unit that aggregates the gift information acquired between the first of the plurality of sections during the playback of the music data; and a display control unit that displays a performance image in the second section, which is the section after the first section, according to the aggregated value of the gift information aggregated between the first sections.

[0009] In the above-described information processing device, the aggregation unit adjusts the aggregated value by weighting the values ​​corresponding to each of the gift information according to the length of the first section, and the display control unit changes the presentation form of the presentation image according to the aggregated value of the weighted gift information.

[0010] In the above-described information processing device, the first and second sections are repeated during playback of the music data, and the display control unit carries over part or all of the aggregated value of the gift information in the first section that follows the second section, according to the aggregated value of the gift information aggregated in the first section.

[0011] In the above-described information processing device, the display control unit further displays the gift object while moving it so that the gift object corresponding to the gift information transmitted in response to the operation input flies toward the display object displayed on the display device, and changes the form of the display object according to the aggregated value of the gift information acquired in the first section.

[0012] The information processing device further includes a background color control unit that controls the background color of the screen displayed on the display unit of the terminal device in accordance with the progression of the music being played, wherein the background color control unit synchronizes the background color based on lighting from a lighting device installed in the venue where the display device is installed, an object selected on the display unit of the terminal device, or location information transmitted from the terminal device.

[0013] The information processing device further includes a location information acquisition unit that acquires location information transmitted from the terminal device, and the display control unit is characterized in that, based on the operation input, it causes a gift object corresponding to the gift information to be displayed in the area corresponding to the location information in the display area of ​​the display device.

[0014] The information processing device is further characterized by comprising a payment control unit that switches between a first payment processing unit, which performs payment processing based on a payment method entered on a payment method input screen displayed at the time the gift information is selected, in response to the playback of the music data, when the gift information subject to billing is selected on the terminal device, and a second payment processing unit, which performs payment processing based on a pre-registered payment method that has undergone credit check.

[0015] An information processing device program according to one aspect of the present invention is connected to a terminal device that can be operated by a user and display images via a communication network, and the information processing device is capable of outputting to a display device, and causes the information processing device to execute an acquisition process for acquiring gift information transmitted from the terminal device in response to a predetermined operation input during the playback of music data composed of multiple sections, an aggregation process for aggregating the gift information acquired between the first section of the multiple sections during the playback of the music data, and a display control process for displaying a performance image in the second section, which is the section after the first section, according to the aggregated value of the gift information aggregated between the first sections.

[0016] A terminal device program according to one aspect of the present invention causes a terminal device, which can be connected via a communication network to an information processing device capable of outputting to a display device and which is capable of user operation and image display, to perform a reception process that accepts a predetermined operation input to the terminal device during playback of music data composed of multiple sections, and a transmission process that aggregates gift information transmitted from the terminal device during the first section of the multiple sections during playback of the music data, and transmits the gift information in response to the received operation input to an information processing device that displays a performance image in the second section, which is the section after the first section, according to the aggregated value of the gift information acquired during the first section. [Effects of the Invention]

[0017] During events, the performance can be dynamically changed in response to cheering for the target object and the progression of the music. [Brief explanation of the drawing]

[0018] [Figure 1] This is a block diagram of the information processing system 1 in this embodiment. [Figure 2] This diagram shows an example of the network configuration of the event production system in this embodiment. [Figure 3]This is a functional and configuration block diagram of the event production system in this embodiment. [Figure 4] This is a flowchart for explaining the overall flow of this embodiment. [Figure 5] This is a sequence diagram of the pre-registration process (S1) in this embodiment. [Figure 6] This is a diagram showing an example of a touch payment setting screen displayed on a terminal device in the pre-registration process of this embodiment. [Figure 7] This is a diagram showing an example of the arrangement of two-dimensional barcodes indicating position information in the event venue in this embodiment. [Figure 8] This is a diagram for explaining an example of the configuration and section of music data in this embodiment. [Figure 9] This is a diagram showing an example of an image displayed on a display device at the start of music data playback in this embodiment. [Figure 10] This is a support operation input screen to be displayed on a terminal device during music data playback in this embodiment. [Figure 11] This is a diagram showing an example of an effect where gift objects gather and fly towards display objects according to the position information in this embodiment. [Figure 12] This is a diagram showing an example of a special effect in the effect section in this embodiment. [Figure 13] This is a sequence diagram regarding the support operation in this embodiment. [Figure 14A] This is flowchart (part 1) of Example 1 of the production process (S5) based on the section of music data by the server in this embodiment. [Figure 14B] This is flowchart (part 2) of Example 1 of the production process (S5) based on the section of music data by the server in this embodiment. [Figure 15A] This is flowchart (part 1) of Example 2 of the production process (S5) based on the section of music data by the server in this embodiment. [Figure 15B]This is a flowchart (part 2) of Example 2 of the performance processing (S5) by the server based on the interval of the music data in this embodiment. [Figure 16] This is a sequence diagram showing how the terminal device in this embodiment functions as a glow stick and synchronizes with the lighting in the event venue. [Figure 17] This flowchart shows how to make the server-based terminal device function as a glow stick and synchronize it with the lighting in the event venue in this embodiment. [Figure 18] This is a sequence diagram of the normal credit card payment process before or after playback of music data, and the process based on pre-registered information for contactless payment during music data playback, in this embodiment. [Figure 19] This is a flowchart of the payment process in this embodiment, where the payment method switches depending on the playback of music data. [Figure 20] This is an example of a block diagram of the hardware environment configuration of a computer that executes the program in this embodiment. [Modes for carrying out the invention]

[0019] Figure 1 is a block diagram of the information processing system 1 in this embodiment. The information processing system 1 includes a terminal device 2, an information processing device 3, and a display device 4. An example of the information processing system 1 is the event production system 11, which will be described later. An example of the terminal device 2 is the terminal device 12, which will be described later. An example of the information processing device 3 is the server 13, which will be described later. An example of the display device 4 is the display device 15, which will be described later.

[0020] The information processing device 3 is an information processing device that can be connected to a terminal device 2 that allows user operation and image display via a communication network, and can also output to a display device 4. The information processing device 3 includes an acquisition unit 3a, an aggregation unit 3b, and a display control unit 3c.

[0021] The acquisition unit 3a acquires gift information transmitted from the terminal device 2 in response to predetermined operation inputs during playback of music data consisting of multiple sections. An example of the acquisition unit 3a is the acquisition unit 34, which will be described later.

[0022] The aggregation unit 3b aggregates gift information acquired during playback of music data, specifically during the first of several segments (for example, segment A or segment C described later, i.e., the non-effect segment described later). An example of the aggregation unit 3b is the aggregation unit 35 described later.

[0023] The display control unit 3c displays a performance image in the second section (for example, section B, i.e., the effect section, described later) which is the section following the first section, according to the aggregated value of the gift information aggregated during the first section. An example of the display control unit 3c is the display control unit 36, which will be described later.

[0024] By configuring it in this way, the performance can be dynamically changed at the event venue in response to cheering for the target object and the progression of the music.

[0025] The aggregation unit 3b may adjust the aggregated value by weighting the values ​​corresponding to each of the gift information according to the length of the first section. In this case, the display control unit 3c may change the presentation style using the presentation image according to the aggregated value of the weighted gift information.

[0026] By configuring it in this way, even if, for example, the first interval is short and not enough gift information can be obtained, the aggregated value can be adjusted by weighting, so that it can achieve the same effect as accumulating a certain amount of gift information points.

[0027] During playback of music data, the first and second sections are repeated. In this case, the display control unit 3c may carry over some or all of the aggregated gift information in the first section that follows the second section, according to the aggregated gift information aggregated in the first section.

[0028] By structuring it this way, you can accumulate even more gift information points in the next section, which allows you to generate more visually impressive images and carry the excitement into the next effect section.

[0029] The display control unit 3c may further display the gift object while moving it so that the gift object corresponding to the gift information transmitted in response to the operation input flies towards the display object (for example, the display object 72 described later) displayed on the display device. In addition, the display control unit 3c may change the form of the display object according to the aggregated value of the gift information acquired in the first section.

[0030] By configuring it in this way, it is possible to create an effect where the form of the display object changes as the gift object is absorbed into it. This enhances the user's sense of having sent the gift object themselves and improves the level of interaction.

[0031] The information processing device 3 may further include a background color control unit 3d. The background color control unit 3d can control the background color of the screen displayed on the display unit of the terminal device 2 according to the progression of the music being played. In this case, the background color control unit 3d may synchronize the background color based on the lighting from the lighting equipment installed in the venue where the display device 4 is installed, an object selected on the display unit of the terminal device 2, or position information transmitted from the terminal device 2.

[0032] By configuring it in this way, the display screen of terminal device 2 will have an effect similar to that of glow sticks, creating a sense of unity in the venue. Furthermore, the lighting may be synchronized, or the background color may be adjusted according to the location within the venue. This can further enhance the sense of unity in the venue.

[0033] The information processing device 3 may further include a location information acquisition unit 3e. The location information acquisition unit 3e acquires location information transmitted from the terminal device 2. At this time, the display control unit 3c may, based on the operation input, display a gift object corresponding to the gift information in the area corresponding to the location information in the display area of ​​the display device 4. An example of a location information acquisition unit 3e is a location information acquisition unit 37.

[0034] With this configuration, for example, if a user located to the right of the display device 4 sends gift information, it will appear as if the gift object was thrown from the right side of the display area of ​​the display device 4 towards the center. This enhances the user's sense of having sent the gift object themselves and improves the interactivity.

[0035] The information processing device 3 may further include a payment control unit 3f. When a gift information to be charged is selected in the terminal device 2, the payment control unit 3f switches between a first payment process (first payment process S93 described later) and a second payment process (second payment process S95 described later) in accordance with the playback of the music data. The first payment process is a payment process that performs payment based on the payment method entered on the payment method input screen displayed when the gift information is selected. The second payment process performs payment based on a pre-registered payment method that has undergone credit checks. An example of a payment control unit 3f is the payment control unit 39 described later.

[0036] With this configuration, if music data is not being played, normal payment processing such as credit card payment will be performed. However, while music data is being played, payments can be made simply and quickly based on pre-registered, credit-checked payment methods.

[0037] Figure 2 shows an example of the network configuration of the event production system in this embodiment. The event production system 11 includes a terminal device 12, a server device (hereinafter referred to as "server") 13, a computer (hereinafter referred to as "PC") 14, a display device 15, a speaker 16, a lighting control device 17, a credit inquiry and settlement system 19, and a communication network 20. The terminal device 12, server 13, PC 14, and credit inquiry and settlement system 19 are connected to each other via the communication network 20 by wired or wireless communication.

[0038] In this embodiment, as an example, one or more users are gathered at an event venue 18 where a display device 15 connected to a PC 14, a speaker 16, and a lighting control device 17 are installed. Each user is assumed to be carrying at least one terminal device 12. At the event venue 18, one or more artists (including groups) composed of anime or game characters are displayed on the display device 15 and other display devices, and the artists perform, etc., and users can cheer for the characters in response to the performance.

[0039] Terminal device 12 is an electronic terminal device having communication capabilities that can connect to a communication network 20, such as a smartphone, tablet, or mobile phone carried by the user. A web browser is installed on terminal device 12. Terminal device 12 can display images generated by server 13 via the web browser. Note that terminal device 12 may also be a so-called personal computer.

[0040] Server 13 is an information processing device that can distribute various content to terminal devices 12 and display content on display devices 15 via PC 14. Server 13 may be a server system composed of one or more physical information processing devices, or it may be a virtual server system composed of one or more virtual server devices.

[0041] PC14 is a so-called personal computer that outputs content distributed from server 13 to display device 15, speaker 16, and lighting control device 17. PC14 may also be a terminal device with communication capabilities that can connect to a communication network 20, such as a smartphone, tablet, or mobile phone.

[0042] The display device 15 is a display device such as a screen that outputs content distributed from the server 13. If the distributed content includes sound data (including voice data, music data, etc.), the display device 15 outputs that sound data via the speaker 16. The display device 15 may also be a projector or a screen display. The speaker 16 may also be built into the display device 15.

[0043] The lighting control device 17 controls multiple lighting devices installed within the event venue 18 based on instructions from the server 13.

[0044] The credit check and payment system 19 performs a credit check when a contactless payment, as described later, is made, and when an inquiry is received from the server 13 or the billing server. A credit check refers to verifying the creditworthiness of the credit card user (verification of validity and credit limit) with the credit card company. Once the credit check is approved by the card company, the payment amount is temporarily (provisionally) secured.

[0045] Here, event venue 18 may be equipped with admission reception terminals and payment terminals, which are not shown. In this case, in order to enter event venue 18, it is necessary to register the required information in advance as a participation application (pre-registration). Pre-registration also includes setting up a post-payment method to facilitate payment for the purchase of goods and the provision of services at the event venue. Users who have completed pre-registration are granted event participation rights and are issued admission permission information (for example, a two-dimensional code such as a QR code (registered trademark)) that allows them to enter event venue 18. In the following, goods include services, and payment for the provision of services is considered to be included in the purchase of goods.

[0046] When entering event venue 18, the user displays the issued QR code on their terminal device 12 at the entrance reception. The entrance reception staff then reads the QR code with the entrance reception terminal, reads the wristband ID of a pre-prepared wristband, and sends it to server 13. Server 13 retrieves user information from the QR code and links the user information with the wristband ID. After the linking is complete, the entrance reception staff hands the user a wristband containing the linked wristband ID. The user can purchase goods at event venue 18 by using the wristband. That is, when the user purchases goods, the payment process is completed by holding the wristband over the reader of the payment terminal. (Hereinafter referred to as "contactless payment") will be performed. Contactless payment includes not only payments using the wristband directly, but also payments based on pre-registered and credit-checked payment methods that are intended for use with the wristband.

[0047] Figure 3 is a functional and configuration block diagram of the event production system in this embodiment. The terminal device 12 includes a communication unit 21 and an operation display unit 22. The communication unit 21 is an interface that enables communication with devices connected to the communication network 20. In this case, the communication unit 21 communicates with the server 13.

[0048] The operation display unit 22 is a touch panel that allows input through input operations and also displays information. In this embodiment, the operation display unit 22 is used as an example, but it is not limited to this, and the input unit and the display unit may be independent of each other. Using the operation display unit 22, the user registers user information and payment method via the terminal device 12 when applying to participate in an event (in advance).

[0049] The terminal device 12 is equipped with an acceleration sensor that detects the direction of movement and rotation of the terminal device 12. It may also include a gyro sensor. This allows the terminal device 12 to detect the applied force when it is shaken, moved in a predetermined direction, or rotated, and to perform a predetermined action.

[0050] Server 13 includes a communication unit 31, a control unit 32, and a storage unit 40. The communication unit 31 is an interface that enables communication with devices connected to the communication network 20, and in this case, it communicates with terminal device 12 and PC 14.

[0051] The control unit 32 functions as a user information / payment method registration unit 33, an acquisition unit 34, an aggregation unit 35, a display control unit 36, a glow stick control unit 37, a location information acquisition unit 38, and a settlement control unit 39.

[0052] The user information and payment method registration unit 33 acquires user information and payment methods entered by the user via the terminal device 12 when the user applies to participate in an event (in advance), and registers them in the user information management table 41 and the payment method management table 42.

[0053] The acquisition unit 34 acquires gift information transmitted by an operation (support operation) to support an artist (including animation and game characters) (hereinafter referred to as "support target object") displayed on the display device 15, based on an input operation of the terminal device 12. Support operations include, for example, tapping a predetermined area displayed on the terminal device 12 or shaking the terminal device 12.

[0054] Here, the gift information includes, for example, an item name (including a code and identification information (ID)) that identifies an item (hereinafter referred to as "gift item") which will be displayed on the display device 15 in response to a support operation, in accordance with the gift information. Gift information may be set for each support target object. Furthermore, gift items may be set according to whether they are free or paid. In the case of paid gifts, gift items may be set according to the set charge amount. In this case, each gift item is pre-assigned points, with the lowest points assigned to free gift information and increasing points as the charge amount increases.

[0055] The aggregation unit 35 aggregates the number of acquired gift information and the points for each acquired gift information for each section pre-set in the song data. The aggregation unit 35 can also weight the points according to the intervals pre-set in the song data.

[0056] The display control unit 36 ​​causes the support target object to be displayed on the display device 15. The support target object may be displayed on a display device other than the display device 15. Furthermore, when music data is played back, if an operation to support the support target object (support operation) is performed by input operation from the terminal device 12, the display control unit 36 ​​displays a performance image corresponding to that support operation on the display device 15.

[0057] The glow stick control unit 37 functions as a trigger for the terminal device 12 to cheer on the target object. The glow stick control unit 38 controls the background color of the screen displayed on the operation display unit 22 of the terminal device 12 according to the progression of the music being played. At this time, the glow stick control unit 37 may synchronize its background color with the color of the lighting from the lighting equipment installed in the venue where the display device 15 is installed. The glow stick control unit 37 may also control and synchronize the background color of the screen according to the target object selected on the operation display unit 22 of the terminal device 12. Furthermore, the glow stick control unit 37 may also control and synchronize the background color of the screen according to the location information transmitted from the terminal device 12.

[0058] The location information acquisition 38 acquires the location information of the terminal device 12 within the event venue 18. Multiple two-dimensional barcodes corresponding to location information indicating a specific location (section) within the venue are placed within the event venue 18. The terminal device 12 reads one of these two-dimensional barcodes and transmits the location information corresponding to that barcode to the server 13, at which point the location information acquisition 38 acquires that location information.

[0059] When a payment operation is performed on the terminal device 12 to purchase a gift, the payment control unit 39 switches between normal payment processing (first payment processing) and touch payment processing (second payment processing) in accordance with the playback of music data, and executes the switched payment processing. Normal payment is a payment method in which payment processing is performed based on the payment method entered on the payment method input screen displayed when a gift item is selected on the terminal device 12, such as commonly used credit card payment. Touch payment, as described above, is a simple and quick payment method based on a pre-registered and credit-checked payment method. The payment control unit 39 performs normal payment processing before the start of playback or after the end of playback, and performs payment processing based on touch payment processing during playback.

[0060] The memory unit 40 stores user information management table 41, payment method management table 42, terminal device user interface (hereinafter referred to as "UI") data 43, gift object data 44, character data 45, music data 46, effect data 47, and billing management database (hereinafter referred to as "DB").

[0061] The user information management table 41 is a table for managing information about users participating in the event. The payment method management table 42 is a table for managing payment methods that are pre-registered for use with touch payment or payment based on touch payment. The payment method management table 42 includes information for credit card payments and information such as the recipient address for the user's invoice for later payment at stores such as convenience stores. The UI data 43 is data related to the input interface for cheering displayed on the terminal device 12, the background color, and the input display screen for determining billing.

[0062] Gift object data 44 is data relating to gift objects corresponding to gift information for display on the display device 15, and includes information about the points of the gift information. Character data 45 is data relating to characters (information about the visuals and movements (animations) of the cheering target object) for which the performance is displayed as animation on the display device 15. Music data 46 is music data that is played according to the character's performance movements, and the intervals are set in advance as described later. Effect data 47 is various effect images to be displayed on the display device from the start to the end of the performance, and includes data such as various display emphasis effects that enhance the performance in response to cheering operations (data relating to the glow stick function is also included).

[0063] The billing management DB 49 is a database that manages billing processes (including normal payment processing, contactless payment processing, and payment processing based on contactless payment processing). In Figure 3, the billing management DB 49 is stored in the storage unit 40, but this is just an example, and it may be stored in a different storage device.

[0064] PC14 includes a communication unit 51 and an output unit 52. The communication unit 51 is an interface that enables communication with devices connected to the communication network 20, and in this case, it communicates with the server 13. The output unit 52 is an output interface that connects to the display device 15, speaker 16, and lighting control device 17 to output data and commands.

[0065] Figure 4 is a flowchart illustrating the overall flow of this embodiment. First, when the user applies to participate in the event (in advance), they register their user information and payment method using the terminal device 12 (S1).

[0066] Next, at the event venue 18, when the performance (playback of music data) begins, the user reads a two-dimensional barcode placed near the position (section) where the user will be cheering using the terminal device 12 (S2). This two-dimensional barcode provides information to identify that position (section) at the event venue 18.

[0067] At the event venue 18, before the performance (playback of music data) begins, users may, if necessary, operate the terminal device 12 to purchase gift items to support the target object (S3). In S3, the payment method is the standard payment process described above.

[0068] The performance (playback of music data) begins (S4). The user then performs a cheering operation on the terminal device 12 in response to the music playback and sends gift information based on the selected gift item to the server 13. The server 13 then performs various effect processing to enhance the performance, according to the progression of the song and the aggregated value of the sent and aggregated gift information (S5).

[0069] Furthermore, the server 13 controls the background color of the display screen shown on the terminal device 12 via a web browser, in accordance with the progression of the music data (S6). This allows the display screen via the web browser to have an effect similar to glow sticks, creating a sense of unity at the venue.

[0070] Even during a performance, the user can operate the terminal device 12 as needed to purchase gift items to support the object they wish to support (S7). In this case, since a performance is in progress, the server 13 performs payment processing based on touch payment to reduce the burden on the user's payment operation.

[0071] Below, we will explain each process and procedure in the flow described in Figure 4 in detail. First, we will explain S1 in Figure 4.

[0072] Figure 5 is a sequence diagram of the pre-registration process (S1) in this embodiment. Figure 6 is a diagram showing an example of the touch payment setting screen displayed on the terminal device during the pre-registration process in this embodiment. Below, Figure 5 will be explained with reference to Figure 6. For the sake of explanation, below, displaying on the operation display unit 22 of the terminal device 12 may be referred to as displaying on the terminal device 12.

[0073] First, in order for a user to participate in the event, they must complete a predetermined setup as part of their registration. Therefore, the user accesses a designated portal site using a web browser installed on the terminal device 12 (S11). They then perform a predetermined input operation on the portal site to register for the event and display a settings screen (touch payment screen) for registering their payment method at the event venue (S12).

[0074] When the user presses "Proceed with payment" on the touch payment screen, the terminal device 12 sends a request to the server 13 to set the payment method (S13). In response, the server 13 displays the payment method setting screen 61 on the terminal device 12, as shown in Figure 6 (S14).

[0075] The user enters their payment method on the payment method settings screen 61 using the terminal device 12. For example, on the payment method settings screen 61, if the user selects credit card payment, they enter the necessary information in the credit card payment settings field 62. If one or more credit card details are already registered, the last four digits of those credit cards will be displayed, and the user can select one of the credit cards. Additionally, pressing the "Add Credit Card" button 63 allows the user to register a new credit card.

[0076] Furthermore, on the payment method settings screen 61, if you select deferred payment (a method where you pay at a convenience store using an invoice that will be mailed to you later), enter the necessary information in the deferred payment settings field 64. If one or more invoice delivery addresses are already registered, those invoice delivery addresses will be displayed, and you can select one of them. Also, by pressing the "Add New Delivery Address" button 65, you can register a new invoice delivery address.

[0077] Furthermore, payment is not limited to convenience stores; if the invoice allows payment at banks, post offices, etc., you may pay at a bank, post office, etc.

[0078] Furthermore, the aforementioned "maximum amount" can be set in the credit card payment settings section 62 and / or the deferred payment settings section 64 of the payment method settings screen 61.

[0079] After the user has finished entering the necessary information on the payment method setting screen 61 and presses the "Confirm Application" button 66 in Figure 6, the terminal device 12 sends a user information registration request to the server 13 (S15). In response, the server 13 performs a credit check with the credit check and payment system 19 based on the user's name, telephone number, and address (which may also include credit card information) (S16) and receives the credit check result (S17). Then, the server 13 displays a setting completion screen (not shown) on the terminal device 12 (S18). On the setting completion screen (not shown), the server 13 displays that the touch payment setup is complete and the registered information.

[0080] Furthermore, SMS authentication may be used for pre-registration. This can improve security during pre-registration. Note that in Figure 6, pressing the "Back" button 67 will return you to the previous screen.

[0081] Next, S2 in Figure 4 will be explained. Figure 7 is a diagram showing an example of the arrangement of two-dimensional barcodes indicating location information within the event venue in this embodiment. Two-dimensional barcodes X1 to X12 are arranged in the event venue 18, and each of the two-dimensional barcodes X1 to X12 indicates its respective location. The two-dimensional barcodes may, for example, be printed on paper and attached to a fixed object. Alternatively, the event staff may hold the printed paper with the two-dimensional barcodes in their hands, or display it on the terminal device of the event staff.

[0082] Figure 8 is a diagram illustrating an example of the structure and sections of music data in this embodiment. The horizontal axis in Figure 8 represents the development of the song. A song is composed of, for example, an intro, followed by sections called the A section, B section, C section, and chorus. The horizontal axis represents the fluctuations of emotion (user's enthusiasm and excitement). The color of the bars indicates the mood of the song.

[0083] In this embodiment, as an example, the basic structure of the performance will be divided into the following three sections: A, B, and C. Section A (A1, A2) is the melody section where the song is listened to. Section B (B1, B2, B3) is the chorus section. Section C (C1) is the section where the excitement continues following the chorus section. These sections are predetermined.

[0084] In this embodiment, gift information is transmitted to the server 13 by the user's cheering operation on the terminal device 12. The server 13 controls the special performance in section B based on the gift information points accumulated in sections A and C. For example, in section A, the user is asked to participate in cheering operations gradually. As a result, gift information points are gradually accumulated on the server 13. If a certain amount of gift information points have been accumulated in section B, the special performance described later is activated. Section C is a section where the excitement continues after the chorus, and the user is asked to participate in cheering operations more actively in preparation for the final special performance. For example, as a result of accumulating gift information points collected in section A1, the special performance is activated in section B1. As a result of accumulating gift information points collected in section A2, the special performance is activated in section B2. As a result of accumulating gift information points collected in section C1, the special performance is activated in section B3. In the following, the section corresponding to section B may be referred to as the "effect section". Also, the section corresponding to section A or section C may be referred to as the "non-effect section".

[0085] Next, we will explain S4 and S5 in Figure 4. Note that S3 will be discussed later along with S7.

[0086] Figure 9 shows an example of an image displayed on the display device when music data playback starts in this embodiment. Below the display area 71 of the display device 15, three character support objects 73a, 73b, and 73c are displayed as support target objects 73. For example, the music used in this embodiment is set to be played by support target objects 73a, 73b, and 73c. ​​In addition, a display object 72 is displayed in the display area above the support target objects 73a, 73b, and 73c. ​​The display object 72 is designed to change its form, such as growing larger, changing shape, or changing color, as it absorbs gift information sent through support operations. Note that the support target objects 73a, 73b, and 73c may be displayed on a separate display device. Furthermore, the display object 72 is not limited to circles or spheres, and may have any shape, form, color, or appearance, and may move through animation, etc.

[0087] Figure 10 shows the cheering operation input screen displayed on the terminal device during music data playback in this embodiment. The cheering operation input screen 81 can be displayed via a web browser.

[0088] In the support target object selection field 84, you can select one of the support target objects 73a, 73b, or 73c. ​​When you select one of the support target objects in the support target object selection field 84, the image of the selected support target object will be displayed in the display area 82. In addition, the background color of the background area 85 will change according to the selected support target object.

[0089] The gift selection field 83 allows you to select a gift item to send through the support operation. When you select a gift item in the gift selection field 83, an image of that selected gift item is displayed in the display area 82. The gift information displayed in the gift selection field 83 changes according to the support target object selected in the support target object selection field 84. Some gift items are free, while others are paid. For example, if 1 yen = 1 point (pt), the gift item in gift selection field 83a can be used for free (0pt). The gift item in gift selection field 83b can be used for 100pt and has already been purchased for 100 yen. The locked lock object is displayed in gift selection field 83c, which indicates that the 500pt gift item has not yet been purchased.

[0090] In this state, by performing predetermined operations such as tapping or sliding a finger on the support operation input area 86 or shaking the terminal device 12, gift information corresponding to the selected gift item can be sent to the server 13.

[0091] Figure 11 shows an example of an effect in this embodiment where gift objects gather around a display object and fly towards it according to the location information. Here, Figure 11 is an image of the effect in a section corresponding to section A or section C described above (i.e., a non-effect section).

[0092] For example, in Figure 10, the sent gift object 91 is absorbed into the display object 72 in the animation image.

[0093] Furthermore, based on the position information derived from the two-dimensional barcode read in S2 of Figure 4, an image is displayed that simulates the gift object being thrown from a position corresponding to that position information. For example, if the two-dimensional barcode X8 is read in Figure 7, an image is displayed that simulates the gift object 91 being thrown from the right side of the display area 71 to the central display object 72.

[0094] Figure 12 shows an example of a special effect in the effect section in this embodiment. Here, Figure 12 shows an effect image (special effect image 92) for the special effect in the section corresponding to section B (effect section) described above.

[0095] When an effect section is reached during music playback, a special effect image 92 is displayed according to the total number of gift information points accumulated in the preceding non-effect section. The larger the total number of points, the greater the effect of the special effect image 92.

[0096] The special effect image 92 could be, for example, an image of a cluster of collected gift information exploding, an image of fireworks going off, or an image of falling stars. The effect of the special effect image will increase as the end of the song approaches, with the effect being strongest during the final chorus. As part of the presentation, a large cut of the object being supported may be displayed in the center of the display area 71 at predetermined timings or depending on the total number of points.

[0097] Figure 13 is a sequence diagram relating to cheering operations in this embodiment. First, the user reads a two-dimensional barcode located near their seat at the event venue 18 using the terminal device 12 (S21). The terminal device 12 stores the location information indicated by the two-dimensional barcode.

[0098] As explained in Figure 9, the server 13 displays the display object 72 and the support target object on the display device 15 in conjunction with the start of the performance, and also starts playing the music data (S22).

[0099] The user sends gift information to the server 13 by performing a support operation using the terminal device 12. At this time, the terminal device 12 also sends the location information acquired in S21 to the server 13 (S23). The server 13 displays a performance image (including a special performance image) on the display device 15 according to the gift information and location information sent from the terminal device 12, and the section set in the music data (S24). Steps S23 and S24 are repeated while the music data is playing.

[0100] Once the performance (playback of the music data) is finished, the server 13 displays the end credits on the display device 15 (S25). The end credits may, for example, display the user's nickname in a larger font or in a predetermined order, depending on the points of the gift information sent.

[0101] Figures 14A and 14B are flowcharts of Embodiment 1 of the performance processing (S5) based on the interval of music data performed by the server in this embodiment. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device and functions as the acquisition unit 34, aggregation unit 35, display control unit 36, and position information acquisition unit 38, and executes the flow shown in Figures 14A and 14B. Hereafter, for convenience, the processing by the control unit 32 will be described as the processing by the server 13.

[0102] When server 13 receives a music playback command, it starts playing the music data (S31). Server 13 initializes the parameter P for accumulating points (accumulated point value) to 0 (S32). Server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0103] Server 13 acquires gift information and location information transmitted from terminal device 12 (S34). Server 13 identifies the acquired gift information by referring to gift object data 44 (S35). Based on the location information, Server 13 displays the gift objects corresponding to the identified gifts so that they gather on the display object 72 (S36). Server 13 changes the form of the display object as the gift objects are absorbed into the display object (S37).

[0104] Server 13 refers to the gift object data 44 to identify the points Pi corresponding to the identified gift information (S38). Server 13 adds the points Pi to the total points P (S39).

[0105] Server 13 determines whether the effect phase has arrived (S40). If the effect phase has not arrived (NO in S40), Server 13 returns to processing S34. Processing S34 to S39 is repeated until the effect phase arrives.

[0106] If an effect is triggered (YES in S40), the server 13 generates a special animation image corresponding to the aggregated value P (S41) and displays it (S42). Here, if the aggregated value P exceeds a predetermined value, for example, the special animation image may be displayed as if the points have been filled to the maximum. The predetermined value may change each time, for example, depending on the number of participating users or the points set for the gift items.

[0107] Server 13 determines whether the effect phase has finished (S43). If the effect phase has not finished (NO in S43), Server 13 returns to processing S41. Processing S41 to S42 is repeated until the effect phase is finished.

[0108] If the effect section ends (YES in S43), server 13 determines whether the music playback has finished (S43). If the music playback has not finished (NO in S44), server 13 initializes the aggregate value P to 0 or reduces it to a predetermined value (S45) and returns to the process in S34. The processes in S34 to S45 are repeated until the music playback finishes.

[0109] When the music playback finishes (YES in S44), Server 13 fades out the visual effects (S46) and finally displays the end credits (S47). As described above, in the end credits, Server 13 displays the user's nickname in a larger size or in a predetermined order, for example, according to the points of the gift information sent.

[0110] Figures 15A and 15B are flowcharts of Example 2 of the performance processing (S5) based on the interval of music data performed by the server in this embodiment. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device and functions as the acquisition unit 34, aggregation unit 35, display control unit 36, and position information acquisition unit 38, and executes the flow shown in Figures 15A and 15B. Hereinafter, the processing by the control unit 32 will be described as the processing by the server 13 for convenience.

[0111] Figures 15A and 15B are flowcharts obtained by adding processes S32-1 and S32-2 to Figures 14A and 14B, replacing S39 with process S39-1, and further replacing S45 with processes S45-1, S45-2, and S45-3. In Example 2, gift points are weighted according to the length of the section preceding the effect section in Example 1.

[0112] When server 13 receives a music playback command, it starts playing the music data (S31). Server 13 initializes the parameter P for accumulating points (point total value) to 0 (S32).

[0113] Server 13 calculates the time T until the effect interval (S32-1). Server 13 sets the weight W according to the calculated time T (S32-2). For example, Server 13 sets a heavier weight the shorter the time T is.

[0114] Server 13 displays the support target object 73 and the display object 72 on the display device 15 (S33).

[0115] Server 13 acquires gift information and location information transmitted from terminal device 12 (S34). Server 13 identifies the acquired gift information by referring to gift object data 44 (S35). Based on the location information, Server 13 displays the gift objects corresponding to the identified gifts so that they gather on the display object 72 (S36). Server 13 changes the form of the display object as the gift objects are absorbed into the display object (S37).

[0116] Server 13 refers to the gift object data 44 to identify the point Pi corresponding to the identified gift information (S38). Server 13 adds the value obtained by multiplying the point Pi by the weight W to the point aggregate value P (S39-1).

[0117] Server 13 determines whether the effect phase has arrived (S40). If the effect phase has not arrived (NO in S40), Server 13 returns to processing S34. Processing S34 to S39 is repeated until the effect phase arrives.

[0118] If an effect is triggered (YES in S40), the server 13 generates a special animation image corresponding to the aggregated value P (S41) and displays it (S42). Here, if the aggregated value P exceeds a predetermined value, for example, the special animation image may be displayed as if the points have been filled to the maximum. The predetermined value may change each time, for example, depending on the number of participating users or the points set for the gift items.

[0119] Server 13 determines whether the effect phase has finished (S43). If the effect phase has not finished (NO in S43), Server 13 returns to processing S41. Processing S41 to S42 is repeated until the effect phase is finished.

[0120] If the effect section ends (YES in S43), Server 13 determines whether the music playback has finished (S43). If the music playback has not finished (NO in S44), Server 13 calculates the time T until the effect section ends (S45-1). Server 13 sets a weight W according to the calculated time T (S45-2). For example, Server 13 sets a heavier weight the shorter the time T. Server 13 also reduces the aggregate value P to a predetermined value according to the time T (S45-5) and returns to the process in S34. The processes in S34 to S45 are repeated until the music playback finishes.

[0121] When the music playback finishes (YES in S44), Server 13 fades out the visual effects (S46) and finally displays the end credits (S47). As described above, in the end credits, Server 13 displays the user's nickname in a larger size or in a predetermined order, for example, according to the points of the gift information sent.

[0122] Furthermore, in the processing of S45-3, by reducing the aggregate value P without initializing it, the aggregate value can be carried over to the next interval A or interval C (non-effect interval), allowing the excitement to continue for a longer period.

[0123] Next, we will explain S6 in Figure 4. Figure 16 is a sequence diagram showing how the terminal device in this embodiment functions as a glow stick and synchronizes with the lighting in the event venue. The server 13 switches the background color of the display area 85 of the terminal device via a web browser according to the progression of the music (S51). Furthermore, the server 13 may control the lighting control device 17 in accordance with the background color change to synchronize the lighting equipment in the event venue and switch the color and direction of the lighting (S52).

[0124] Figure 17 is a flowchart showing how the server in this embodiment makes the terminal device function as a glow stick and synchronizes it with the lighting in the event venue. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device and functions as the glow stick control unit 37 and the location information acquisition unit 38, executing the flow in Figure 17. In the following, for convenience, the processing by the control unit 32 will be described as the processing by the server 13.

[0125] Server 13 acquires location information transmitted from terminal device 12 (S61). For each terminal device 12, Server 13 determines the background color of the display area 85 according to the song's progression, location information, and / or the selected support target object (S62). Server 13 notifies terminal device 12 of the information regarding the determined background color. Server 13 also notifies lighting control device 17 of a command to perform lighting processing according to that background color (S63).

[0126] Server 13 repeats the process from S62 to S64 until playback of the music data is finished (NO at S64). Once playback of the music data is finished, this flow terminates (YES at S64).

[0127] This allows the web browser display to have an effect similar to glow sticks, and by also controlling the lighting within the event venue, a sense of unity can be achieved within the event venue.

[0128] Next, the payment processing steps S3 and S7 in Figure 4 will be explained. Figure 18 is a sequence diagram of the normal credit card payment processing before or after playback of music data, and the processing based on pre-registered information for contactless payment during music data playback, in this embodiment.

[0129] Before or after playback of music data, the user uses the terminal device 12 to purchase an item as gift information (S71). For example, in Figure 10, tapping the lock object in the gift selection field 83c displays a list of 500pt gift items, and the user can select the gift item they wish to purchase.

[0130] When server 13 obtains gift information for the selected gift item, it displays a payment method input screen for purchasing that gift item on terminal device 12 (S72).

[0131] The user enters their payment method on the payment method input screen using terminal device 12 (S73). Server 13 displays a confirmation screen on terminal device 12 for the user to confirm the information entered on the payment method input screen (S74).

[0132] The user uses terminal device 12 to confirm the confirmation screen and taps the confirm button (S75). The server 13 then performs a credit check with the credit check and payment system 19 (S76). Upon receiving the credit check result from the credit check and payment system 19 (S77), the server 13 notifies terminal device 12 whether the payment is complete or not, depending on whether the sum of the cumulative payment amount over a predetermined period and the current payment amount exceeds a pre-set upper limit, or depending on the credit check result. (S76). If payment is not possible, the terminal device 12 will display a message stating, "Payment could not be completed," and the selected gift item cannot be purchased.

[0133] On the other hand, while music data is playing, the user uses the terminal device 12 to perform an operation to purchase an item as gift information (S81). For example, in Figure 10, when the user taps the lock object in the gift selection field 83c, a list of 500pt gift items is displayed, and the user can select the gift item they wish to purchase.

[0134] When server 13 obtains gift information for the selected gift item, it displays a confirmation screen on terminal device 12 with the purchase details and payment method of the gift item entered, based on the information previously registered in S1 of Figure 4 (S82).

[0135] The user uses terminal device 12 to confirm the confirmation screen and taps the confirm button (S83). The server 13 then performs a credit check with the credit inquiry and payment system 19 (S84). Upon receiving the credit check result from the credit inquiry and payment system 19 (S85), the server 13 notifies terminal device 12 whether the payment is complete or not, depending on whether the sum of the cumulative payment amount over a predetermined period and the current payment amount exceeds a pre-set upper limit, or depending on the credit check result. (S86). If payment is not possible, the terminal device 12 will display a message stating, "Payment could not be completed," and the selected gift item cannot be purchased.

[0136] Figure 19 is a flowchart of the payment process in this embodiment, in which the payment method switches according to the playback of music data. The control unit 32 of the server 13 reads the program according to this embodiment from the storage device and functions as the payment control unit 39, executing the flow in Figure 19. In the following, for convenience, the processing by the control unit 32 will be described as the processing by the server 13.

[0137] When server 13 receives a request to purchase a gift item from terminal device 12 (S91), it determines whether or not music data is currently being played (S92). If music data is not being played (NO in S92), server 13 performs the first payment process (S93).

[0138] In the first payment processing (S93), the server 13 displays a payment method input screen on the terminal device 12 (S93a). Once the terminal device 12 has finished entering the payment method on the payment method input screen, the server 13 accepts that payment method (S93b).

[0139] Server 13 displays a confirmation screen on terminal device 12 for the user to confirm the accepted payment method (S93c). When the user confirms the confirmation screen using terminal device 12 and taps the confirm button, server 13 accepts the confirmation instruction (S93d).

[0140] Server 13 processes the payment for the gift item based on the acquired payment method (S93e). If the acquired payment method is "credit card payment", Server 13 retrieves valid credit card information corresponding to the user ID from the payment method management table 42. Based on the acquired credit card information, Server 13 performs a credit check with the credit check and payment system 19 and processes the payment for that amount.

[0141] If the acquired payment method is deferred payment, server 13 retrieves valid invoice recipient information corresponding to the user ID from the payment method management table 42. Based on the acquired invoice recipient information, server 13 processes the payment for that amount. Server 13 may also cancel the payment process if the sum of the cumulative payment amount for a predetermined period and the current payment amount exceeds a pre-set upper limit. Server 13 notifies terminal device 12 of the result of the payment process (S93f).

[0142] In S92, if music data is being played (YES in S92), the server 13 refers to the payment method management table 42 to determine whether the user has pre-registered for contactless payment (S94). If the user has not pre-registered for contactless payment If the response in S94 is NO, server 13 performs the first payment processing (S93). If pre-registration for contactless payment is registered (YES in S94), server 13 performs the second payment processing. (S95).

[0143] In the second payment processing (S95), the server 13 displays a confirmation screen on the terminal device 12 with the purchase details and payment method of the gift item entered, based on the information previously registered in the payment method management table 42 in S1 of Figure 4 (S95a). When the user confirms the confirmation screen using the terminal device 12 and taps the confirm button, the server 13 accepts the confirmation instruction (S95b).

[0144] Server 13 processes the payment for the gift item based on the acquired payment method (S95c). If the acquired payment method is "credit card payment", Server 13 retrieves valid credit card information corresponding to the user ID from the payment method management table 42. Based on the acquired credit card information, Server 13 performs a credit check with the credit check and payment system 19 and processes the payment for that amount.

[0145] If the acquired payment method is deferred payment, server 13 retrieves valid invoice recipient information corresponding to the user ID from the payment method management table 42. Based on the acquired invoice recipient information, server 13 processes the payment for that amount. Server 13 may also cancel the payment process if the sum of the cumulative payment amount for a predetermined period and the current payment amount exceeds a pre-set upper limit. Server 13 notifies terminal device 12 of the result of the payment process (S95d).

[0146] Figure 20 is an example of a block diagram of the hardware environment of a computer that executes the program in this embodiment. Computer 101 functions as a terminal device 12 or a server 13. Computer 101 consists of a CPU 102, ROM 103, RAM 104, storage device 105, input I / F 106, output I / F 107, communication I / F 108, reader 109, and bus 120.

[0147] Here, CPU refers to the central processing unit. ROM refers to read-only memory. RAM refers to random access memory. I / F refers to the interface. The bus 140 is connected to the CPU 102, ROM 103, RAM 104, storage device 105, input I / F 106, output I / F 107, communication I / F 108, and, if necessary, a reader 109.

[0148] The CPU 102 reads the program according to this embodiment from the storage device 105 and, when functioning as a server 13, executes the program as the user information / payment method registration unit 33, acquisition unit 34, aggregation unit 35, display control unit 36, glow stick control unit 37, location information acquisition unit 38, and settlement control unit 39. The CPU 102 also reads the program according to this embodiment from the storage device 105 and, when functioning as a terminal device 12, executes the program as the reception processing unit and transmission processing unit. When functioning as the reception processing unit, the CPU 102 accepts predetermined operation inputs to the terminal device 12 during the playback of music data composed of multiple sections. When functioning as the reception processing unit, the CPU 102 aggregates gift information transmitted from the terminal device 12 during the first section of the multiple sections during the playback of music data, and transmits the gift information to the server 13 in the second section, which is the section after the first section, according to the received operation input, to display a performance image according to the aggregated value of the gift information acquired during the first section. ROM 103 indicates read-only memory. RAM 104 is memory for temporary storage.

[0149] The storage device 105 is a device for storing large amounts of information. Various types of storage devices can be used as the storage device 105, such as hard disks, solid-state drives (SSDs), and flash memory cards. The storage device 105 stores programs according to the embodiment of the present invention, as well as various data stored in the storage unit 40.

[0150] Input I / F106 can be connected to input devices such as keyboards, mice, electronic cameras, webcams, microphones, scanners, sensors, tablets, touch panels, and information reading devices. Output I / F107 can be connected to output devices such as displays, touch panels, projectors, printers, and speakers.

[0151] The communication interface 108 is an interface such as a port for connecting to a communication network and communicating with other devices. The communication network may be the internet, a local area network (LAN), a wide area network (WAN), a dedicated line, wired, wireless, or other communication network. The reader 109 is a device for reading portable recording media.

[0152] The program that implements the processing described in the above embodiment may be stored, for example, in the storage device 105 via a communication network and communication interface 108 from the program provider. Alternatively, the program that implements the processing described in the above embodiment may be stored in a commercially available and distributed portable storage medium. In this case, the portable storage medium may be set in the reader 105, and the program may be read and executed by the CPU 102. Various types of storage media can be used as portable storage media, such as CD-ROMs, flexible disks, optical disks, magneto-optical disks, IC cards, USB memory devices, and semiconductor memory cards. The program stored in such a storage medium is read by the reader 109.

[0153] Furthermore, the program may be installed on a standalone computer, or it may be installed on a cloud computer and only its functionality provided to the user. In addition, although the screen in this embodiment was displayed using a web browser on the terminal device 12, the screen in this embodiment may also be displayed by installing an application program that can communicate with the server 13 on the terminal device 12.

[0154] According to this embodiment, the performance can be dynamically changed in response to cheering for the target object during an event and the progression of the music. Furthermore, since the response to cheering operations is visually reflected in the performance in real time, it is possible to enhance the user's sense of having sent the gift object themselves and improve the level of interaction.

[0155] Furthermore, the object being supported is not limited to characters from anime or games; it could be a human artist, or even something other than a human, such as an animal or robot. Also, the content of the special effect images is not limited; any kind of effect is acceptable. In this embodiment, sections are pre-set in the music data, but sections may be formed in real time at predetermined timings according to the atmosphere of the moment. Moreover, the sections are not limited to A-melody, B-melodic section, chorus, etc., but may be set arbitrarily.

[0156] The embodiments of this specification have been described above based on the embodiments and modifications described above. The embodiments described above are for the purpose of facilitating understanding of this specification and do not limit it. This specification may be modified and improved without departing from its spirit and the scope of the claims, and equivalents thereof are included in this specification. Furthermore, any technical features that are not described as essential in this specification may be deleted as appropriate. [Explanation of symbols]

[0157] 1. Information Processing System 2 Terminal devices 3. Information Processing Device 3a Acquisition part 3b Tally section 3c Display Control Unit 3D background color control 3e Location information acquisition section 3F Payment Control Unit 4 Display device 5 Acquisition part 6. Payment Amount Determination Section 7. Payment Processing Section 8 Amount Management Department 11 Event Production System 12 Terminal devices 13 Servers 14 PC 15 Display device 16 speakers 17 Lighting control device 18 Event venues 19. Credit Inquiry and Payment System 20 Communication Networks 21 Communications Department 22 Operation display section 31 Communications Department 32 Control Unit 33. User Information / Payment Method Registration Section 34 Acquisition Department 35. Aggregation Department 36 Display Control Unit 37. Cyalume Control Unit 38 Location information acquisition unit 39 Payment Control Unit 40 Storage section 51 Communications Department 52 Output section

Claims

1. While the music data is playing, a gift selection field displaying multiple gift items along with their corresponding points is shown on the user's terminal device display. The gift items displayed horizontally in the gift selection field are switched to gift items based on certain characters and displayed on the terminal device's display when buttons related to multiple characters, which are displayed on the same screen as the gift selection field, are operated. The terminal device is instructed to perform a process that allows the user of the terminal device to select a gift item from among the gift items displayed in the gift selection field. While the aforementioned music data is being played, the display device that displays some of the characters is instructed to perform the following process: move the performance image corresponding to the selected gift item toward the display object that is displayed together with the some of the characters and display it. program.

2. The processor displays a gift selection field on the screen, showing multiple gift items along with their corresponding points, while the music data is playing. The processor switches the display of gift items, which are arranged horizontally in the gift selection field, to gift items based on certain characters when buttons related to multiple characters, displayed on the same screen as the gift selection field, are operated. The processor accepts the selection of a gift item from the gift items displayed in the gift selection field. The processor causes the display device, which displays some of the characters, to display a visual image corresponding to the selected gift item so that it moves toward a display object that is displayed together with some of the characters while the music data is being played. Information processing methods.

3. Equipped with terminal devices and servers, The aforementioned terminal device is While the music data is playing, a gift selection field is displayed on the screen showing multiple gift items along with their corresponding points. The gift items displayed horizontally in the aforementioned gift selection field can be switched to display gift items based on certain characters by operating buttons related to multiple characters, which are displayed on the same screen as the gift selection field. The system accepts the selection of a gift item from the gift items displayed in the aforementioned gift selection field. The aforementioned server, While the aforementioned music data is being played, some of the aforementioned characters are displayed on the display device. The visual image corresponding to the selected gift item is moved and displayed toward the display object that is shown together with some of the characters. system.

Images