System, computer program, and remote support system

The system addresses the lack of immersion in remote event participation by associating users with cheering devices at the venue, enabling interactive avatar experiences and real-time engagement, thus enhancing the sense of presence.

JP7712577B2Active Publication Date: 2025-07-24CAPCOM CO LTD
View PDF 11 Cites 0 Cited by

Patent Information

Application Number
JP2024007586
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-01-22
Publication Date
2025-07-24
Estimated Expiration
2041-06-22

AI Technical Summary

Technical Problem

Existing systems fail to provide users with an immersive experience of participating in events like sports or concerts from a remote location, lacking the feeling of being present at the venue.

Method used

A system that associates a user with a cheering device installed at the event venue, allowing output of cheering images and voices, and enables interaction through image and voice input, along with the ability to move the user's avatar to different locations within the venue, and facilitate chat with other users.

Benefits of technology

Enables users to feel as if they are participating in the event by allowing their avatar to engage in real-time interactions and movements, enhancing the sense of presence and immersion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007712577000001
    Figure 0007712577000001
  • Figure 0007712577000002
    Figure 0007712577000002
  • Figure 0007712577000003
    Figure 0007712577000003
Patent Text Reader

Abstract

To provide a system and a computer program which allow an avatar of a user to participate in an event site of an event such as a sport or concert and give a user who is not in the site with feeling as if the user went to the site.SOLUTION: There is provided a system which executes the following steps. In the setting step, a user is associated with at least one of a plurality of supporting devices which is installed in an event site where an event in the actual world is held. In the output step, an output unit connected to the supporting device outputs a supporting image and / or supporting sound.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a system, a computer program, and a remote support system.

Background Art

[0002] In recent years, in events executed in the real world (such as baseball games), a service has been provided to display, at the event venue, a support video solicited from users (such as spectators and viewers) who cannot visit the event venue (see, for example, Non-Patent Document 1).

[0003] Also, a service has been provided to display, at the event venue, a video as if sending cheers based on the photos of the users themselves solicited from users who cannot visit the event venue (see, for example, Non-Patent Document 2).

Prior Art Documents

Patent Documents

[0004]

Non-Patent Document 1

Non-Patent Document 2

Disclosure of the Invention

Problems to be Solved by the Invention

[0005] However, in the service of displaying the aforementioned cheering videos, etc. at the venue, it has been difficult to give users the experience of actually visiting the event venue and participating (cheering) in the event.

[0006] An object of the present invention is to provide a system and a computer program that can allow an avatar of a user to participate in an event venue for an event such as a sport or a concert, and give a user who is not at the venue the feeling of having been to the venue.

Means for Solving the Problem

[0007] The first invention is a system that executes the following steps: In a setting step, associate a user with at least one of a plurality of cheering devices. The cheering device is installed at an event venue where a real-world event is held. In an output step, cause an output unit connected to the cheering device to output a cheering image and / or a cheering voice. It is a system.

[0008] Also, An attribute is set for the cheering device. The price required to associate the user with the cheering device varies depending on the attribute. This can be done.

[0009] Also, The cheering device is installed on the seat at the event venue. This can be done.

[0010] Also, The event venue is a venue for sports, and the cheering device is installed on at least one of a vehicle used by a player participating in the event for movement, a bench on which the player sits, a locker room used by the player, and a field on which the player plays. This can be done.

[0011] Also, the event venue is a venue where a performance is held, the support device is installed on the stage where the performance is held and / or in the dressing room of the performer participating in the performance, which is possible.

[0012] Also, Furthermore, it is a system that executes the following steps: In the image input step, an image and / or text is set based on the user's operation, in the output step, the image and / or text set by the user is displayed on the display unit provided in the support device. which is possible.

[0013] Also, there are multiple types of the image and / or the text, by consuming a price, the user can set the type of the image and / or the text. which is possible.

[0014] Also, Furthermore, it is a system that executes the following steps: In the voice input step, voice is set or input based on the user's operation, in the output step, the voice set or input by the user is output from the speaker provided in the support device. which is possible.

[0015] Also, there are multiple types of the voice by consuming a price, the user can set the type of the voice. which is possible.

[0016] Also, Furthermore, it is a system that executes the following step: In the photographing step, an image photographed by a camera included in the support device is transmitted to the user's terminal device. This can be done.

[0017] Also, Furthermore, a system that executes the following steps, In the matching step, Users associated with the support device having attributes included in predetermined conditions are matched with each other, and Chat or conversation between the matched users is executed. This can be done.

[0018] Also, In the matching step, A plurality of users are matched with one user, and Based on the attributes of the device, the voices of the matched users during conversation are changed. This can be done.

[0019] The second invention is A system that executes the following steps, In the setting step, a user is associated with at least one of a plurality of support devices. The support device is a device managed by the user, and is installed at an event venue where a real-world event is held by transfer. In the output step, a support image and / or support voice is output to an output unit connected to the support device. It is a system.

[0020] The third invention is A computer program that causes a computer to execute the following steps, In the setting step, a user is associated with at least one of a plurality of support devices. The support device is installed at an event venue where a real-world event is held. In the output step, the output unit connected to the support device outputs a support image and / or support voice. It is a computer program.

[0021] The fourth invention is A computer program that causes a computer to execute the following steps: In the setting step, a user is associated with at least one of a plurality of support devices. The support device is a device managed by the user, and is installed at an event venue where a real-world event is held by transfer. In the output step, the output unit connected to the support device outputs a support image and / or support voice. It is a computer program.

[0022] The fifth invention is A remote support system that executes the following steps: In the setting step, a user is associated with at least one of a plurality of support devices. The support device is installed at an event venue where a real-world event is held. In the output step, the output unit connected to the support device outputs a support image and / or support voice. It is a remote support system.

Effect of the Invention

[0023] According to the present invention, it is possible to provide a system and a computer program that allow a user's avatar to participate in an event venue such as a sports event or a concert, and give a user who is not at the venue the feeling of being at the venue.

Brief Description of the Drawings

[0024]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Modes for Carrying Out the Invention

[0025] [First Embodiment] The system 1 according to the embodiment of the present invention will be described with reference to FIGS. 1 to 13. Note that the system 1 and the processing procedures described below are examples, and the embodiments of the present invention are not limited thereto. The system 1 and the processing procedures can be appropriately modified in design without changing the gist of the present invention.

[0026] [Description of System] The system 1 of the present embodiment is composed of the application server device 2 described in FIGS. 1 to 4, the user terminal device 3, the management server device 4, the operation terminal device 5, and the support device 6.

[0027] By the cooperation of these devices (transmission and reception of data by each device), the user can make the user's avatar participate in the event venue where the event is held. In this specification, "participation" means making the user himself or the support device 6 present at the event venue for the purpose of viewing (watching) the event, cheering, etc. The support device 6 is a device set as the user's avatar.

[0028] Note that the support device 6 includes, for example, a movable avatar device (robot-type device) mainly described below and a stationary device configured to be immovable (for example, a fixed camera-equipped device on a pole, an embedded camera-equipped device on a home base, etc.). Hereinafter, although the avatar device and the stationary device are described as the support device 6 without distinction, expressions such as the avatar device are used as necessary.

[0029] The event is various events, festivals, performances, etc., and is, for example, a sports tournament, a game, etc. In the present embodiment, a professional baseball game between Team A (name: A-OSAKA) and Team B (name: B-TOKYO) will be described as an example of the event. The baseball game is held in a stadium (event venue) in the real space.

[0030] In the seats (stands) of the stadium, etc., the support device 6 shown in FIGS. 4 and 5 is installed. The user can participate in the event using the installed support device 6 as their avatar. Specifically, the user can virtually watch (support) a professional baseball game held at the stadium via the support device 6 associated with the user terminal device 3 shown in FIG. 2.

[0031] The user can view the relay video and audio of the game (stadium), the video and audio captured by the support device 6 (viewing video and viewing audio), and output support videos and cheers, etc. to the support device 6 on the user terminal device 3.

[0032] When an application (application program) is executed on the display 320 of the user terminal device 3, a specified image 70 (see FIGS. 6 to 8) and a viewing image 80 (see FIGS. 9 and 10), etc. are displayed. Note that a touch pad 340 for receiving touch input from the user is arranged on the upper surface of the display 320.

[0033] The user can select (reserve) which support device 6 of which stadium (game) (the support device 6 arranged in any area such as behind the back net) to associate themselves with by pressing a predetermined button (operating the touch pad). In this embodiment, the user selects to register for the support device 6 at the stadium of the game between Team A and Team B.

[0034] The specified image 70 in FIG. 6 is displayed on the display 320 after the game (stadium) is selected. The specified image 70 is an image for causing the user to perform various specified operations (selection operations). In this embodiment, in the specified image 70, the user is made to perform specified operations on the seats of the stadium (support device 6) and various options.

[0035] In this embodiment, one support device 6 is installed for each seat in the stadium, and the support device 6 is designated by seat assignment. Unique information is set for the seats in the stadium or the support devices 6. Also, the target specified by the user may be the support device 6, or the user may indirectly specify the support device 6 by specifying a seat.

[0036] As shown in FIG. 6, the designated image 70 is composed of a message display area 71, a designated area 72, and the like.

[0037] In the message display area 71, a message prompting the user to perform a designation operation is displayed. In the designated area 72, items for the user to designate (select) are displayed.

[0038] In seat assignment, as shown in FIG. 6, a message for designating a seat (support device 6) is displayed in the message display area 71, and a list of seat types and prices (seat list) is displayed in the designated area 72. Also, in the designated area 72, a seat map showing the positions of the seats in the floor plan of the stadium is also displayed.

[0039] In the designated image 70 of FIG. 6, after the user taps on the portion (touch pad 340) where the price of the seat (support device 6) in the designated area 72 is displayed, and then designates an empty seat in that area, one seat of the corresponding type is designated as the user's seat (support device 6). As a result, the support device 6 installed in the designated seat is associated with the user terminal device 3 (and the user ID). This associated support device 6 becomes the user's avatar.

[0040] After the seat assignment (designation of the support device 6) is completed, as shown in FIG. 7, a message for designating an output option (option 1) is displayed in the message display area 71. Also, in the designated area 72, a list of option names and prices (option list) is displayed. The option is a service that can be provided to the user associated with the support device 6.

[0041] Options are mainly classified into two types: output options and tour options.

[0042] The output option (Option 1) is a service that causes the display 620 and speaker 630 of the user's own support device 6 to output support (support images, support voices, etc.).

[0043] The support device 6 as an avatar device described below is a robot composed of a head 660, a body 661, a right arm 670, a left arm 680, etc., as shown in FIG. 4. A display 620 is arranged on the body 661, and a speaker 630 is arranged on the head 660.

[0044] For example, when "Uniform (Home)" in FIG. 7 is specified, an image of the upper body of the uniform of Team A is displayed on the display 620 as shown in FIG. 4.

[0045] Also, for example, when "Support Message (Fixed)" in FIG. 7 is specified, a text image of the fixed-form support message is displayed on the display 620.

[0046] When both "Uniform (Home)" and "Support Message (Fixed)" are specified, the text image is superimposed and displayed on the uniform on the display 620.

[0047] Also, for example, when "Play Clapping Sound" is specified, by the user tapping the touch pad 340 at the position corresponding to the support icon button 91 (see FIG. 9), the clapping sound is output from the speaker 630.

[0048] The tour option (Option 2) is a service that allows the support device 6 to participate in an event held at the stadium.

[0049] For example, when "Ride along in the relief car (home)" is specified, the support device 6 can ride along with the relief pitcher when the pitcher of Team A is replaced (obtain the right to ride along). Note that FIG. 10 shows the video projected by the support device 6 (for example, a stationary device) riding in the relief car. That is, this support device 6 can move to the pitcher's mound in the relief car together with the relief pitcher.

[0050] Also, in the case of "Ride along in the relief car (home)", the user can communicate with the relief pitcher via the support device 6. For example, the conversation voice of the user acquired from the microphone 331 of the user terminal device 3 is output from the speaker 630 of the support device 6. Then, the conversation voice of the relief pitcher acquired from the microphone 631 of the support device 6 is output from the speaker 330 of the user terminal device 3.

[0051] In this embodiment, only when riding in the relief car, the association between the user and the support device 6 installed in the seat is changed to another support device 6 installed in the relief car. Note that this is not limited thereto, and the support device 6 associated with the user may be moved to the relief car by the staff at the event venue or the like.

[0052] In the designated images 70 of FIGS. 7 and 8, when the user taps the portion (touch pad 340) where the price of the option in the designated area 72 is displayed, the designated item is designated as the user's option. Note that the user does not have to specify an option, and may specify a plurality of options.

[0053] For the purchase of seats and some paid options, for example, general payment services using a credit card, electronic payment services, or points given by an application (for example, points accumulated according to the number of uses and the amount of use) can be used.

[0054] Next, the viewing image 80 is displayed on the display 320 in the designated image 70 after the seats in the stadium (support device 6) and the option designation are completed. The viewing image 80 is an image for the user to view the video of the game through the support device 6 and the like. The viewing image 80 is composed of a video area 81, a support area 82, an operation area 83, etc. as shown in FIG. 9.

[0055] In the video area 81, a video of the stadium is displayed. In this embodiment, two types of videos are displayed.

[0056] The first is the relay video (distribution video) of the game taken by the cameras installed in the stadium (including fixed cameras, drones, cameras of the relay crew, etc.).

[0057] The second is the viewing video taken by the support device 6 (camera 640) as shown in FIG. 9.

[0058] Also, from the speaker 330 of the user terminal device 3, the sound corresponding to the video area 81 is output. When the viewing video is displayed in the video area 81, the sound acquired from the support device 6 (microphone 631) is output from the speaker 330.

[0059] The display of the relay video and the viewing video is switched every time the switching button 500 (touch pad 340) is tapped. For example, in FIG. 9, the viewing video of the support device 6 at the seat behind the back net (A) is displayed, but when the user taps the switching button 500, the display is switched to the relay video.

[0060] The viewing video (camera 640) can be adjusted by the user tapping the operation buttons 101 to 106 (touch pad 340) in the operation area 83 as shown in FIG. 9.

[0061] In the operation area 83, the operation buttons 101 to 106 are displayed while the viewing video is displayed in the video area 81.

[0062] The operation buttons 101 to 104 are buttons for adjusting the direction of the line of sight of the camera 640 of the support device 6. By operating these buttons, the user can adjust the orientation (up, down, left, right) of the head 660 (camera 640) of the support device 6.

[0063] For example, while the user is touching the operation button 101, the head 660 of the support device 6 can be rotated leftward about the neck portion as an axis. Thereby, the orientation of the camera 640 disposed on the head 660 of the support device 6 is changed.

[0064] The user can adjust the enlargement and reduction (optical zoom) of the shooting object of the camera by operating the operation buttons 105 and 106. The operation button 105 causes the camera 640 to perform a zoom-in function, and the operation button 106 causes the camera 640 to perform a zoom-out function.

[0065] For example, when the operation button 105 (touch pad 340) is tapped while the viewing video is being displayed as shown in FIG. 9, the viewing video is displayed such that the central portion of the screen is enlarged.

[0066] In addition, the user can view not only the game but also the situation around the support device 6 (the situation of the stadium) by operating the operation buttons 101 to 106. That is, the user can view any viewing video according to the movable range of the head 660 (camera 640) of the support device 6.

[0067] Also, in the video area 81, when it is determined that a predetermined condition is satisfied, such as while a designated tour option (riding in a relief car, commemorative photography during a game, etc.) is being executed, the relay video and the viewing video are forcibly switched to the option video.

[0068] The option video is a video taken by the support device 6 (camera 640) in the designated tour option.

[0069] For example, when the "Ride-Along with Relief Car (Home)" tour option is specified, as shown in FIG. 10, the option video captured by the support device 6 (camera 640) riding in the relief car is displayed in the video area 81.

[0070] During the display of the option video in the video area 81, the operation buttons 101 to 106 are also displayed in the operation area 83. Thereby, the user can adjust the option video in the same manner as when viewing the viewing video.

[0071] Also, during the display of the option video in the video area 81, it is also possible to talk to the pitcher riding in the relief car via the microphone 331 of the user terminal device 3 and the support device 6. The voice of the pitcher's speech is acquired by the microphone 631 of the support device 6 and output from the speaker 330 of the user terminal device 3.

[0072] Next, in the support area 82, images of the support icon buttons 91 and 92 related to a part of the specified output option are displayed. The support icon buttons correspond to the output options that are executed only when tapped. In this embodiment, the output option of voice output corresponds to the support icon button.

[0073] For example, when the user specifies "Play Clapping Sound" and "Booing" as output options, as shown in FIGS. 9 and 10, the support icon buttons 91 and 92 are displayed. The support icon button 91 corresponds to "Play Clapping Sound". The support icon button 92 corresponds to "Booing".

[0074] When the user taps these support icon buttons 91 and 92 (touch pad 340), the corresponding voice is output from the speaker 630 of the support device 6. The voice (data) to be output is registered in advance.

[0075] In addition, an image of the chat button 95 is displayed in the support area 82. The chat button 95 receives a request for voice chat. In a voice chat, a user can talk to other users who meet the matching conditions (predetermined conditions) among other users who have the support device 6 participating in the stadium.

[0076] Other users who meet the matching conditions are, for example, other users associated with the support device 6 having the same attribute as the support device 6 of the user who made the chat request.

[0077] The attribute is, for example, the installation location of the support device 6 (type of seat), the team to be supported, a friend user who is in a friend relationship with the user, or a group of users. In the example of FIG. 9, the user is associated with the support device 6 of the seat behind the back net (A). This support device 6 has the attribute of behind the back net (A) set. In this case, other users of the support device 6 with the attribute of behind the back net (A) set are the objects of matching.

[0078] The conversation voice from other users is synthesized with the voice related to the video displayed in the video area 81 and output from the speaker 330 of the user terminal device 3. Also, the conversation voice of the user is acquired by the microphone 331 of the user terminal device 3 and transmitted to the user terminal devices 3 of other users.

[0079] Note that in this embodiment, the support device 6 is managed by the stadium operator (management server device 4). The operator (operation terminal device 5) can instruct the output of video and the like to all the support devices 6 being managed via the management server device 4.

[0080] In this embodiment, the operation terminal device 5 can perform a forced output instruction to all the support devices 6 regardless of whether the support device 6 is associated with a user.

[0081] For example, it is possible to instruct the support device 6 to perform forced output such as stadium sponsor information (advertising images, etc.) and effects with a unified feeling throughout the venue (stadium) (for example, singing the national anthem in unison, images of people in mourning).

[0082] <Hardware Configuration of the System> As shown in FIG. 1, the system 1 includes an application server device (computer) 2, a plurality of user terminal devices (computers) 3, a management server device (computer) 4, an operation terminal device (computer) 5, and an avatar device (computer) 6.

[0083] The application server device 2, the plurality of user terminal devices 3, the management server device 4, the operation terminal device 5, and the support device 6 are connected so as to be able to communicate with each other via a communication network 7 such as the Internet or a LAN.

[0084] A user account is assigned to the user terminal device 3 in association with the user terminal device 3. This user account is managed as a user ID (user identification information).

[0085] When the user terminal device 3 communicates with the application server device 2 via the communication network 6, the user ID is transmitted from the user terminal device 3. The transmitted user ID is authenticated by the server device 2. Thereby, communication between the application server device 2 and the user terminal device 3 becomes possible.

[0086] <Hardware Configuration of the Application Server Device> The application server device 2 has various functions for providing information regarding the progress of the application to the user terminal device 3.

[0087] The application server device 2 provides various types of image information and the like for generating the designated image 70 and the viewing image 80 of the application described above to each user terminal device 3, for example.

[0088] Further, the application server device 2 receives operation information such as a user's designated operation from the user terminal device 3. Then, based on the operation information, the application server device 2 requests the management server device 4 to manage outputs to the support device 6 and the like.

[0089] Furthermore, the application server device 2 controls the progress of the voice chat. Specifically, it assigns (matches) other users with whom the user chats, and transmits voice data between the matched users (user terminal devices 3).

[0090] The application server device 2 includes a control unit 20, a network interface 21, and a storage unit 22. The network interface 21 and the storage unit 22 are electrically connected to the control unit 20 via a bus 29.

[0091] The network interface 21 is connected so as to be able to communicate with each user terminal device 3 and the management server device 4 via a communication network 7 such as the Internet and a LAN.

[0092] The storage unit 22 stores various kinds of information and data. The storage unit 22 is composed of an HDD (Hard Disk Drive), an SSD (Solid State Drive), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.

[0093] Stored in the storage unit 22 are a control program (computer program) for controlling the progress of the application on the user terminal device 3 and various control data.

[0094] Also stored in the storage unit 22 are a distribution program and data for distributing an application program for the user terminal device 3.

[0095] In addition, as shown in FIG. 11, a schedule table, which is information regarding the schedule of the game, is stored in the storage unit 22.

[0096] In the schedule table, a held game ID, a match card, a server ID, seat data, option data, etc. are stored as one record.

[0097] The held game ID is identification information of the game to be held.

[0098] The match card is detailed information (text data) of the game to be displayed on the user terminal device 3. For example, the names of the competing teams, the holding schedule, the stadium name, etc. are included in the detailed information.

[0099] The server ID is identification information of the management server device 4 that manages the stadium where the game is held. In the present embodiment, there are a plurality of stadiums where baseball games are held, and each stadium is managed by a separate management server device 4.

[0100] The seat data includes information regarding the seats in the stadium where the game is held. For example, as shown in FIG. 6, there is information such as the seat type for the user to specify a seat and its price. The seat data may be received from each management server device 4.

[0101] The option data includes information regarding options 1 and 2 provided in the game. In the option data, for example, as shown in FIG. 7, there is information such as an option list for the user to specify an option. The option data can be received from each management server device 4.

[0102] The application server device 2 causes an image to be displayed on the user terminal device 3 based on the schedule table, etc., and allows the user to select a game, an option, etc.

[0103] In addition, a user DB 221 is stored in the storage unit 22.

[0104] The user DB 221 is a database that stores information about users who use the system 1. For example, as shown in FIG. 12, user data, which is information about each user, is stored in the user DB 221.

[0105] User data is described as one record including a user ID, participation information, etc.

[0106] The user ID is the account information (identification information) of the user.

[0107] The participation information is information about the games (stadiums) in which the user's avatar participates. That is, it is information about the stadium where the user is watching (cheering) via the user terminal device 3.

[0108] The game ID is the identification information of the game in which the user participates.

[0109] The seat ID is the identification information of the seat (designated seat) designated by the user. That is, it is the identification information of the seat designated in the above-mentioned designated image.

[0110] The avatar ID is the identification information of the support device 6 installed at the designated seat. The avatar ID includes attribute information. In this embodiment, the information (attribute information) about the installation location (type of seat) of the support device 6 and the seat number are included in the avatar ID. For example, the avatar ID: A-3339R in FIG. 12 includes the attribute information of "A" indicating the attribute of behind the back net (A).

[0111] The output option ID is the identification information of the output option designated by the user. The tour option ID is the identification information of the tour option designated by the user.

[0112] The control unit 20 controls the operation of the application server device 2. The control unit 20 transmits and receives various information and data, and processes various information and data. The control unit 20 includes a CPU (Central Processing Unit) and a semiconductor memory (not shown).

[0113] <Description of the functions of the control unit of the application server device> By executing the aforementioned computer program, the control unit 20 of the application server device 2 functions as the following respective means and executes the following respective steps.

[0114] <Description of the setting step> The control unit 20 executes the setting step by functioning as setting means. Hereinafter, the processing executed by the control unit 20 as the setting means will be described.

[0115] The control unit 20 associates a user with at least one of a plurality of support devices. This support device is the aforementioned support device 6, which is installed at an event venue (stadium) where a real-world event (game) is held. The control unit 20 instructs the management server device 4 to associate the user with the support device 6 at the seat designated by this user based on the participation information received from the user terminal device 3.

[0116] The control unit 20 stores the avatar ID of the support device 6 associated with the user in the storage unit 22 as part of the participation information of this user.

[0117] <Description of the image input step> The control unit 20 executes the image input step by functioning as image input means. Hereinafter, the processing executed by the control unit 20 as the image input means will be described.

[0118] The control unit 20 sets an image (or text) based on the user's operation. The image is a support image to be displayed on the display 620 of the support device 6. The text is a message as a support image to be displayed on the display 620 of the support device 6. The support image corresponds to an output option for displaying an image on the display 620. The control unit 20 stores the option ID of the output option specified by the user in the storage unit 22 as part of the user's participation information.

[0119] <Description of the voice input step> The control unit 20 executes the voice input step by functioning as voice input means. Hereinafter, the processing executed by the control unit 20 as voice input means will be described.

[0120] The control unit 20 sets a voice based on the user's operation. The voice is a support voice to be output to the speaker 630 of the support device 6. The support voice corresponds to an output option for outputting a voice to the speaker 630. The control unit 20 stores the option ID of the output option specified by the user in the storage unit 22 as part of the user's participation information.

[0121] <Description of the tour option input step> The control unit 20 executes the tour option input step by functioning as tour option input means. Hereinafter, the processing executed by the control unit 20 as tour option input means will be described.

[0122] The control unit 20 sets tour options based on the user's operation. The control unit 20 stores the option ID of the tour option specified by the user in the storage unit 22 as part of the user's participation information.

[0123] <Description of the output step> The control unit 20 executes the output step by functioning as output means. Hereinafter, the processing executed by the control unit 20 as output means will be described.

[0124] The control unit 20 causes a display 620 and a speaker 630 (an example of an output unit) connected to the support device (support device 6) to output a support image, a support voice, or the like.

[0125] Specifically, based on the participation information received from the user terminal device 3, operation information of the support icon buttons 91, 92, etc., the control unit 20 instructs the management server device 4 to manage the output to the output unit of the support device 6 associated with the user.

[0126] <Description of execution steps> The control unit 20 executes the execution steps by functioning as an execution means. Hereinafter, the processing executed by the control unit 20 as the execution means will be described.

[0127] Based on the participation information and the like received from the user terminal device 3, the control unit 20 instructs the management server device 4 to execute the tour options of the support device 6 associated with the user.

[0128] <Description of video and audio output steps> The control unit 20 executes the video and audio output steps by functioning as a video and audio output means. Hereinafter, the processing executed by the control unit 20 as the video and audio output means will be described.

[0129] The control unit 20 causes the output information to be output to the display 320 and the speaker 330 of the user terminal device 3 according to the progress of the event.

[0130] The control unit 20 transmits various types of information for causing the output to the display 320 and the speaker 330 to the user terminal device 3 based on the various types of output information described above according to the progress of the event (the progress of the game). As a result, designated images 70 and viewing images 80 as shown in FIGS. 6 to 9 are displayed on the display 320.

[0131] <Description of matching steps> The control unit 20 executes the matching step by functioning as matching means. Hereinafter, the processing executed by the control unit 20 as the matching means will be described.

[0132] The control unit 20 matches users associated with a support device (support device 6) having an attribute included in a predetermined condition (matching condition), and executes a chat (text conversation or voice conversation) between the matched users.

[0133] The control unit 20 refers to the participation information (avatar ID) of each user and matches the users with each other as described above. The control unit 20 stores the user ID of each matched user in the storage unit 22 as matching information.

[0134] The control unit 20 transmits the voice data of the conversation voice of the other party to the user terminal device 3 of each matched user. Note that the chat may be in a form that displays text.

[0135] <Explanation of the change step> The control unit 20 executes the change step by functioning as change means. Hereinafter, the processing executed by the control unit 20 as the change means will be described.

[0136] The control unit 20 causes the orientation of the camera 640 of the support device 6 to be changed. Specifically, the control unit 20 instructs the management server device 4 to change the orientation of the camera or the like based on the operation information of the operation buttons 101 to 106 received from the user terminal device 3.

[0137] <Hardware configuration of the user terminal device> The user terminal device 3 is constituted by a terminal device that can execute applications and video games, such as a smart device such as a smartphone, a personal computer, a PlayStation (registered trademark), an XBox (registered trademark), a Nintendo Switch (registered trademark), and the like.

[0138] In this embodiment, a smartphone will be described as the user terminal device 3. The user terminal device 3 includes a display 320, a speaker 330, a microphone 331, and a touch pad 340. The user terminal device 3 executes an application to display the aforementioned specified image 70 and viewing image 80, and transmits operation information (operation signal) input by the user to the application server device 2.

[0139] As shown in FIG. 2, the user terminal device 3 includes a control unit 30, a network interface 31, a graphic processing unit 32, an audio processing unit 33, an operation unit 34, and a storage unit 35.

[0140] The network interface 31, the graphic processing unit 32, the audio processing unit 33, the operation unit 34, and the storage unit 35 are electrically connected to the control unit 30 via a bus 39.

[0141] The control unit 30 controls the operation of the user terminal device 3. The control unit 30 transmits and receives various information and data, and processes various information and data. The control unit 30 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 30 will be described later.

[0142] The network interface 31 is communicably connected to the communication network 7 to transmit and receive various data between the user terminal device 3 and the application server device 2 or the management server device 4.

[0143] The graphic processing unit 32 draws various images in video format according to various image information output from the control unit 30. The images drawn by the graphic processing unit 32 are output (displayed) to the display 320. For example, the graphic processing unit 32 causes the display 320 to display the specified image 70, the viewing image 80, etc. as various images in video format.

[0144] The audio processing unit 33 outputs (plays) various voices to the speaker 330 according to various voice information output from the control unit 30. For example, the audio processing unit 33 outputs the voice of the image displayed in the video area 81 to the speaker 330 as various voices.

[0145] Also, the audio processing unit 33 generates an analog voice signal and digital voice data (voice data) detected (recorded) by the microphone 331. For example, the audio processing unit 33 generates voice data during a user's conversation (utterance) in a voice chat.

[0146] An operation signal from the user is input to the operation unit 34. The operation signal from the user is input to the operation unit 34 via the touch pad 340 which is an input position detection device. The touch pad 340 is arranged on the upper surface of the display 320.

[0147] The user inputs operation information (operation signal) to the user terminal device 3 (operation unit 34) by operating (tapping) the location where the support icon buttons 91, 92, etc. displayed on the display 320 are shown.

[0148] The storage unit 35 is composed of an HDD, SSD, RAM, ROM, etc. Various data downloaded from the application server device 2, various programs such as application programs, etc. are stored in the storage unit 35. Also, the user ID used in the application server device 2 is stored in the storage unit 35.

[0149] <Explanation of the functions of the control unit of the user terminal device> The control unit 30 functions as the following respective means and executes the following respective steps by executing the application program downloaded from the application server device 2. <Explanation of the application execution step> The control unit 30 executes the application execution step by functioning as the application execution means. Below, the processing executed by the control unit 30 as the application execution means will be described.

[0150] Based on the operation of the touch pad 340 by the user, the control unit 30 causes the user to specify a game and the seats (support device 6) in the stadium where the game is held.

[0151] Also, based on the operation of the touch pad 340 by the user, the control unit 30 specifies options (output options and tour options).

[0152] Also, the control unit 30 receives the user's operation on the support icon button (touch pad 340) displayed on the display 320.

[0153] Also, the control unit 30 receives the user's operation on the operation button (touch pad 340) displayed on the display 320.

[0154] Also, the control unit 30 receives the user's operation on the chat button (touch pad 340) displayed on the display 320.

[0155] Also, during voice chat execution, the control unit 30 generates voice data of the user's conversation.

[0156] Also, based on information transmitted from the application server device 2 and the like, the control unit 30 causes the specified image 70, the viewing image 80, etc. to be displayed on the display 320.

[0157] <Explanation of communication step> The control unit 30 executes the communication step by functioning as a communication means. Hereinafter, the processing executed by the control unit 30 as the communication means will be described.

[0158] The control unit 30 receives information such as an application program, image information for display on the screen of the application, and voice information from the application server device 2, for example.

[0159] In addition, the control unit 30 transmits, for example, the user's identification information (user ID), participation information, operation information of the support icon button, operation information of the operation button, chat button, voice data, etc. to the application server device 2 based on the user's operation.

[0160] <Hardware Configuration of the Management Server Device> The management server device 4 has various functions for providing information regarding a baseball game at the stadium to the application server device 2.

[0161] In addition, the management server device 4 has various functions for managing the support devices 6 installed in the stadium.

[0162] As shown in FIG. 1, the management server device 4 includes a control unit 40, a network interface 41, and a storage unit 42.

[0163] The network interface 41 and the storage unit 42 are electrically connected to the control unit 40 via a bus 49.

[0164] The control unit 40 controls the operation of the management server device 4. The control unit 40 transmits and receives various information and data, and processes various information and data. The control unit 40 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 40 will be described later.

[0165] The network interface 41 is communicatively connected to the application server device 2, the operation terminal device 5, and a plurality of support devices 6 via a communication network 7 such as the Internet and a LAN.

[0166] The storage unit 42 stores various information and data. The storage unit 42 is composed of an HDD, an SSD, a RAM, a ROM, etc.

[0167] The storage unit 42 stores a computer program and data for controlling each support device 6.

[0168] In addition, the storage unit 42 also stores a computer program and data for transmitting various data to the application server device 2.

[0169] In addition, the storage unit 42 stores a support DB 421.

[0170] The support DB 421 is a database that stores a plurality of types of support image information and a plurality of types of support voice information, etc., which are output targets of the support device 6, as data for executing output instructions to the display 620 and the speaker 630, etc. of the support device 6.

[0171] In this embodiment, the support DB 421 stores output information (support image information and support voice information) corresponding to output options. The support image information is, for example, an image such as the team uniform to be displayed on the display 620. The support voice information is, for example, voice data such as applause. Also, in association with the output of the output information, operation information when operating the arm part, etc. of the support device 6 is also stored in association with the output information.

[0172] In addition, the storage unit 42 stores a local user DB 422.

[0173] The local user DB 422 is a database that stores information about users associated with the seats (support devices 6) in the stadium corresponding to the management server device 4.

[0174] For example, the local user DB 422 stores information about users among the users registered in the user data of FIG. 12 for whom a game (game ID) held in the stadium managed by the management server device 4 is set. For example, the local user DB 422 of the management server device 4 (server ID: AS - 01) stores information about the user (user ID: UA - 00001, etc.) of game ID: AB - 01.

[0175] For example, in the local user DB 422, user data in the same format as that in FIG. 12 is stored for the aforementioned users. The information in the user management table of the local user DB 422 is synchronized with the user management table in FIG. 12.

[0176] <Description of the functions of the control unit of the management server device> By executing the aforementioned program, the control unit 40 of the management server device 4 functions as the following respective means and executes the following respective steps.

[0177] <Description of the setting step> The control unit 40 executes the setting step by functioning as the setting means. Hereinafter, the processing executed by the control unit 40 as the setting means will be described.

[0178] The control unit 40 associates a user with the seat (support device 6) specified by the user. Specifically, the control unit 40 registers the user ID and participation information received from the application server device 2 in the local user DB 422.

[0179] In addition, when the seat is already associated with another user, the association request from the user is rejected.

[0180] <Description of the avatar control step> The control unit 40 executes the avatar control step by functioning as the avatar control means. Hereinafter, the processing executed by the control unit 40 as the avatar control means will be described.

[0181] When the control unit 40 receives an output instruction from the application server device 2, it causes a display 620 and a speaker 630 (an example of an output unit) connected to the support device (support device 6) to output a support image, a support voice, or the like.

[0182] Specifically, the control unit 40 instructs the output unit of the support device 6 associated with the user based on the participation information received from the application server device 2, operation information of the support icon buttons 91, 92, etc.

[0183] Also, when the control unit 40 receives a change instruction from the application server device 2, it changes the orientation of the camera 620 connected to the support device (support device 6). Specifically, the control unit 40 instructs the support device 6 to make a change based on the operation information of the operation buttons 101 to 106 received from the application server device 2.

[0184] Also, when the control unit 40 receives a forced output instruction from the operation terminal device 5, it forcibly outputs sounds, etc. to the display 620 and the speaker 630 (an example of the output unit) connected to the target support device (support device 6). For example, it outputs sponsor information of the stadium, a unified production throughout the venue (stadium) (e.g., singing the national anthem in unison, an image of mourning).

[0185] <Explanation of the video acquisition step> The control unit 40 executes the video acquisition step by functioning as a video acquisition means. Hereinafter, the processing executed by the control unit 40 as the video acquisition means will be described.

[0186] The control unit 40 acquires relay video information (including audio information) of a baseball game at the stadium. The acquisition of the relay video information is performed, for example, from a video server device (not shown) via the communication network 7.

[0187] Also, the control unit 40 acquires viewing video information captured by the camera 620 connected to the support device 6 and viewing audio information acquired from the microphone 630. Also, the control unit 40 transmits the acquired video information, etc. to the application server device 2 together with the identification information of the support device 6.

[0188] <Tour execution step> The control unit 40 executes the tour execution step by functioning as a tour execution means. Hereinafter, the processing executed by the control unit 40 as the tour execution means will be described.

[0189] When the control unit 40 receives an execution instruction from the application server device 2, it executes the tour options of the support device 6 associated with the user according to the progress of the baseball game (for example, pitcher change, home run).

[0190] For example, when the above-mentioned pitcher change occurs, the control unit 40 changes the support device 6 associated with the user who specified the option of "riding in the relief car (home)" to the support device 6 installed in the relief car. Also, when a player hits a home run, the control unit 40 changes the support device 6 associated with the user who specified the option of "sitting on the player bench" to the support device 6 installed on the player bench.

[0191] And during the pitcher change, the control unit 40 transmits information on the execution of the tour option to the application server device 2.

[0192] Also, the control unit 40 causes the speaker 630 of the support device 6 installed in the relief car to output the user's conversation voice acquired from the microphone 331 of the user terminal device 3.

[0193] Also, at the time of pitcher change, in the video acquisition step, image information captured by the camera 640 connected to the support device 6 installed in the relief car and voice information acquired from the microphone 631 are acquired.

[0194] Note that the information on the progress of the baseball game is set, for example, by the administrator of the operation management device 5 or the like.

[0195] <Hardware Configuration of the Operation Terminal Device> The operation terminal device 5 is a terminal device for the stadium operator. The operation terminal device 5 is constituted by a terminal device capable of executing an application, such as a smart device such as a smartphone or a personal computer.

[0196] In this embodiment, a personal computer will be described as the operation terminal device 5. The operation terminal device 5 is connected to a display 520, a speaker 530, and a keyboard 340. The operation terminal device 5 executes an application and transmits operation information (operation signal) input by the operator to the management server device 4.

[0197] As shown in FIG. 3, the operation terminal device 5 includes a control unit 50, a network interface 51, a graphic processing unit 52, an audio processing unit 53, an operation unit 54, and a storage unit 55.

[0198] The network interface 51, the graphic processing unit 52, the audio processing unit 53, the operation unit 54, and the storage unit 55 are electrically connected to the control unit 50 via a bus 59.

[0199] The control unit 50 controls the operation of the operation terminal device 6. The control unit 50 transmits and receives various information and data and processes various information and data. The control unit 50 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 50 will be described later.

[0200] The network interface 51 is communicably connected to the communication network 7 in order to transmit and receive various data between the operation terminal device 5 and the management server device 4.

[0201] The graphic processing unit 52 draws various images in video format according to various image information output from the control unit 50. The images drawn by the graphic processing unit 52 are output (displayed) to the display 520. For example, the graphic processing unit 52 causes the display 520 to display an operation screen or the like for receiving an output instruction for the aforementioned support device 6.

[0202] The audio processing unit 53 outputs (plays back) various sounds to the speaker 530 according to various audio information output from the control unit 50.

[0203] An operation signal from an operator is input to the operation unit 54. An operation signal from a user is input to the operation unit 54 via the keyboard 540.

[0204] The storage unit 55 is composed of an HDD, an SSD, a RAM, a ROM, etc. Various programs such as application programs for operators and control data are stored in the storage unit 55. In addition, a user ID (operator ID) used in the management server device 4 is stored in the storage unit 55.

[0205] <Explanation of the functions of the control unit of the operator terminal device> By executing the aforementioned application program for the operator, the control unit 50 functions as the following respective means and executes the following respective steps. <Explanation of the output step> The control unit 50 executes the output step by functioning as an output means. Hereinafter, the processing executed by the control unit 50 as the output means will be described.

[0206] The control unit 50 causes an image or the like to be output to the display 620 and the speaker 630 (an example of an output unit) connected to all target support devices (support device 6). As described above, sponsor information of the stadium, an effect with a sense of unity throughout the venue (stadium) (for example, singing the national anthem in unison or an image of mourning) is forcibly output.

[0207] Specifically, based on the operator's operation information and the like, the control unit 50 instructs the management server device 4 to manage the output to the output units of all the target support devices 6.

[0208] <Description of the communication step> The control unit 50 executes the communication step by functioning as a communication means. Hereinafter, the processing executed by the control unit 50 as a communication means will be described.

[0209] The control unit 50 receives information such as image information and audio information to be displayed on the screen of the application from the management server device 4, for example.

[0210] Further, the control unit 50 transmits the operator's identification information (user ID), output instructions, etc. to the management server device 4 based on the operator's operation information, for example.

[0211] <Hardware configuration of the avatar device> The support device 6 is installed at an event venue (stadium) where a real-world event (baseball game) is held, and has various functions for a corresponding user to perform support and the like via the support device 6. Note that the support device 6 is driven by a built-in battery (not shown).

[0212] As shown in FIG. 4, the support device 6 includes a display 620, a speaker 630, a microphone 631, a camera 640, a head 660, a torso 661, a left arm 607, and a right arm 608.

[0213] The head 660, the right arm 670, and the left arm 680 are connected to the torso 661.

[0214] On the front side of the head 660, the camera 640 and the microphone 631 are arranged.

[0215] On the front of the torso 661, the display 620 and the speaker 631 are arranged.

[0216] Also, as shown in FIG. 5, the support device 6 includes a control unit 60, a network interface 61, a graphic processing unit 62, an audio processing unit 63, a storage unit 64, a right arm drive unit 67, a left arm drive unit 68, and a head drive unit 66.

[0217] The network interface 61, the graphic processing unit 62, the audio processing unit 63, the storage unit 64, the right arm drive unit 67, the left arm drive unit 68, the head drive unit 66, and the camera 604 are electrically connected to the control unit 60 via a bus 69.

[0218] The control unit 60 controls the operation of the support device 6. The control unit 60 transmits and receives various information and data, and processes various information and data. The control unit 60 includes a CPU and a semiconductor memory (not shown). The functions of the control unit 60 will be described later.

[0219] The network interface 61 is communicably connected to a communication network 7 to transmit and receive various data between the support device 6 and the management server device 4.

[0220] The graphic processing unit 62 draws various images in video format according to various image information output from the control unit 60. The images drawn by the graphic processing unit 62 are output (displayed) to the display 620. For example, the graphic processing unit 62 causes the support image to be displayed on the display 620.

[0221] The audio processing unit 63 outputs (plays back) various sounds to the speaker 630 according to various audio information output from the control unit 60. For example, the audio processing unit 63 causes the support sound to be output to the speaker 630.

[0222] Also, the audio processing unit 63 generates an analog audio signal and digital audio data (audio data) detected (collected) by the microphone 631. For example, the audio processing unit 63 generates audio data of the sound generated in the stadium.

[0223] The storage unit 64 is composed of an HDD, SSD, RAM, ROM, etc. Various programs for controlling the operation of the avatar device, control data, etc. are stored in the storage unit 64. Also, an avatar ID is stored in the storage unit 64.

[0224] Also, the imaging unit 65 causes the camera 650 to perform imaging according to the information output from the control unit 60. The camera (imaging unit) 650 includes an optical lens, a CCD image sensor (CCD), an imaging signal processing unit, etc., and generates image data obtained by photographing the stadium. The camera 640 transmits the generated image data to the control unit 60.

[0225] The head drive unit 66 includes a motor, etc., and rotates the head 660 in the vertical and horizontal directions. By rotating the head, the imaging direction of the camera 603 is adjusted. Note that a general configuration can be adopted for the rotation configuration in each of the drive units 65 to 67.

[0226] The right arm drive unit 67 includes a motor, etc., and rotates the right arm 670 in the vertical direction. The left arm drive unit 68 includes a motor, etc., and rotates the left arm 680 in the vertical direction.

[0227] <Explanation of the functions of the control unit of the avatar device> By executing the aforementioned program, the control unit 60 of the support device 6 functions as the following respective means and executes the following respective steps. <Explanation of the output step> The control unit 60 executes the output step by functioning as an output means. Hereinafter, the processing executed by the control unit 60 as the output means will be described.

[0228] The control unit 60 extracts the output target (output information) from the output instruction received from the management server device 4 and outputs it to the graphic processing unit 62 and the audio processing unit 63. As a result, the graphic processing unit 62 outputs (displays) the support image on the display 620, and the audio processing unit 63 outputs (plays back) the support voice from the speaker 630.

[0229] <Description of Driving Steps> The control unit 60 executes an output step by functioning as a driving means. Hereinafter, the processes executed by the control unit 60 as a driving means will be described.

[0230] The control unit 60 drives each of the drive units 65 to 67 based on the change instruction received from the management server device 6. As a result, the head 660, the right arm 670, and the left arm 680 rotate.

[0231] In addition, the control unit 60 drives each of the drive units 65 to 67 in response to the output of cheering voices or the like.

[0232] <Description of Imaging Step> The control unit 40 executes an imaging step by functioning as an imaging means. Hereinafter, the processes executed by the control unit 40 as an imaging means will be described.

[0233] The control unit 40 acquires viewing video information captured by the camera 640 and viewing audio information acquired from the microphone 631. In addition, the control unit 40 transmits the acquired video information and the like to the management server device 4 together with the identification information of the support device 6.

[0234] <Description of Support Execution Process> Hereinafter, with reference to FIG. 13, the support execution process of the present invention performed in the system 1 will be described. In FIG. 13, one user terminal device 3 and one management server device 4 are used, but a support execution process may be executed using a plurality of user terminal devices 3 and a plurality of management server devices 4.

[0235] First, the control unit 50 of the operation terminal device 5 executes a status update step and transmits information on the progress of the game to the management server device 4 (step S500).

[0236] The progress of the game includes information such as player bus movement, waiting in the player locker, 30 minutes before the game starts, singing the national anthem together, during the game (inning information), pitcher change, scoring such as a home run, end of the game, and interview. For example, the operator inputs the progress situation into the operation terminal device 5 and sends it from the operation terminal device 5 to the management server device 4. This step is executed every time an input is made by the operation administrator.

[0237] Next, when the control unit 40 of the management server device 4 receives the progress of the game, it executes an update step (step S300).

[0238] In this step, the progress of the game stored in the storage unit 42 is updated. This step is executed every time the management server device 4 receives the progress of the game.

[0239] Also, the control unit 30 of the user terminal device 3 executes a selection step and receives selection operations (designation operations) for the game (stadium) to participate in, the seat (support device 6), the output option, and the tour option (step S105).

[0240] Also, in the selection step, the control unit 30 sends the participation information to the application server device 2. The user terminal device 3, for example, after the application is launched, receives game information, seat information, etc. from the application server device 2, etc., displays a designated image 70, etc., and causes the user to execute the above operation via the touch pad 340.

[0241] Next, the control unit 20 of the application server device 2 executes a setting step and executes settings related to the received participation information (step S205). For example, the control unit 20 sends a setting instruction to the management server device 4 together with the participation information. Also, the control unit 20 registers the participation information as user data in the user DB221 in association with the user ID of this user.

[0242] Next, the control unit 40 of the management server device 4 executes a setting step based on the setting instruction from the application server device 2 (step S305). For example, the control unit 40 executes a setting for associating the seat of the game (support device 6) specified by the user with the user.

[0243] Also, in this step, the control unit 40 also registers information such as output options and tour options included in the participation information. Specifically, the control unit 40 registers the received user ID and participation information in the local user DB 422.

[0244] Next, the control unit 20 of the application server device 2 executes an information acquisition / output step, acquires various information from the management server device 4, and executes transmission of output information to the display 320 and the speaker 330 of the user terminal device 3 (step S210).

[0245] For example, the control unit 20 requests (transmission start request) the management server device 4 to start transmission of various information such as relay video and viewing video, and output to the support device 6.

[0246] Also, the control unit 20 transmits an output start instruction including relay video, viewing video, etc. to the user terminal device 3 in order to display the above-described viewing image 80. The information acquisition / output step is repeatedly performed until step S255 described later. Also, the relay video and the viewing video are displayed, for example, from 30 minutes before the start of the game until the end of the interview of the winning team's players after the end of the game.

[0247] Also, the viewing video may be distributed outside the distribution time of the relay video. For example, the viewing video may be displayed after the distribution of the relay video has ended. Thereby, the user can participate in, for example, an option tour after the end of the game, and can also enjoy the afterglow after the end of the game via the support device 6.

[0248] Next, the control unit 40 of the management server device 4 executes an information acquisition / transmission step based on the transmission start request from the application server device 2 (step S310).

[0249] In this step, various information such as the progress status information of the game, the relay video, and the viewing video is acquired and transmitted.

[0250] For example, the control unit 40 requests the support device 6 to start transmitting the viewing video (including viewing audio) captured by the camera 640 and the microphone 631. Also, the control unit 40 starts the acquisition process of the relay video. Note that the information acquisition / transmission step is repeatedly performed until step S355 described later.

[0251] Next, the control unit 60 of the support device 6 executes a shooting step based on the transmission start request from the management server device 4 (step S410). In this step, the control unit 60 transmits the viewing video (including viewing audio) captured by the camera 640 and the microphone 631 to the management server device 4. Note that the shooting step is repeatedly performed until step S455 described later.

[0252] Also, the control unit 30 of the user terminal device 3 starts an output step based on the output start instruction from the application server device 2 (step S110). Thereby, based on the various information received from the application server device 2, the display of the viewing image 80 on the display 320 and the output of the audio are executed. Note that the output step is repeatedly performed until step S155 described later.

[0253] Also, the control unit 40 of the management server device 4 executes a support output I step based on the participation information (step S315).

[0254] In this step, for the output options to be output to the support device 6 that do not require a button operation by the user (operation of the support icon button), the output to the support device 6 is executed. As this output option, for example, there is an output option for outputting a uniform image to the display 620 of the support device 6.

[0255] Based on the user's participation information, the control unit 40 determines a support video (for example, a uniform image) to be output to the support device 6, and issues an output start instruction I to the display 620 of the support device 6. For example, the control unit 40 transmits the output start instruction I to the support device 6 together with output information (such as image information) such as the support video.

[0256] Next, the control unit 60 of the support device 6 executes a support output I step based on the output start instruction I from the management server device 4 (step S415). In this step, the control unit 60 causes the support image to be displayed on the display 620 based on the received output information. Note that the support output I step continues to be output until step S455 described later.

[0257] Also, when the switching button is operated by the user, the control unit 30 of the user terminal device 3 executes a video change step and switches the display content of the video area 81 to either the relay video or the viewing video (step 120). As described above, the user can execute the video change by tapping the switching button (the touch pad 340 corresponding to the position where the switching button is displayed).

[0258] Also, when the support icon button is operated by the user, the control unit 30 of the user terminal device 3 executes a support request step and transmits operation information (option ID) to the application server device 2 (step S125). As described above, the user can execute the support request by tapping the support icon button (the touch pad 340 corresponding to the position where the support icon button is displayed).

[0259] Next, when the control unit 20 of the application server device 2 receives operation information of a support icon button (for example, booing 92) from the user terminal device 3, it executes a support output II step (step S225). Specifically, the control unit 20 transmits a support output instruction II including the operation information (option ID) to the management server device 4.

[0260] Next, the control unit 40 of the management server device 4 executes a support output II step based on the support output instruction II from the application server device 2 (step S325). In this step, based on the operation information (option ID), a support voice to be output to the support device 6 is determined, and an output start instruction II is transmitted to the support device 6.

[0261] The control unit 40 transmits the output start instruction II to the support device 6 together with, for example, output information (voice data, arm posture information, etc.) corresponding to the support voice. The arm posture information is, for example, the rotation angle of the arm.

[0262] Next, the control unit 60 of the support device 6 executes a support output II step based on the output start instruction II from the management server device 4 (step S425). In this step, the control unit 60 outputs a support voice to the speaker 630 based on the received output information, and rotates the arm parts 607 and 608. Note that the support output II step ends after the output of the specified support voice is completed.

[0263] Also, when the control unit 30 of the user terminal device 3 receives an operation of an operation button from the user, it executes a camera operation request step and transmits operation information (operation ID) to the application server device 2 (step S130). As described above, the user can execute a camera operation request by tapping the operation button (the touch pad 340 corresponding to the position where the operation button is displayed).

[0264] Next, when the control unit 20 of the application control server device 2 receives the operation information of the operation button from the user terminal device 3, it executes the camera change step (step S230). Specifically, the control unit 20 transmits a change instruction including the operation information (operation ID) to the management server device 4.

[0265] Next, the control unit 40 of the management server device 4 executes the camera change step based on the change instruction from the application server device 2 (step S330).

[0266] In this step, based on the operation information (operation ID), the posture and zoom (scale ratio) of the head 660 of the support device 6 are determined, and a change instruction is transmitted to the support device 6.

[0267] For example, the control unit 40 transmits a change instruction to the support device 6 together with control information such as the posture and zoom (scale ratio) of the head 660 of the support device 6.

[0268] Next, the control unit 60 of the support device 6 executes the camera change step based on the change instruction from the management server device 4 (step S430). In this step, the control unit 60 sets (changes) the rotation of the head 660 and the zoom magnification based on the received setting information.

[0269] Note that the rotation of the head 660 and the zoom magnification changed in the change step are maintained until a new change instruction is received or until the shooting step ends.

[0270] In addition, when the control unit 30 of the user terminal device 3 receives an operation of the chat button from the user, it executes the chat start request step and transmits a chat start request to the application server device 2 (step S140). As described above, the user can execute a chat start request by tapping the chat button (the touch pad 340 corresponding to the position where the chat button is displayed).

[0271] Next, when the control unit 20 of the application control server device 2 receives a chat start request from the user terminal device 3, it executes a matching step (step S240).

[0272] Specifically, the control unit 20 assigns other users who meet the matching conditions for the user as chat partners for the user's voice chat. There may be one or more other users. Further, the control unit 20 registers the user ID of the chat partner in the user data of each matched user.

[0273] Furthermore, when the matching is successful, the control unit 20 sends a chat start instruction to the user terminal device 3 of each user for whom the matching is successful.

[0274] Next, the control unit 20 of the application server device 2 executes a chat communication step (step S245).

[0275] In this step, the control unit 20 receives the voice data of the speech of the user during matching from each user terminal device 3 and sends it to the user terminal device 3 of the other user. This step is continuously executed until the chat ends, for example, when the user performs an operation to end the chat.

[0276] Also, when the control unit 30 of the user terminal device 3 receives a chat start instruction from the application server device 6, it executes a chat execution step (step S145).

[0277] In this step, the control unit 30 sends the voice data of the speech of the user acquired via the microphone 331 to the application server device 2. Also, the control unit 30 receives the voice data of the speech of the other user from the application server device 2 and outputs it from the speaker 330.

[0278] This step is continuously executed until the chat ends, for example, when the user performs an operation to end the chat.

[0279] Further, when the output condition is satisfied, the control unit 50 of the operation terminal device 5 executes a forced output step (step S535).

[0280] In this step, for example, all the support devices 6 in the stadium are forced to output production videos (including audio). The output conditions include, for example, that the progress of the game is in a specific situation, or a forced output instruction is input from the operator, etc.

[0281] For example, when the progress of the game is the singing of the national anthem (a specific situation), an image of the national flag such as the Rising Sun Flag in accordance with the singing of the national anthem is displayed on the displays 630 of all the support devices 6 in the stadium. In this case, the control unit 50 transmits a forced output instruction to the management server device 4 together with output information such as the image information of the national flag.

[0282] Also, for example, in the case of a specific situation designated by the sponsor (such as when the offense and defense alternate), the control unit 50 displays the sponsor's advertisement video on the displays 630 of all the support devices 6 in the stadium. As a result, the advertisement video is reflected in the relay video. Also, the visitors to the stadium can directly see the advertisement video, which also has an appealing effect on the visitors.

[0283] Also, in this step, when the end condition is satisfied, the control unit 60 transmits a forced output end instruction to the management server device 4 and ends this step. The end condition is, for example, that the singing of the national anthem (a specific situation) has ended.

[0284] Next, when the control unit 40 of the management server device 4 receives a forced output instruction from the operation terminal device 5, it executes a forced output step (step S335).

[0285] In this step, the control unit 40 forces the output device 6 that is the output target to perform an output. Specifically, the control unit 40 transmits a forced output instruction including output information to the target support device 6. For example, a forced output instruction including the image information (output information) of the national flag is transmitted to all the support devices 6 in the stadium.

[0286] Also, in this step, when the control unit 40 receives a forced output end instruction from the operation terminal device 5, the control unit 40 transmits the forced output end instruction to the avatar terminal device 6 and ends this step.

[0287] Next, when the control unit 60 of the support device 6 receives a forced output instruction from the management server device 4, the control unit 60 executes a forced output step (step S435).

[0288] In this step, the control unit 60 interrupts the execution of the support output I step being executed and causes the national flag image to be displayed on the display 620.

[0289] Also, in this step, when the control unit 60 receives a forced output end instruction from the management server device 4, the control unit 60 ends this step and resumes the execution of the interrupted support output I step.

[0290] Also, when the execution timing of the tour option arrives, the control unit 40 of the management server device 4 executes an execution step (step S350). After the process of step S310, the control unit 40 continuously determines the arrival of the execution timing of the designated tour option by referring to the participation information of each user in the local user DB422.

[0291] For example, when the progress of the game reaches the pitcher change, the control unit 40 determines that the execution timing of the "relief car ride (home)" tour option has arrived and executes "relief car ride". If it is not the home team's pitcher change, "relief car ride (home)" is not executed.

[0292] In this step, the control unit 40 temporarily changes the support device 6 associated with the user from the support device 6 of the seat to the support device 6 of the relief car. As a result, a support image or the like is also output to the display 620 of the support device 6 of the relief car.

[0293] Also, in this step, the control unit 40 requests the support device 6 of the relief car to start transmitting the viewing video (including the viewing audio) captured by the camera 640 and the microphone 631. Note that the control unit 60 of the support device 6 of the relief car executes the shooting / output step based on the transmission start request and the voice output instruction from the management server device 4. The control unit 60 transmits the viewing video (including the viewing audio) captured by the camera 640 and the microphone 631 to the management server device 4. Also, the control unit 60 outputs the voice data received from the management server device 4 from the speaker 630.

[0294] Also, in this step, the control unit 40 transmits a tour option output instruction to the application server device 2 together with the output information of the viewing video (including the viewing audio) received from the support device 6 of the relief car.

[0295] Also, in this step, the control unit 40 requests the support device 6 of the relief car for a voice output instruction including the voice data of the user's spoken voice received from the user terminal device 3 (application server device 2).

[0296] Also, in this step, when the end timing of the tour option arrives, the control unit 40 returns the association of the support device 6 associated with the corresponding user to the support device 6 of the original seat. As a result, a support image or the like is output again to the display 620 of the support device 6 of the original seat, and a relay video is output to the display 320 of the user terminal device 3.

[0297] When the end timing of the tour option arrives, the control unit 40 transmits a tour option end instruction to the application server device 2 and ends this step.

[0298] Next, based on the tour option output start instruction from the management server device 4, the control unit 20 of the application server device 2 executes the tour option output step (step S250).

[0299] In this step, the control unit 20 transmits a tour option output instruction to the user terminal device 3 together with the output information of the viewing video (including viewing audio) captured by the relief car support device 6.

[0300] Also, in this step, the control unit 20 transmits the voice data received from the user terminal device 3 to the management server device 4.

[0301] Also, in this step, when the control unit 20 receives a tour option end instruction, it transmits the tour option end instruction to the user terminal device 3 and ends this step.

[0302] Next, based on the tour option output start instruction from the application server device 2, the control unit 30 of the user terminal device 3 executes the tour option output step (step S150). As a result, the viewing video captured by the relief car support device 6 is displayed on the display 320 (video area 81). Also, the audio of this viewing video is output from the speaker 330.

[0303] Also, in this step, the control unit 30 transmits the voice data of the user's spoken voice acquired from the microphone 331 to the application server device 2.

[0304] When the control unit 30 receives a tour option end instruction from the application server device 2, it ends this step.

[0305] When the video display ends, such as when the control unit 40 of the management server device 4 can no longer obtain the relay video of the baseball game, the information acquisition / transmission step ends (step S355). The control unit 40 sends an end instruction to the application server device 2 and the support device 6.

[0306] Through the above steps, the support execution process of the present invention is executed.

[0307] Summarizing the above, the present invention is A system that executes the following steps: In the setting step, associate a user with a plurality of support devices 6. The support device 6 is installed at the event venue where the real-world event is held. In the output step, output a support image and support audio to the display 620 and speaker 630 connected to the support device 6. It is a system.

[0308] <Effect of the Invention> According to the present invention, it is possible to provide a system and a computer program that allow a user's avatar to participate in an event venue such as a sports event or a concert, giving the user who is not at the venue the feeling of being at the venue.

[0309] Specifically, by installing the avatar device associated with the user at the event venue, the user can, for example, watch the event through the camera installed on the avatar device, and at the same time, the user can, for example, issue support at the event venue through the display and speaker installed on the avatar device.

[0310] Furthermore, according to the present invention, for example, the user can send a support image / cheer to a player or the like through the avatar device, while the player can also provide fan services to the user through the avatar device.

[0311] [Second Embodiment] Not limited to the first embodiment, a support device managed by a user may be used in the system of the present invention.

[0312] The support device in the present embodiment is, for example, as shown in FIG. 14, a support device 610 managed by a user.

[0313] The support device 610 is not installed in the stadium (event venue) from the beginning. For example, by using a carrier or the like, the user can transfer it from his / her hand to the stadium.

[0314] In the present embodiment, before the transfer of the support device 610, the user performs designation operations such as a game, a seat, and options.

[0315] Next, the user registers his / her support device 600 with the management server device 400 of the stadium where the game is held.

[0316] Thereby, information for various devices to start communication with the support device 610, such as the IP address of the support device 610, is registered in the local user DB (user data) in association with the user.

[0317] Note that the information for starting communication is transmitted from the user terminal device 300 to the management server device 400 via the application server device 200.

[0318] After the communication connection between the management server device 400 and the support device 610 is completed, the user may transfer the support device 610 to the stadium.

[0319] After arriving at the stadium, the support device 610 is arranged at a designated position (seat) by, for example, the stadium operator.

[0320] The arranged position can be automatically displayed on the display of the support device 610 after power-on, for example, based on information specified by the user.

[0321] By starting the application on the user terminal device 300 from a predetermined time before the event starts, the user can watch viewing videos and the like.

[0322] After the game ends, the support device 610 is transferred back to the user's hands using a carrier or the like again.

[0323] Also, not limited to the above, the user himself / herself may bring the support device into the venue and install it. Furthermore, the user may use a shuttle bus for the support device to transport the support device to the venue.

[0324] Furthermore, when the support device is a self-propelled device (such as a bipedal walking robot), the user can set a destination for the support device and move it to the venue.

[0325] Other configurations and effects are the same as those of the above-described embodiment.

[0326] [Third Embodiment] In the first and second embodiments, a robot-type avatar device is used as the support device. However, various devices can be used as long as they can output support images and / or support voices.

[0327] For example, as shown in FIG. 15, a liquid crystal display having a wireless communication function may be used as the support device. The liquid crystal display 600 is provided with a camera, a microphone, a speaker, etc., similar to the above-described avatar device.

[0328] In this case, as shown in FIG. 15, the user's own face photo can be displayed on the liquid crystal display 600 together with the image of the uniform of the team to be supported. In this case, the user's own face photo may be a real-time video or a still image taken in advance.

[0329] Furthermore, a single user may be associated with a plurality of adjacent liquid crystal displays 600. In this case, as a multi-monitor, a single user can be displayed largely.

[0330] Other configurations and effects are the same as those of the above-described embodiment.

[0331] [Other Embodiments] In the above-described embodiment, the event was a baseball game, but it may be a game of other sports such as soccer, golf, tennis, or combat sports, a public gambling such as horse racing or boat racing, or e-sports. Further, the event may be an entertainment such as a concert or an overseas tour.

[0332] For example, when the event is e-sports, a support device may be installed not only at the seat where the user sits, but also at a position where the operation of the player's controller can be imaged.

[0333] In e-sports, golf, tennis, etc., the support device may be controlled so as not to reproduce (or reduce the volume) according to the reproduction status of the cheering from the support device so as not to interfere with the concentration of the player. Also, among the users who support the player via the support device, cheering, chat, etc. may be reproduced via the user terminal device.

[0334] Also, in a movie theater, a theater for a play, etc., for example, when there is a support screening (a screening where the audience can send cheers while waving a penlight, etc.), the support device may be able to output sound.

[0335] Further, the application server device or the management server device may be able to detect a manner violation in which a user utters or displays a prohibited term via the support device. In this case, the application server device or the like can forcibly control (prohibit) the output from the support device associated with the user who violates the manner.

[0336] Also, when an application server device or the like can detect a violation of manners as described above, when a user with a certain number of manner violations makes a next seat reservation, etc., restrictions may be imposed on the user (the user may not be able to make a reservation, or may only be able to reserve seats far from the players).

[0337] Further, as an example where the progress situation of the game is a specific situation, when the theme song of Team A (or Team B) is played, etc., the team color may be displayed on the display of the support device, or an emblem or a support message may be displayed across a plurality of support devices.

[0338] Furthermore, in the event of an emergency such as an earthquake, an evacuation route may be displayed on the display of the support device to guide the visitors.

[0339] Also, in the above-described embodiment, an example is described in which the support device associated with the user is changed at the start timing of the tour option, but the present invention is not limited to this. For example, when the start timing of the tour option arrives, in addition to the support device associated with the corresponding user, temporary association may be additionally made with another support device (for example, a support device on board a relief car).

[0340] Also, not limited to the above-described embodiment, a plurality of types of uniforms such as home uniforms, away uniforms, and third uniforms may be prepared. The user can purchase the images (skins) and display them as optional images on the display of the support device.

[0341] Furthermore, the user can purchase various goods images such as towels, megaphones, and hats and display them on the support device. In this case, for example, the image of the towel is displayed over the uniform image.

[0342] In addition, the image displayed on the support device may be not only an image of the user's face photo but also an avatar image displayed in a three-dimensional model. Also, the user may be able to customize the avatar image by variously changing the facial parts or hairstyle of the avatar image.

[0343] In addition, a plurality of types of facial parts of the avatar image displayed on the display of the support device may be prepared, and there may be prepared parts that can be used for free and parts that can be used for a fee.

[0344] In addition, the support device may include a light-emitting device, and the light-emitting device may be made to emit light based on the user's operation.

[0345] In addition, one support device may be placed inside the radio booth where a famous person conducts as a DJ or the like, and a user as a listener may be associated with the support device. In this case, based on the processing (such as a lottery) of the operation terminal device, the user associated with the support device is changed, and the user associated at that time can talk to the entertainer.

[0346] Not limited to the above embodiment, the support device may be fixed in advance to the seat in the stadium. And in this case, when the user reserves the seat, the user may be able to try to view the viewing video from the seat (support device).

[0347] The user may be able to change the volume or voice output from the support device via the user terminal device. For example, by the user performing a payment process for a fee, for example, the volume of the user's cheering may be increased, and also, the voice output from the support device may be changed by a voice changer.

[0348] Moreover, the support device is not limited to the one installed on the seat. The support device may be a camera-equipped device embedded in the seat backrest, a base such as first base, a mound, etc., or may be a camera-equipped device distributed and arranged at multiple positions in the event venue. That is, the support device only needs to be equipped with any one of a camera, a microphone, a speaker, and a display.

[0349] Also, the support device may be a device that can move on the pitcher's side, inside the stadium, or in the air. Further, the support device may move on a rail, may move by itself, or may fly like a drone.

[0350] Not limited to the above embodiment, the camera of the support device may be controlled by the support device itself. For example, image recognition processing and tracking processing may be performed based on the camera video of the support device, and the camera may be controlled to follow the ball during the game.

[0351] Also, the movement of the camera of the support device may be controlled in conjunction with the line of sight or orientation of the HMD (head-mounted display) worn by the user. In this case, for example, it is sufficient if the user wears the HMD, sets a reference posture and a reference line of sight, and can register the information in the application server device. Based on this information, the camera of the support device may be controlled based on the posture and the like changed from the basic posture and the like.

[0352] The viewing video is not only displayed on the user terminal device of the user associated with the support device, but may also be displayed on the user terminal device of another user. Further, this viewing video may be displayed as a distribution video.

[0353] Also, the support device may be equipped with a 360-degree camera such as an omnidirectional camera or a hemispherical camera.

[0354] Not limited to the above-described embodiment, a user may be able to specify a support device installed other than the seats in the stadium. For example, the user may be able to select any one of the images obtained by a plurality of fixed-point cameras installed in the stadium.

[0355] Furthermore, while allowing spectators to enter the stadium as in the past, it may be possible to register the user's own user ID in the stationary devices installed in the stadium. In this case, for example, if a stadium can accommodate a maximum of 30,000 people and 100 support devices (avatar devices, stationary devices) are installed in the stadium, and 100 users can be registered for each device, a larger number of spectators, up to 40,000 people, can be accommodated than in the past.

[0356] Also, in a stadium that can accommodate a maximum of 30,000 people, when the admission limit is 5,000 people, in addition to 5,000 visitors (5,000 seats), support devices (25,000 seats) can be allocated to 25,000 people who provide remote support.

[0357] Also, when seats in the stadium remain unsold (when empty seats occur), the operator may install a support device in that seat (in the support device installed in that seat) and sell the right to view the video from that seat. In this case, even a user who cannot visit the stadium can watch the game by associating himself / herself with the support device of that seat until the event ends.

[0358] Also, as another example, a system that executes the following steps: In an output step, an output unit connected to the support device outputs a support image and / or a support voice. A predetermined medium (for example, an object imitating a mascot character, etc.) can be connected to the support device. In the output step, the support image and / or the support voice are changed according to the attributes of the medium (information such as the team being supported). There is a system.

[0359] In this case, by connecting an object such as a mascot character to the support device, for example, the user can change the support content according to the attributes of the object.

[0360] Moreover, not limited to the above embodiment, a plurality of users may be associated with one support device. In this case, when outputting support videos or the like, the display of the support device may be divided, or the videos of the users may be switched every predetermined time. Also, for one option (for example, when viewing a video based on the perspective of a camera mounted on a catcher's mask or an umpire's mask, a fee of 500,000 yen is required), it may be possible for multiple people to purchase the option by splitting the cost.

[0361] Not limited to the above embodiment, the relay video and the viewing video by the support device may be displayed simultaneously. Furthermore, based on the user's operation, the relay video and the viewing video may be switched.

[0362] Not limited to the above embodiment, the user may be able to specify (or change) output options or the like during the game.

[0363] Also, the support device may be installed on the bench where the players (reserve players) participating in the game are seated, the locker room used by the players, and the field where the players play. Also, in the case of an event such as a concert, the support device may be installed on the stage where the event is held and in the control room of the performers participating in the event.

[0364] Furthermore, by developing the present invention, new services can be provided to the users in the event venue as follows.

[0365] For example, even when the user is not present remotely, the user may be associated with a support device installed at a location where the user normally cannot go, such as sitting in their designated seat. Specifically, cameras are attached to equipment such as a pitcher's hat, a catcher's mask (or umpire's mask), a bench, and a base. By registering their user terminal device with the application server device, the user can watch (experience) images that are not normally visible through an avatar while being at the venue (remotely).

[0366] For example, while sitting in a seat in the stadium (outfield seat), the user can view, on their user terminal device, an image based on the catcher's line of sight (the camera viewpoint of the support device attached to the catcher's mask).

[0367] Also, on the user terminal device of the venue user, the tour options of the above embodiment may be specified. As a result, the venue user can also view relay images and viewing images, etc. on their user terminal device. In this way, additional services can also be provided to the venue user using the system of the present invention.

[0368] Not limited to the above embodiment, the volume of the conversation voice of the other matched user may be adjusted while a voice chat is being conducted.

[0369] For example, the volume may be adjusted so that the conversation voice with the other user corresponding to the support device arranged in a seat far from the seat of the user's support device becomes smaller. As a result, the user can obtain a sense of presence as if they were having a conversation at the stadium even during a voice chat.

[0370] Note that the avatar ID of the user's support device includes the seat number. Therefore, by referring to the avatar ID and comparing the seat position of the user's support device with the seat position of the other user's support device, the distance between the seats may be determined.

[0371] In addition, not only before the start of the event, but also after the event has started, the user may be able to associate themselves with any of the support devices. That is, the application server device may be able to accept seat and option specifications by the user even after the event has started. In this case, it is possible to reduce the remaining unsold tickets after the event has started. Furthermore, the fee paid by the user may vary depending on the length of the time elapsed after the event has started (or the time until the scheduled end time of the event).

[0372] Also, in order to protect a user who leaves their seat (leaves the stadium) during the event (from the start to the end of the event), the rights such as the seat and options purchased by that user may be transferable to other users. In this case, for example, the necessary information such as the game ID and avatar ID may be transmitted and received between the users who transfer the rights, and it is sufficient if the transfer of money can be done using a general electronic payment service. These operations may be performed via the application server device, or may be performed between user terminal devices.

[0373] Furthermore, a user who leaves their seat (leaves the stadium) during the event (from the start to the end of the event) may be able to view the viewing video from the support device associated with that seat thereafter. As a result, even after leaving the seat for various reasons (such as going to the toilet or shopping at the concession stand, or going home), the user can view the video from that seat via the user terminal from any location, and will not miss a scoring scene or the like.

[0374] In the above-described embodiment, an example is described in which a plurality of devices such as an application server device, a management server device, and an operation terminal device are used. However, the present invention is not limited to this. For example, the functions of the application server device, the functions of the management server device, and the functions of the operation terminal device may be executed by one device. In this case, it is only necessary that the one device and an application program (for example, the A-OSAKA application) are prepared for each stadium.

[0375] Also, when a specific situation (for example, a player hits a comeback home run) is established, the management server device may use the display of the support device for a mascot game (or dye it in the team color, etc.). Alternatively, the management server device may drive the arm drive unit of the support device to execute a wave on the support device.

[0376] In addition, in the above, measures may be taken to prevent the resale of the right to view an event by a malicious user.

[0377] For example, in the above system, when the users associated with a predetermined number or more of support devices are all the same user (user ID), it may be determined whether the user is a user (for example, a cheering squad registered as a team supporter, a sponsor, etc.) who has been pre-registered in the system (for example, pre-reviewed by an operator).

[0378] And, when the user is a user who has not been pre-registered, the user ID etc. associated with the support device may be temporarily invalidated. Thereby, it is possible to exclude a user who installs a plurality of support devices in a stadium and resells the right to view an event.

[0379] Also, in the above-described system, instead of the support device, a holography device (or an Augmented Reality device, an IC chip) connected with a camera, a microphone, and a speaker may be installed on a stadium seat, a vehicle used by a player for movement, a bench where a player sits, etc. When the holography device is installed, instead of a physical support device, a hologram of the support device can be displayed. As the hologram, for example, a hologram of the user himself / herself or a hologram of an avatar registered by the user can be considered.

[0380] Also, not limited to the above, instead of installing one support device for each seat, a support device equipped with a camera that follows the movement of the ball, for example, may be installed for each area. In this case, without limiting the number of seats, as an area ticket, the right to associate a user with a support device may be sold.

[0381] Also, not limited to the above, a user may be able to install support devices at two or more stadiums (for example, a swimming stadium, a judo venue) simultaneously. In this case, for example, even when games are held at the same time, the user may be able to switch between stadiums by pressing a button or watch the games by splitting the screen.

[0382] Also, when the user's support device malfunctions or the like, based on the user's operation (or the processing of the management server device), the user ID may be temporarily registered in the support devices of other users existing in adjacent seats. Thereby, it is possible to avoid problems such as the user being unable to view the video until the support device becomes normal.

Explanation of Signs

[0383] 1 System 2 Application Server Device 3 User Terminal Device 4 Management Server Device 5 Management Terminal Device 6 Support Device (Avatar Device, Stationary Device) 7 Communication Network

Claims

1. A system comprising a computer and a plurality of support devices, which causes the computer to execute the following steps: In the setting step, one user is associated with each of the support devices on a one-to-one basis. In the image input step, a support image is set. In the customization step, an operation signal from the user to the user terminal device is received, and the customized support image is set. In the output step, each of the support devices displays the support image for the associated user. The support device is installed in advance at an event venue where a real-world event is held. System.

2. In the setting step, one user is associated with a plurality of the support devices. In the output step, one of the support images is displayed for each of a plurality of adjacent support devices. The system according to Claim 1.

3. A computer program that causes a computer communicably connected to a plurality of support devices to execute the following steps: In the setting step, one user is associated with each of the support devices on a one-to-one basis. In the image input step, a support image is set. In the customization step, an operation signal from the user to the user terminal device is received, and the customized support image is set. In the output step, each of the support devices displays the support image for the associated user. The support device is installed in advance at an event venue where a real-world event is held. Computer program.

Citation Information

Patent Citations

  • Remote utilization method

    JP1999025188A

  • Providing system, terminal, toy, providing method, program, and medium for sound source data

    JP2003114692A

  • Character information service system and method and character doll suitable for this

    JP2004504741A

  • Internet-based monitor-top type simulation learning system and learning method

    JP2004530157A

  • Display system for installation in venue

    JP2013020389A