Information processing system, information processing method, and program

Abstract

The distribution of special offers will be made more entertaining. [Solution] The system includes an image acquisition unit that captures images of a user receiving guidance via an avatar, an audio acquisition unit that acquires the user's voice, an operation information acquisition unit that acquires operation information of the operator operating the avatar, and a reward selection unit that selects rewards to distribute to the user based on the images, the voice, and the operation information.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program.

Background Art

[0002] In order to attract customers and increase brand awareness, it is common to distribute benefits such as souvenirs and coupons to visitors (for example, Patent Document 1). There are visitors who enjoy collecting souvenirs and those who enjoy using coupons.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in Patent Document 1, benefits corresponding to a campaign are given to members who visit the store, and the benefits to be given are predetermined. Therefore, there is a problem that it is difficult to motivate people who enjoy what kind of benefits will be given to visit the store. In order to make people enjoy collecting souvenirs and using coupons, it is desirable to enhance the entertainment value of distributing benefits such as souvenirs and coupons.

[0005] The present invention has been made in view of such a situation, and an object thereof is to provide an information processing system, an information processing method, and a program that can enhance the entertainment value of distributing benefits.

Means for Solving the Problems

[0006] One aspect of the present invention is an information processing system comprising: an image acquisition unit that acquires images of a user receiving guidance from an avatar; an audio acquisition unit that acquires the user's voice; an operation information acquisition unit that acquires operation information of the operator operating the avatar; and a reward selection unit that selects rewards to be distributed to the user based on the images, the audio, and the operation information.

[0007] One aspect of the present invention is a computer-based information processing method, wherein an image acquisition unit acquires an image of a user receiving guidance from an avatar, an audio acquisition unit acquires the user's voice, and an operation information acquisition unit acquires operation information of the operator operating the avatar. This is an information processing method in which the reward selection unit selects a reward to be distributed to the user based on the image, the audio, and the operation information.

[0008] One aspect of the present invention is a program that causes a computer to acquire images of a user receiving guidance from an avatar, acquire the user's voice, acquire operation information of the operator controlling the avatar, and select a reward to distribute to the user based on the images, the voice, and the operation information. [Effects of the Invention]

[0009] According to the present invention, the distribution of perks can be made more entertaining. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing an example configuration of a reward distribution system in an embodiment. [Figure 2] This figure shows an example of a guidance image displayed on the signage device of the embodiment. [Figure 3] This is a block diagram showing an example configuration of an information processing device in an embodiment. [Figure 4] This figure shows an example of information stored in the guidance history storage unit of the embodiment. [Figure 5] This is a sequence diagram showing the processing flow of the reward distribution system in the embodiment. [Modes for carrying out the invention]

[0011] Embodiments of the present invention will be described below with reference to the drawings.

[0012] (Regarding the bonus distribution system 1) Figure 1 shows an example configuration of a reward distribution system 1 according to an embodiment of the present invention. The reward distribution system 1 comprises an information processing device 10, a signage device 20, an NFT management server 30, an avatar operation terminal 40, and a visitor terminal 50. In the reward distribution system 1, the information processing device 10, the signage device 20, the NFT management server 30, the avatar operation terminal 40, and the visitor terminal 50 are each connected via a communication network NW. The communication network NW is, for example, an information communication network such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. The information communication network may be a wired network, a wireless network, or a combination thereof.

[0013] The signage device 20 is a stationary image display device that includes a display module such as a liquid crystal display. The signage device 20 is installed, for example, near the exit of an exhibition booth in a facility where visitors can explore, such as a zoo. After viewing the exhibition booth, visitors will see the signage device 20 or panel display near the exit and, by operating the visitor terminal 50 according to the instructions on the signage device 20 or panel display, they can receive visitor benefits. The signage device 20 is connected to the information processing device 10 via a communication network NW. The signage device 20 displays instructions regarding the acquisition of digital data distributed as a visitor benefit to the facility, in response to control by the information processing device 10. Various types of digital data can be used, such as digital art, electronic illustrations, games, music, and audio.

[0014] The digital data distributed as a reward for visiting the facility could be, for example, an NFT (Non-Fungible Token) managed on a blockchain. By managing digital data on a blockchain, it becomes difficult to tamper with that data, and it can be made into an NFT, which is digital data whose uniqueness is guaranteed. Alternatively, the digital data distributed as a visitor benefit to the facility could be an SBT (Soul Bound Token: a non-transferable token). By making the digital data an SBT that cannot be transferred to a third party, the visitor benefit can be used as proof that the visitor has visited the facility. Additionally, visitors could receive a commemorative gift by presenting the visitor benefit at the facility's information desk. Alternatively, they could receive discounts on admission fees or other services at related facilities such as other zoos by presenting the visitor benefit obtained at this facility.

[0015] The signage device 20 provides instructions for obtaining the benefits, outlining two procedures. The first procedure involves installing a dedicated application program (hereinafter referred to as the wallet app) on a terminal device operated by the visitor (visitor terminal 50, described later) and creating an account. The second procedure involves using the reading function of the wallet app on the visitor terminal 50 to read a dedicated two-dimensional code displayed on the signage device 20. Here, it is also possible to implement a function corresponding to the wallet app on the web instead of the wallet app installed on the visitor terminal 50. However, in this embodiment, in order to have more visitors use the wallet app, the above procedure is guided while also promoting the installation of the wallet app.

[0016] In this embodiment, assuming that the visitor has difficulty in operating to obtain the privilege or is confused about participating in the campaign to obtain the privilege, the avatar V makes a voice call to the visitor. The avatar V is a character displayed on the signage device 20 and is a clone of the operator (the person who remotely operates the avatar V).

[0017] FIG. 2 is a diagram showing an example of a guidance image displayed on the signage device of the embodiment. In this figure, on the signage device 20, a guidance image G1, G2, a two-dimensional code C, and an avatar V are displayed. For example, the signage device 20 is provided with a panel display such as "If you don't understand, ask the avatar on the screen", and the avatar V in the screen of the signage device makes gestures such as hand movements, body movements, and expressions to prompt the visitor to use the guidance. The guidance image G1 shows an example of a screen displayed when the wallet app is launched on the terminal device. The guidance image G2 shows an example of an NFT obtained as a visitor privilege. The two-dimensional code C is code information for obtaining the visitor privilege. It is shown that on the signage device 20, an NFT as a visitor privilege can be obtained by reading the two-dimensional code C using the reading function of the wallet app.

[0018] The signage device 20 includes, for example, a camera as an imaging unit, a microphone as a sound collection unit, and a speaker as an output unit. These camera, microphone, and speaker may be built into the signage device 20 or externally connected to the signage device 20. The camera as the imaging unit captures the space where the signage device 20 is installed and outputs the captured image to the control unit of the signage device 20. The imaging unit captures, for example, the visitors who view the image displayed by the signage device 20 and the state of the visitors who use the guidance of the avatar V. The control unit of the signage device 20 transmits the image information of the image captured by the imaging unit to the information processing device 10. The microphone as the sound collection unit collects the sound in the space where the signage device 20 is installed, collects the ambient noise in the space and the voices of the visitors who use the guidance of the avatar V, and outputs the collected sound to the control unit of the signage device 20. The control unit of the signage device 20 transmits the sound information such as the voices of the visitors to the information processing device 10. The speaker as the output unit outputs the voice spoken by the operator, the alarm sound and the melody sound according to the operation of the operator. For example, the signage device 20 receives the sound information indicating the voice spoken by the operator notified from the information processing device 10 and the sound and music according to the operation of the operator, and outputs the received sound information to the speaker as the output unit via the control unit of the signage device 20. Thereby, the voice spoken by the operator etc. is output from the speaker. The signage device 20 displays the actions of the operator and the movements according to the operations of the operator as the actions of the avatar V. The movement according to the operation of the operator is, for example, a movement associated with the operation of a controller or the like. When the operator operates a controller or the like, for example, the operator moves the head left and right or nods. For example, the signage device 20 receives the motion information notified from the information processing device 10. The motion information here is information indicating the time-series change of the positions of the body feature points of the operator obtained using motion capture or the like. The body feature points include, for example, the feature points of the face such as the eyes, eyebrows, and corners of the mouth, and the joints of the operating parts such as the neck, shoulders, arms, and hands. Alternatively, the motion information is information indicating the movement according to the operation of the operator. The signage device 20 displays the motion information received from the information processing device as the movement of the avatar V displayed on the screen of the signage device 20 via the control unit of the signage device 20. Thereby, an image in which the actions of the operator etc. are reflected in the movement of the avatar V is displayed.

[0019] Returning to the explanation of Figure 1, the NFT management server 30 is, for example, a server or a computer such as a PC (Personal Computer). The NFT management server 30 issues NFTs as visitor benefits and manages the issued NFTs using a blockchain network (not shown). The blockchain network is a network in which many computers are connected to each other, and each connected computer, called a node, records processing requests notified to the blockchain network from the NFT management server 30, executes processing in accordance with the processing request, and records the results in storage managed by the node. Processing requests are transmitted to each node, and each node executes the same processing in response to that processing request and records the output, so that each node holds exactly the same information even in a distributed environment, making it difficult to tamper with the processing results and managing to maintain correct processing results. The NFT management server 30 issues an NFT as a visitor reward when certain predetermined granting conditions are met. The granting condition here is that the visitor's terminal 50 reads a specific two-dimensional code using the reading function of the wallet application installed on the terminal.

[0020] The avatar control terminal 40 is a terminal used by the operator when controlling avatar V. The avatar control terminal 40 is, for example, a smartphone, tablet, or a computer such as a PC. The avatar control terminal 40 is connected to the information processing device 10 via a communication network NW so as to be able to communicate. The avatar operation terminal 40 is installed, for example, in a different space (within the facility) from the space where the signage device 20 is installed, and remotely operates the avatar V displayed on the signage device 20. For example, during communication with the information processing device 10, the avatar operator receives information such as images of visitors using the avatar V guidance system and the visitors' voices. Based on the received information, the avatar operator terminal 40 displays the visitors' appearance on its monitor and outputs the visitors' questions through the avatar operator terminal 40's speaker. The operator listens to the visitors' questions while observing their appearance and provides answers in response to the visitors' questions. In response to questions, the operator may, for example, make gestures or operate a controller while speaking the answer. The avatar control terminal 40 collects the operator's spoken response via a microphone and transmits information indicating the collected spoken response to the information processing device 10 as voice information for avatar V. The avatar control terminal 40 also acquires information indicating the operator's own movements via motion capture or the like, or acquires information indicating the operator's operation of the controller from the controller, and transmits the acquired information to the information processing device 10 as operation information. The voice information transmitted from the avatar control terminal 40 is transmitted to the signage device 20 via the information processing device 10 and is reflected as the spoken response of avatar V displayed by the signage device 20. In addition, the movement information transmitted from the avatar control terminal 40 is transmitted to the signage device 20 via the information processing device 10 and is reflected in the movements of avatar V displayed by the signage device 20.

[0021] The visitor terminal 50 is a computer operated by the visitor. The visitor terminal 50 is a mobile device such as a smartphone, tablet, or wearable device. The visitor terminal 50 is connected to the NFT management server 30 via a communication network NW. The visitor terminal 50, for example, sends a notification to the NFT management server 30 requesting the issuance of an NFT during communication. In this embodiment, the visitor terminal 50 uses the reading function of a wallet application installed on the terminal to read a specific two-dimensional code, thereby sending a notification to the NFT management server 30 requesting the issuance of an NFT as a visitor benefit. The NFT management server 30 issues the NFT in response to the request from the visitor terminal 50.

[0022] The information processing device 10 is a computer that provides a service for distributing benefits provided by the benefit distribution system 1. The visitor terminal 50 consists of one or more servers (for example, cloud servers). The information processing device 10 is connected to the signage device 20 and the avatar operation terminal 40 via a communication network NW, enabling communication between them. For example, in communication with the signage device 20, the information processing device 10 receives images of visitors and information indicating visitors' voices, and transmits the received information to the avatar operation terminal 40. In addition, in communication with the avatar operation terminal 40, the information processing device 10 receives operation information and voice information of avatar V, and transmits the received information to the signage device 20.

[0023] In this embodiment of the reward distribution service, in order to enhance the entertainment value, multiple types of rewards are prepared, and one of these rewards is given to each visitor. This allows visitors to enjoy wondering which reward they will receive, or to enjoy collecting all of the rewards, thereby more strongly motivating them to visit the facility. Specifically, the information processing device 10 selects a reward to be given to the visitor based on the content of the interaction between the visitor and avatar V. The configuration of the information processing device 10, in particular the configuration related to the process of selecting a reward to be given to the visitor, will be described below.

[0024] (Regarding the information processing device 10) Figure 3 is a block diagram showing an example configuration of the information processing device 10. The information processing device 10 is composed of, for example, an image acquisition unit 101, an audio acquisition unit 102, an operation information acquisition unit 103, a guidance control unit 104, a special offer selection unit 105, an output unit 106, and a user information storage unit 107. The image acquisition unit 101 acquires image information of an image taken of a visitor (user) receiving guidance from Avatar V, and outputs the acquired image information to the guidance control unit 104. The voice acquisition unit 102 acquires voice information indicating the voice of a visitor and outputs the acquired voice information to the guidance control unit 104. The operation information acquisition unit 103 acquires operation information from the operator operating Avatar V and outputs the acquired operation information to the guidance control unit 104. The user information storage unit 107 stores user information. User information is information that indicates the characteristics of the visitor, obtained from the interaction between avatar V and the user (visitor).

[0025] In this embodiment, the characteristics of visitors obtained from interactions between Avatar V and visitors are used as information related to the selection of rewards. This allows different rewards to be given to visitors according to their characteristics, and visitors can enjoy seeing which reward they receive. Moreover, since it is possible to obtain visitor characteristics by utilizing the information obtained during customer service by Avatar V, there is no need to set up dedicated equipment, and the distribution of rewards can be easily done using existing equipment, making it more entertaining.

[0026] Figure 4 shows an example of information stored in the user information storage unit 107. As shown in Figure 4, the user information storage unit 107 stores information corresponding to items such as visitor ID, guidance avatar ID, date and time of visit, and visitor characteristics. The visitor ID is identification information that identifies the visitor. The guidance avatar ID is identification information that identifies the avatar V that guided the visitor identified by the visitor ID. The date and time of visit is the date and time when the visitor identified by the visitor ID was guided by avatar V. Visitor characteristics are information that indicates the characteristics of a visitor identified by their visitor ID, such as age, appearance, and whether or not they are accompanied by someone. However, the items shown in this diagram are not limited to those listed. Various information obtained from the interaction between Avatar V and the visitor may be stored in the user information storage unit 107. For example, if the visitor's hobbies, preferences, or planned activities after arriving at the facility are obtained through conversation with the visitor, that information will be stored in the user information storage unit 107.

[0027] Returning to the explanation of Figure 3, the guidance control unit 104 controls the guidance provided by Avatar V. The guidance control unit 104 enables visitors to receive guidance from Avatar V in response to requests from visitors. Specifically, when a visitor operates an operation button (not shown) on the signage device 20, a guidance request is notified to the signage device 20. The signage device 20 transmits the notified guidance request to the information processing device 10. The guidance control unit 104 of the information processing device 10 connects the signage device 20 and the avatar operation terminal 40 and starts guidance in response to a guidance request notified from the signage device 20. The guidance control unit 104 controls the camera of the signage device 20 to capture images of visitors and transmits the captured images of visitors to the avatar operation terminal 40. The guidance control unit 104 also controls the microphone of the signage device 20 to collect the voice of visitors and transmits the voice of visitors to the avatar operation terminal 40. Furthermore, the guidance control unit 104 transmits the voice information notified from the avatar operation terminal 40 to the signage device 20 so that it is reflected as the voice of avatar V displayed on the signage device 20. Furthermore, the guidance control unit 104 transmits the movement information notified from the avatar operation terminal 40 to the signage device 20 so that it is reflected in the movement of avatar V displayed on the signage device 20.

[0028] Furthermore, the guidance control unit 104 extracts user characteristics from the interaction between Avatar V and the visitor. The interaction between Avatar V and the visitor can be identified based on images acquired by the image acquisition unit 101, audio acquired by the audio acquisition unit 102, and operation information acquired by the operation information acquisition unit 103. For example, the guidance control unit 104 extracts characteristics of visitors, such as age, appearance, and whether or not they are accompanied by others, by performing image analysis on images captured of visitors. Alternatively, the guidance control unit 104 may extract characteristics of visitors by extracting specific keywords indicating age, appearance, and whether or not they are accompanied by others from text information obtained by character recognition of the visitors' voices. Similarly, the guidance control unit 104 may also extract characteristics of visitors from voice information notified from the avatar operation terminal 40 by extracting specific keywords indicating age, appearance, and whether or not they are accompanied by others from text information obtained by character recognition of the voice output as the utterances of avatar V. The guidance control unit 104 stores the extracted visitor characteristics in the user information storage unit 107.

[0029] Furthermore, the guidance control unit 104 may control the camera that takes images so that the characteristics of visitors are captured. For example, the guidance control unit 104 may periodically or irregularly change the field of view while taking images so that the visitor's face, clothing, and whether or not they are accompanied by someone can be identified. More specifically, the guidance control unit 104 may first narrow the camera's field of view to capture the visitor's face in more detail, then gradually widen the camera's field of view to capture the visitor's upper body so that their clothing can be identified, and further widen the camera's field of view to determine whether or not the visitor is accompanied by someone.

[0030] Furthermore, the guidance control unit 104 may instruct the operator of Avatar V to engage in conversation that highlights the characteristics of the visitor. In this case, when the guidance control unit 104 receives a request from a visitor for guidance via avatar V, it first performs a primary extraction to extract the visitor's characteristics using images of the visitor and the visitor's voice. Next, the guidance control unit 104 notifies the avatar operation terminal 40 of the visitor's characteristics that could not be extracted in the primary extraction. At this time, the guidance control unit 104 asks the operator of avatar V to engage in conversation that will elicit the visitor's characteristics and starts the guidance. The operator asks questions such as "Are you accompanied by anyone?" and "If you don't mind, could you tell me your plans for later?" in response to a request from the guidance control unit 104 of the information processing device 10, while observing the visitor's responses. When the guidance is finished, the guidance control unit 104 performs a secondary extraction to extract the visitor's characteristics based on images of the visitor, the visitor's voice, and operation information. The guidance control unit 104 stores the visitor's characteristics extracted in the primary and secondary extractions in the user information storage unit 107.

[0031] Alternatively, the guidance control unit 104 may instruct the operator of avatar V to determine the characteristics of the visitor. In this case, when the guidance control unit 104 receives a request from a visitor for guidance via avatar V, it notifies the avatar operation terminal 40 of the visitor's characteristics to be extracted as information related to the selection of benefits (e.g., age, appearance, presence or absence of companions). The guidance control unit 104 then requests the operator of avatar V to determine the visitor's characteristics during the guidance process and notify the operator of the determination result, and then starts the guidance. The operator of avatar V provides guidance to the visitor and inputs the visitor's characteristics determined during the guidance process into the avatar operation terminal 40. The avatar operation terminal 40 transmits the visitor's characteristics input by the operator to the information processing unit 10. The information processing unit 10 receives the determination result of the visitor's characteristics notified from the avatar operation terminal 40 and outputs the received determination result to the guidance control unit 104. As a result, the guidance control unit 104 obtains the visitor's characteristics determined by the operator of avatar V. The guidance control unit 104 stores the obtained visitor's characteristics in the user information storage unit 107.

[0032] The reward selection unit 105 selects the rewards to be distributed to visitors. The reward selection unit 105 selects the rewards to be distributed to visitors based on the interaction between Avatar V and the visitors, that is, the images acquired by the image acquisition unit 101, the audio acquired by the audio acquisition unit 102, and the operation information acquired by the operation information acquisition unit 103. Specifically, the reward selection unit 105 selects rewards to distribute to visitors based on the information stored in the user information storage unit 107. For example, the reward selection unit 105 selects rewards to distribute to visitors based on the behavioral characteristics of visitors after they arrive at the facility, which are estimated from the information stored in the user information storage unit 107. This makes it possible to distribute rewards that visitors are highly likely to use, according to their predicted behavior.

[0033] For example, the reward selection unit 105 selects a reward to distribute to a visitor based on the visitor's behavior, which is estimated based on the date and time of visit stored in the user information storage unit 107. For example, if a visitor arrives early in the morning, it can be assumed that they will have breakfast or do some shopping after arriving at the facility. Based on this assumption, the reward selection unit 105 selects rewards to distribute to the visitor that can be used at restaurants that serve breakfast or stores that offer early morning discounts, if the visitor arrived in the early morning.

[0034] Alternatively, the reward selection unit 105 may select the rewards to distribute to visitors based on the visitor's behavior, which is estimated based on one or more visitor characteristics stored in the user information storage unit 107. For example, if a visitor is a man in his 30s accompanied by a woman of the same age and a young child, it can be assumed that they are visiting the facility as a family and will use family-friendly restaurants and shops. Based on such assumptions, the reward selection unit 105 selects, for example, rewards that can be used at a family restaurant or amusement park near the facility as rewards to be distributed to the visitor. Furthermore, if the visitor is a woman in her 50s and is visiting with other women of the same age, it can be assumed that they are visiting the facility as part of a sightseeing trip with friends and will use restaurants and shops catering to tourists. Based on this assumption, the reward selection unit 105 selects, for example, rewards that can be used at restaurants offering desserts related to the tourist attraction or at souvenir shops, to be distributed to the visitor.

[0035] Alternatively, the reward selection unit 105 may select the reward to distribute to the visitor based on a randomly selected characteristic from a plurality of visitor characteristics stored in the user information storage unit 107. This prevents the same reward from being selected for visitors who visit multiple times at similar times with similar visitor characteristics. For example, if the reward selection unit 105 selects "age" as one of the options (age, appearance, and presence of companions), it will select rewards appropriate to the age group to be distributed to the visitor. Alternatively, if the reward selection unit 105 selects "appearance" as one of the options (age, appearance, and presence of companions), it calculates a representative color corresponding to the visitor's appearance. The representative color is a statistical quantity calculated by performing statistical processing on the pixel values ​​of each pixel in the image of the visitor, and is, for example, the average color of the image. Alternatively, the color of the clothing the visitor is wearing may be used as the representative color. The reward selection unit 105 selects a reward corresponding to the visitor's representative color to be distributed to the visitor. Alternatively, if the reward selection unit 105 selects "presence or absence of companions" as one of the options (age, appearance, or presence or absence of companions), and if there are companions, it will select a reward corresponding to the companion's representative color to be distributed to the visitor. If there are no companions, it will select a reward corresponding to the visitor's representative color to be distributed to the visitor.

[0036] The output unit 106 outputs the selection result selected by the reward selection unit 105, that is, information indicating the reward to be distributed to visitors. For example, the output unit 106 transmits the selection result to the signage device 20 so that the selection result is reflected in the two-dimensional code C displayed by the signage device 20.

[0037] The functional units of the information processing device 10 (image acquisition unit 101, audio acquisition unit 102, operation information acquisition unit 103, guidance control unit 104, special item selection unit 105, output unit 106) are realized by a hardware processor such as the CPU (Central Processing Unit) of the information processing device 10 executing a program (software). Some or all of these functional units may be realized by hardware (including circuitry) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), and GPU (Graphics Processing Unit), or by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or flash memory (a storage device with a non-transient storage medium), or it may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium) and installed when the storage medium is inserted into a drive device.

[0038] Figure 5 is a sequence diagram showing the processing flow of the reward distribution system 1. This sequence diagram assumes that Avatar V is displayed on the signage device 20 and that a visitor has initiated the operation to start guidance by Avatar V. The signage device 20 captures images of visitors using its camera (step S10) and collects the visitors' voices using its microphone (step S11). The signage device 20 transmits information indicating the captured images of visitors and the collected voices of visitors to the information processing device 10 (step S12). The information processing device 10 receives information from the signage device 20 indicating images of visitors and audio recordings of visitors, and transmits the received information to the avatar operation terminal 40 (step S13). The avatar operation terminal 40 receives information from the information processing device 10 indicating an image of a visitor and information indicating the visitor's voice that has been collected (step S14). Based on the received information, the avatar operation terminal 40 displays the image of the visitor on the monitor and outputs the visitor's voice from the speaker so that the operator can understand the visitor's appearance. The operator observes the visitor's appearance and listens to the visitor's voice before performing actions or speaking to provide guidance. The avatar operation terminal 40 transmits information indicating the actions and speech related to the operator's guidance to the information processing device 10 as operation information (step S15). The information processing device 10 receives operation information from the avatar operation terminal 40 and transmits the received operation information to the signage device 20 (step S16). The signage device 20 receives operation information from the information processing device 10 and reflects the received operation information in the movements and speech of the avatar V displayed on the signage device 20 (step S17). The signage device 20 continues to provide guidance to visitors as shown in steps S10 to S17 until the visitor performs an operation to end the guidance by avatar V.

[0039] Meanwhile, the information processing device 10 generates user information based on the visitor's image and voice received in step S13 and the operation information received in step S16, and stores the generated user information in the user information storage unit 107 (step S18). Based on the user information stored in the user information storage unit 107, the information processing device 10 selects a reward (NFT) to distribute to the visitor (step S19). The information processing device 10 transmits the selection result to the signage device 20 (step S20). The signage device 20 receives the selection result from the information processing device 10 and reflects the received selection result in the two-dimensional code C displayed on the signage device 20 (step S21). For example, the signage device 20 reflects the selection result in the two-dimensional code C by updating the information embedded in the two-dimensional code C to include information specifying that an NFT corresponding to the selection result will be distributed. Alternatively, the signage device 20 may reflect the selection result in the two-dimensional code C by displaying a new two-dimensional code C with information specifying that an NFT corresponding to the selection result will be distributed. The visitor terminal 50 reads the two-dimensional code C displayed on the signage device 20 (step S22). The operator installs the wallet app on their smartphone (visitor terminal 50) and creates an account, following the instructions of avatar V. Then, the visitor launches the wallet app on their smartphone (visitor terminal 50), logs in with their account, and uses the wallet app's reading function to read the two-dimensional code C. The visitor terminal 50 requests the NFT management server 30 to issue an NFT (step S23). When the visitor terminal 50 reads the two-dimensional code C using the reading function of the wallet application, it sends the information embedded in the read two-dimensional code C to the NFT management server 30 based on the processing performed by the wallet application. As a result, the visitor terminal 50 sends a notification to the NFT management server 30 requesting the issuance of an NFT. The NFT management server 30 issues an NFT in response to a request from the visitor terminal 50 (step S24). Here, the NFT management server 30 issues an NFT selected as a reward to be distributed to the visitor based on the information notified by the visitor terminal 50 (information embedded in the two-dimensional code C), and transmits information related to the issued NFT to the visitor terminal 50. The visitor terminal 50 receives the information related to the NFT transmitted from the NFT management server 30. As a result, the visitor terminal 50 acquires the NFT (step S25). For example, the NFTs owned by the visitor will be displayed on the visitor's account My Page in the wallet app. For example, by displaying the acquired NFT on the display screen of the visitor terminal 50 and presenting it at the general information desk, the visitor can obtain a souvenir.

[0040] As described above, the reward distribution system 1 of the embodiment (an example of an information processing system) comprises an image acquisition unit 101, an audio acquisition unit 102, an operation information acquisition unit 103, and a reward selection unit 105. The image acquisition unit 101 acquires images of a visitor (an example of a user) receiving guidance from Avatar V. The audio acquisition unit 102 acquires the visitor's voice. The operation information acquisition unit 103 acquires operation information of the operator operating Avatar V. The reward selection unit 105 selects the rewards to distribute to the visitor based on the images (images acquired by the image acquisition unit 101), audio (audio acquired by the audio acquisition unit 102), and operation information. Thus, the reward distribution system 1 of the embodiment can select the rewards to distribute to the visitor according to the visitor's behavior and interaction with Avatar V. Therefore, visitors can look forward to what kind of rewards they will receive, and the entertainment value of distributing rewards can be increased. Furthermore, since the images (images acquired by the image acquisition unit 101), audio (audio acquired by the audio acquisition unit 102), and operation information are all information obtained when providing guidance via Avatar V, there is no need to acquire new information for selecting rewards. Existing information can be utilized to distribute rewards that are more entertaining.

[0041] Furthermore, the reward distribution system 1 of the embodiment further includes a user information storage unit 107 (an example of a storage unit). The user information storage unit 107 stores user information. The user information is information indicating the characteristics of the user based on images (images acquired by the image acquisition unit 101), voice (voices acquired by the voice acquisition unit 102), and operation information. The reward selection unit 105 selects rewards to distribute to visitors based on the behavioral characteristics of visitors (users) estimated from the user information. As a result, the reward distribution system 1 of the embodiment can select rewards that can be used at stores or restaurants that visitors are likely to use, according to their behavioral characteristics.

[0042] Furthermore, in the reward distribution system 1 of this embodiment, the reward selection unit 105 selects the rewards to be distributed to visitors based on characteristics randomly selected from multiple characteristics of visitors stored as user information. As a result, in the reward distribution system 1 of this embodiment, even if the same visitor visits multiple times with similar characteristics, the same reward will not be selected, and rewards will be distributed in a more entertaining way.

[0043] Furthermore, the reward distribution system 1 of this embodiment further includes a guidance control unit 104. The guidance control unit 104 controls a camera that captures images (images acquired by the image acquisition unit 101). The guidance control unit 104 controls a microphone that collects sound (sounds acquired by the sound acquisition unit 102). The guidance control unit 104 determines the characteristics of the visitor using the images (images acquired by the image acquisition unit 101) and sound (sounds acquired by the sound acquisition unit 102). The reward selection unit 105 selects the rewards to be distributed to the visitor based on the characteristics of the visitor determined by the guidance control unit 104. As a result, the reward distribution system 1 of this embodiment can determine the characteristics of the visitor using a function unit that controls guidance by avatar V, and achieves the same effects as described above.

[0044] Furthermore, in the reward distribution system 1 of the embodiment, the guidance control unit 104 controls the camera that captures the images so that the characteristics of the visitors are captured. As a result, in the reward distribution system 1 of the embodiment, the characteristics of visitors can be easily acquired by controlling the camera so that the characteristics of visitors can be acquired using the function unit that controls guidance by avatar V, thereby achieving the same effects as described above.

[0045] Furthermore, in the reward distribution system 1 of this embodiment, the guidance control unit 104 requests the operator to engage in conversation related to the characteristics of the visitor during the process of guiding the visitor. As a result, in the reward distribution system 1 of this embodiment, the characteristics of the visitor can be acquired through conversation with the operator, achieving the same effects as described above.

[0046] The entirety or part of the reward distribution system 1 and information processing device 10 in the above-described embodiment may be implemented using a computer. In that case, the program for implementing this function may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be loaded into the computer system and executed. Here, "computer system" includes hardware such as the OS and peripheral devices. Furthermore, "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into the computer system. Moreover, "computer-readable recording medium" may also include those that dynamically hold programs for a short period of time, such as communication lines used when transmitting programs via networks such as the Internet or communication lines such as telephone lines, and those that hold programs for a certain period of time, such as volatile memory inside the computer system that acts as a server or client in that case. Furthermore, the above-mentioned program may be for implementing a part of the above-mentioned function, or it may be a program that can implement the above-mentioned function in combination with a program already recorded in the computer system, or it may be implemented using a programmable logic device such as an FPGA.

[0047] While embodiments of this invention have been described in detail above with reference to the drawings, the specific configuration is not limited to these embodiments and includes designs and the like that do not depart from the spirit of this invention. [Explanation of Symbols]

[0048] 1… Reward distribution system (information processing system) 10…Information Processing Devices 101...Image acquisition unit 102...Speech acquisition unit 103...Operation information acquisition unit 104... Guidance Control Unit 105...Selection of Bonus Items 106…Output section 107…User information storage unit 20…Signage device 30…NFT management server 40...Avatar control terminal 50… Visitor terminals

Claims

1. An image acquisition unit that captures images of users receiving guidance via avatars, A voice acquisition unit that acquires the voice of the user, An operation information acquisition unit that acquires operation information of the operator operating the avatar, A reward selection unit that selects a reward to distribute to the user based on the aforementioned image, the aforementioned audio, and the aforementioned operation information, An information processing system equipped with the following features.

2. The system further comprises a storage unit that stores user information, which is a characteristic of the user based on the aforementioned image, the aforementioned audio, and the aforementioned operation information. The reward selection unit selects the reward to be distributed to the user based on the user's behavioral characteristics estimated from the user information. The information processing system according to claim 1.

3. The reward selection unit selects a reward to distribute to the user based on a randomly selected feature from among multiple features of the user stored as user information. The information processing system according to claim 2.

4. The system further comprises a camera for capturing the aforementioned image and a guidance control unit for controlling a microphone for collecting the aforementioned sound, The guidance control unit determines the characteristics of the user using the image and the sound, The reward selection unit selects a reward to distribute to the user based on the user's characteristics determined by the guidance control unit. The information processing system according to claim 1.

5. The guidance control unit controls the camera that captures the image so that the characteristics of the user are captured. The information processing system according to claim 4.

6. The guidance control unit requests the operator to engage in conversation related to the user's characteristics during the process of guiding the user. The information processing system according to claim 4.

7. A signage device that displays the avatar used to guide the user, An avatar operation terminal that acquires the operation information from the aforementioned operator, The signage device and the avatar operation terminal are connected in a communicative manner, and the information processing device has an image acquisition unit, an audio acquisition unit, an operation information acquisition unit, and a special selection unit. Equipped with, The image acquisition unit acquires the image captured by the camera provided in the signage device, The sound acquisition unit acquires the sound collected by the microphone provided in the signage device, The operation information acquisition unit acquires the operation information obtained from the operator by the avatar operation terminal, The aforementioned reward selection unit notifies the signage device of the selection result of the reward to be distributed to the user. The information processing system according to claim 1.

8. A method of information processing performed by a computer, The image acquisition unit acquires images of the user receiving guidance via avatar. The voice acquisition unit acquires the user's voice, The operation information acquisition unit acquires operation information from the operator who operates the avatar, The reward selection unit selects the reward to be distributed to the user based on the image, the audio, and the operation information. Information processing methods.

9. On the computer, The system captures images of users receiving guidance via avatars. The voice of the aforementioned user is acquired, The operator obtains the operation information for controlling the avatar, Based on the aforementioned image, the aforementioned audio, and the aforementioned operation information, the user is made to select a benefit to be distributed to. program.

Images